2023-07-10T23:41:33.691 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-10T23:41:33.692 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332875 --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332875/orig.config.yaml 2023-07-10T23:41:33.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T23:41:33.838 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332875 branch: wip-pdonnell-testing-20230710.195410 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} email: pdonnell@redhat.com first_in_suite: false job_id: '7332875' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-pdonnell-testing-20230710.195410 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20230710.195410 sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 948 sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 sleep_before_teardown: 0 subset: 199/512 suite: fs suite_branch: wip-pdonnell-testing-20230710.195410 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt25siIA6MYEBXhiCv8Bh93AzbLdnUocN++/TZL3ckhP9mgFiHaNXym8D8ZkWco36nOZBf3EvmS7ljKYtS4wrfABUlXrDnWV+mXfWU9O6k57OA/e4UGzMvG+D/cLBuyZAiUMOeDAF9Kpo4R7rJreoDo8ML4k9QZbZMcYvUcsWhPDR9YO+Ot/fLgQtv2/lH44eyS+6jt2Wq9EJ5p+CKbLkTaNQNY3D66uNSeji78SCSPT3wngit8y20TFS+Gh/KmvlMfumYrT7cuv/4xMmOkrE9nQ9ATx9/aeNM2N003vQzjrOBZyLOgYD9ERN5+/2jOt/ehKmof50igLcDpwaEZC01rZc0NPFHDzn+OjMUqKkqo5BD32ZNn0yPNWy+RUBuLYSRkIx7WbGL6elYK5wh2YNoO/VAgBBFxMrf03+tSZnm5amdA4Hu9iiXmPY+7medWlAYhEnTP8TrpwjrZCMGGQBmjawmLXmv1RkKABSb9gQqrZvISpdwmLEI2Icimnh7ajU= smithi070.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5gBBeJ4VIYP9vAIimgxj78oANJ9g7eg70vSqsHyG+lmebF66wBndpoVukGYR4AeXvced9I5TnFxDB40f9ZNMQGS1afS4KHB4VAsZbvNrw5G+ERa3oHkKOWOCIUKUxas9PheklXwIHMePr2sqq2sonMPKjWbBwDYet6AEUeazLI4Ldc+LOGxu9ooPWDk1qPnHljoQJVqMV00R4VK+at7CK7ZWccPOvxRM1az9N5tg4Bb5ldI1p2nipqtVpQDXU3v57jCdnHB6CwLnfp8bWsR/IUUkfneYaphRQl8Llth42rsKGvI8dvJa5o91PXWuufci++TCdLRXERgwHQaQPyCpfhIpVg2Hy10feHikhtXFBnCV1af9nXLJPNz6YhjAOdLfH7rPhfMr6Ys/TvNftSsJ7B6NXm6kUFm/1GQQaEz3UxXazzwHT5eWkIPaUC5hwy7SgxkebKg1XTei/CJXHrsLME6W0uq6Z0Xqma3cMkwakr4RKid3cuztANLQUd5HBgA0= smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpDcpGz7PBH8tYX9I/hzmzNwG2Mn5lCyVvUJaRp2Hj+gCq0J8PzbvI5jAozgDMGdIdPszbgQTeM94bdrDsms1zqnTpXBQlGGhALsNm5+KL2E6InCjd4dD2cqv1u3GyYIQ1fFsInFL9Gbwlioio3/eVv5vloKcTOuqC400u/GyPorT27QR/fvLvURNGaOZYqpBPrllyxUlEZBlJ/jKhUskCNUJONqU9BhHS98Yxrybo/LCWmDWiXqQS45GPwET6ZeCAC8zB5INSwmdZy3c9g3ORoOMrW1SL6203lqp4rgt3aYTU+l1oouj+KVzhVtDb3wEgUzJpBXpMMXrzyvqs9lC1aoTT8wLFSiKSr+KdIAevoIIeevdxGCeXO7OgamvDxzFLDkX1bR2FOw1BEHacaxKJKruD4mdt7vuBSr0yImAGo7+zHG800m/WTiDwoULAuHbj0kBZwjDCQegg99YJZHjHrtOcgCmk28npuuaVyy7NY0Ad1jMwW4p+XEekFSRLFAs= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-10_22:55:54 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-10T23:41:33.838 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/qa; will attempt to use it 2023-07-10T23:41:33.839 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/qa/tasks 2023-07-10T23:41:33.839 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-10T23:41:33.841 INFO:teuthology.task.internal:Checking packages... 2023-07-10T23:41:33.869 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2' 2023-07-10T23:41:33.870 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-10T23:41:33.870 INFO:teuthology.packaging:ref: None 2023-07-10T23:41:33.870 INFO:teuthology.packaging:tag: None 2023-07-10T23:41:33.871 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20230710.195410 2023-07-10T23:41:33.871 INFO:teuthology.packaging:sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-10T23:41:33.871 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20230710.195410 2023-07-10T23:41:34.008 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4828.gb5891ed6 2023-07-10T23:41:34.008 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-10T23:41:34.015 INFO:teuthology.task.internal:no buildpackages task found 2023-07-10T23:41:34.015 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-10T23:41:34.022 INFO:teuthology.task.internal:Saving configuration 2023-07-10T23:41:34.045 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-10T23:41:34.050 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-10T23:41:34.080 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 23:35:46.027769', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD6SW2XJbLX4zmoDFjqCvpHTEVUQ5TjapYEKFMvnup8sMp3LRKWTj7LeEje4+MSS5rz/Dtct5sraXtUnykBx/xA='} 2023-07-10T23:41:34.108 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 23:35:46.029342', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOlvYPH8zOEf1VX3LlCmruOJMxQi/EBlIJ7PnfZXPBBJKLNsMR920TeZI/okoplV0aLpSMVeu7TX4qqRnNz6JRI='} 2023-07-10T23:41:34.135 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 23:35:46.030674', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDoUHNA/CCZAVcMSGymt7nnlGwzNcYAu+PQ0qj1DStGg4+o56MYzNgIlplshlo+xjCzswA6J0+L4DIe8ruC4I8E='} 2023-07-10T23:41:34.136 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-10T23:41:34.149 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-07-10T23:41:34.149 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-07-10T23:41:34.150 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['client.0'] 2023-07-10T23:41:34.150 INFO:teuthology.run_tasks:Running task console_log... 2023-07-10T23:41:34.368 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2cbb440160>, signals=[15]) 2023-07-10T23:41:34.370 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-10T23:41:34.379 INFO:teuthology.task.internal:Opening connections... 2023-07-10T23:41:34.380 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2023-07-10T23:41:34.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:41:34.454 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2023-07-10T23:41:34.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:41:34.523 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2023-07-10T23:41:34.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:41:34.590 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-10T23:41:34.597 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-07-10T23:41:34.621 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-07-10T23:41:34.621 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-10T23:41:34.682 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-07-10T23:41:34.683 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2023-07-10T23:41:34.683 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-07-10T23:41:34.683 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-07-10T23:41:34.683 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2023-07-10T23:41:34.684 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-07-10T23:41:34.684 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-10T23:41:34.684 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-07-10T23:41:34.684 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-10T23:41:34.684 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-07-10T23:41:34.684 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T23:41:34.685 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T23:41:34.685 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-10T23:41:34.685 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-10T23:41:34.709 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2023-07-10T23:41:34.732 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2023-07-10T23:41:34.733 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-07-10T23:41:34.794 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2023-07-10T23:41:34.794 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8" 2023-07-10T23:41:34.794 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2023-07-10T23:41:34.795 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2023-07-10T23:41:34.795 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8" 2023-07-10T23:41:34.795 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-07-10T23:41:34.795 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-10T23:41:34.795 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-07-10T23:41:34.795 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-10T23:41:34.795 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2023-07-10T23:41:34.796 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T23:41:34.796 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T23:41:34.796 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-10T23:41:34.796 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-07-10T23:41:34.817 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-07-10T23:41:34.840 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-07-10T23:41:34.840 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-07-10T23:41:34.901 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-07-10T23:41:34.901 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2023-07-10T23:41:34.901 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-07-10T23:41:34.902 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-07-10T23:41:34.902 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2023-07-10T23:41:34.902 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2023-07-10T23:41:34.902 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-10T23:41:34.903 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-07-10T23:41:34.903 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-10T23:41:34.903 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-07-10T23:41:34.904 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T23:41:34.904 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T23:41:34.904 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-10T23:41:34.905 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-07-10T23:41:34.926 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-10T23:41:34.940 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-10T23:41:35.007 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-10T23:41:35.007 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2023-07-10T23:41:35.010 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2023-07-10T23:41:35.013 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2023-07-10T23:41:35.034 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-10T23:41:35.040 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-10T23:41:35.040 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2023-07-10T23:41:35.072 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2023-07-10T23:41:35.074 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2023-07-10T23:41:35.104 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-10T23:41:35.194 INFO:teuthology.run_tasks:Running task kernel... 2023-07-10T23:41:35.213 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-07-10T23:41:35.214 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-07-10T23:41:35.215 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-07-10T23:41:35.215 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-10T23:41:35.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-10T23:41:35.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-10T23:41:35.531 DEBUG:teuthology.task.kernel:sha1 for client.0 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-10T23:41:35.531 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-10T23:41:35.531 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2023-07-10T23:41:35.553 INFO:teuthology.orchestra.run.smithi131.stdout:4.18.0-489.el8.x86_64 2023-07-10T23:41:35.554 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-10T23:41:35.554 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-10T23:41:35.555 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum upgrade -y linux-firmware 2023-07-10T23:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - AppStream 36 MB/s | 31 MB 00:00 2023-07-10T23:41:46.106 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - BaseOS 27 MB/s | 41 MB 00:01 2023-07-10T23:41:52.456 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2023-07-10T23:41:52.998 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.6 kB 00:00 2023-07-10T23:41:55.716 INFO:teuthology.orchestra.run.smithi131.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-10T23:41:56.858 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-07-10T23:42:00.600 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 415 kB/s | 24 kB 00:00 2023-07-10T23:42:04.097 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-07-10T23:42:04.098 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-07-10T23:42:04.098 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repo Size 2023-07-10T23:42:04.098 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-07-10T23:42:04.098 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2023-07-10T23:42:04.098 INFO:teuthology.orchestra.run.smithi131.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-10T23:42:04.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:42:04.098 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-07-10T23:42:04.099 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-07-10T23:42:04.099 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 1 Package 2023-07-10T23:42:04.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:42:04.099 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 266 M 2023-07-10T23:42:04.099 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-07-10T23:42:10.251 INFO:teuthology.orchestra.run.smithi131.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 43 MB/s | 266 MB 00:06 2023-07-10T23:42:10.252 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-07-10T23:42:10.252 INFO:teuthology.orchestra.run.smithi131.stdout:Total 43 MB/s | 266 MB 00:06 2023-07-10T23:42:11.830 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-07-10T23:42:11.892 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-07-10T23:42:11.892 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-07-10T23:42:13.542 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-07-10T23:42:13.560 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-07-10T23:42:31.514 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-07-10T23:42:32.124 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-10T23:42:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-10T23:42:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-10T23:42:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-10T23:42:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-10T23:42:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:42:33.269 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2023-07-10T23:42:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-10T23:42:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:42:33.269 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-07-10T23:42:33.459 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-10T23:42:33.460 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-10T23:42:33.704 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ 2023-07-10T23:42:33.705 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_g84139c18d56f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-10T23:42:33.707 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi131.front.sepia.ceph.com to complete... 2023-07-10T23:42:56.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-10 23:42:56 URL:https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/kernel-6.4.0_g84139c18d56f-1.x86_64.rpm [379858600/379858600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-10T23:42:56.212 INFO:teuthology.orchestra.run.smithi131.stderr:FINISHED --2023-07-10 23:42:56-- 2023-07-10T23:42:56.212 INFO:teuthology.orchestra.run.smithi131.stderr:Total wall clock time: 22s 2023-07-10T23:42:56.213 INFO:teuthology.orchestra.run.smithi131.stderr:Downloaded: 1 files, 362M in 22s (16.4 MB/s) 2023-07-10T23:42:56.214 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-10T23:42:56.215 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-10T23:42:57.867 INFO:teuthology.orchestra.run.smithi131.stdout:Verifying... ######################################## 2023-07-10T23:42:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing... ######################################## 2023-07-10T23:42:58.019 INFO:teuthology.orchestra.run.smithi131.stdout:Updating / installing... 2023-07-10T23:43:35.855 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-6.4.0_g84139c18d56f-1 ######################################## 2023-07-10T23:44:00.214 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-10T23:44:00.215 DEBUG:teuthology.orchestra.run.smithi131:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-10T23:44:00.283 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/System.map-6.4.0-g84139c18d56f 2023-07-10T23:44:00.284 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/config-6.4.0-g84139c18d56f 2023-07-10T23:44:00.284 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-10T23:44:00.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f 2023-07-10T23:44:00.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel 2023-07-10T23:44:00.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch 2023-07-10T23:44:00.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86 2023-07-10T23:44:00.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto 2023-07-10T23:44:00.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-10T23:44:00.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-10T23:44:00.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-10T23:44:00.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-10T23:44:00.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-10T23:44:00.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-10T23:44:00.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-10T23:44:00.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-10T23:44:00.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-10T23:44:00.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-10T23:44:00.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-10T23:44:00.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-10T23:44:00.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-10T23:44:00.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-10T23:44:00.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-10T23:44:00.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-10T23:44:00.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-10T23:44:00.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-10T23:44:00.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-10T23:44:00.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-10T23:44:00.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel 2023-07-10T23:44:00.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu 2023-07-10T23:44:00.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce 2023-07-10T23:44:00.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-10T23:44:00.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm 2023-07-10T23:44:00.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-10T23:44:00.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-10T23:44:00.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-10T23:44:00.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto 2023-07-10T23:44:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-10T23:44:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-10T23:44:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-10T23:44:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx 2023-07-10T23:44:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-10T23:44:00.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-10T23:44:00.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-10T23:44:00.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-10T23:44:00.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-10T23:44:00.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-10T23:44:00.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-10T23:44:00.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-10T23:44:00.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-10T23:44:00.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-10T23:44:00.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-10T23:44:00.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-10T23:44:00.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-10T23:44:00.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-10T23:44:00.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-10T23:44:00.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-10T23:44:00.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-10T23:44:00.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-10T23:44:00.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-10T23:44:00.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-10T23:44:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-10T23:44:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-10T23:44:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-10T23:44:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-10T23:44:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-10T23:44:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-10T23:44:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-10T23:44:00.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-10T23:44:00.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-10T23:44:00.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-10T23:44:00.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-10T23:44:00.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-10T23:44:00.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-10T23:44:00.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-10T23:44:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-10T23:44:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-10T23:44:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-10T23:44:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-10T23:44:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-10T23:44:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-10T23:44:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-10T23:44:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-10T23:44:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-10T23:44:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-10T23:44:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-10T23:44:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers 2023-07-10T23:44:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi 2023-07-10T23:44:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-10T23:44:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/custom_method.ko 2023-07-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata 2023-07-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ata_generic.ko 2023-07-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-10T23:44:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-10T23:44:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-10T23:44:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-10T23:44:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-10T23:44:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-10T23:44:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-10T23:44:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-10T23:44:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-10T23:44:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-10T23:44:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-10T23:44:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-10T23:44:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-10T23:44:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-10T23:44:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-10T23:44:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-10T23:44:00.301 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-10T23:44:00.301 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-10T23:44:00.301 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-10T23:44:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-10T23:44:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-10T23:44:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-10T23:44:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-10T23:44:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-10T23:44:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-10T23:44:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-10T23:44:00.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-10T23:44:00.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-10T23:44:00.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-10T23:44:00.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-10T23:44:00.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-10T23:44:00.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sis.ko 2023-07-10T23:44:00.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-10T23:44:00.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-10T23:44:00.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-10T23:44:00.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-10T23:44:00.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-10T23:44:00.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-10T23:44:00.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-10T23:44:00.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-10T23:44:00.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-10T23:44:00.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-10T23:44:00.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-10T23:44:00.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-10T23:44:00.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-10T23:44:00.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-10T23:44:00.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-10T23:44:00.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-10T23:44:00.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-10T23:44:00.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay 2023-07-10T23:44:00.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-10T23:44:00.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base 2023-07-10T23:44:00.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap 2023-07-10T23:44:00.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-10T23:44:00.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma 2023-07-10T23:44:00.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-10T23:44:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block 2023-07-10T23:44:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe 2023-07-10T23:44:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-10T23:44:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/brd.ko 2023-07-10T23:44:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd 2023-07-10T23:44:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-10T23:44:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-10T23:44:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/loop.ko 2023-07-10T23:44:00.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx 2023-07-10T23:44:00.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-10T23:44:00.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-10T23:44:00.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk 2023-07-10T23:44:00.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-10T23:44:00.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-10T23:44:00.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-10T23:44:00.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/virtio_blk.ko 2023-07-10T23:44:00.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback 2023-07-10T23:44:00.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-10T23:44:00.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkfront.ko 2023-07-10T23:44:00.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram 2023-07-10T23:44:00.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-10T23:44:00.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char 2023-07-10T23:44:00.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-10T23:44:00.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random 2023-07-10T23:44:00.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-10T23:44:00.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-10T23:44:00.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-10T23:44:00.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-10T23:44:00.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-10T23:44:00.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi 2023-07-10T23:44:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-10T23:44:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-10T23:44:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-10T23:44:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-10T23:44:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-10T23:44:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-10T23:44:00.312 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-10T23:44:00.312 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave 2023-07-10T23:44:00.312 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-10T23:44:00.312 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-10T23:44:00.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-10T23:44:00.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm 2023-07-10T23:44:00.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm.ko 2023-07-10T23:44:00.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-10T23:44:00.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-10T23:44:00.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-10T23:44:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-10T23:44:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-10T23:44:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/uv_mmtimer.ko 2023-07-10T23:44:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/virtio_console.ko 2023-07-10T23:44:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq 2023-07-10T23:44:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-10T23:44:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-10T23:44:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-10T23:44:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-10T23:44:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-10T23:44:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-10T23:44:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto 2023-07-10T23:44:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp 2023-07-10T23:44:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-10T23:44:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-10T23:44:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel 2023-07-10T23:44:00.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat 2023-07-10T23:44:00.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common 2023-07-10T23:44:00.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-10T23:44:00.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-10T23:44:00.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-10T23:44:00.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-10T23:44:00.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-10T23:44:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio 2023-07-10T23:44:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-10T23:44:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca 2023-07-10T23:44:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-10T23:44:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq 2023-07-10T23:44:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-10T23:44:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma 2023-07-10T23:44:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw 2023-07-10T23:44:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-10T23:44:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat 2023-07-10T23:44:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-10T23:44:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac 2023-07-10T23:44:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-10T23:44:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-10T23:44:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-10T23:44:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-10T23:44:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-10T23:44:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-10T23:44:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-10T23:44:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-10T23:44:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-10T23:44:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-10T23:44:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-10T23:44:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-10T23:44:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-10T23:44:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware 2023-07-10T23:44:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/edd.ko 2023-07-10T23:44:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-10T23:44:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio 2023-07-10T23:44:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-10T23:44:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-10T23:44:00.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid 2023-07-10T23:44:00.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-10T23:44:00.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-10T23:44:00.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-10T23:44:00.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-10T23:44:00.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-10T23:44:00.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-10T23:44:00.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-10T23:44:00.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-10T23:44:00.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-10T23:44:00.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-10T23:44:00.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-10T23:44:00.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-10T23:44:00.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-10T23:44:00.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-10T23:44:00.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-10T23:44:00.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-10T23:44:00.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-10T23:44:00.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-10T23:44:00.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-10T23:44:00.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-10T23:44:00.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-10T23:44:00.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-10T23:44:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-10T23:44:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-10T23:44:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-10T23:44:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-10T23:44:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-10T23:44:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-10T23:44:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-10T23:44:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-10T23:44:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-10T23:44:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-10T23:44:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-10T23:44:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-10T23:44:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-10T23:44:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-10T23:44:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-10T23:44:00.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-10T23:44:00.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-10T23:44:00.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-10T23:44:00.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-10T23:44:00.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-10T23:44:00.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-10T23:44:00.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-10T23:44:00.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-10T23:44:00.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-10T23:44:00.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-10T23:44:00.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-10T23:44:00.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-10T23:44:00.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-10T23:44:00.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-10T23:44:00.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-10T23:44:00.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-10T23:44:00.328 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-10T23:44:00.328 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-10T23:44:00.328 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-10T23:44:00.328 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-10T23:44:00.329 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-10T23:44:00.329 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-10T23:44:00.329 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-10T23:44:00.329 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-10T23:44:00.329 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-10T23:44:00.330 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-10T23:44:00.330 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-10T23:44:00.330 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv 2023-07-10T23:44:00.330 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-10T23:44:00.330 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-10T23:44:00.330 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-10T23:44:00.330 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon 2023-07-10T23:44:00.330 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-10T23:44:00.331 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-10T23:44:00.331 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-10T23:44:00.331 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-10T23:44:00.331 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-10T23:44:00.331 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-10T23:44:00.331 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-10T23:44:00.331 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-10T23:44:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-10T23:44:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-10T23:44:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-10T23:44:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-10T23:44:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-10T23:44:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-10T23:44:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-10T23:44:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-10T23:44:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-10T23:44:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-10T23:44:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-10T23:44:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-10T23:44:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-10T23:44:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-10T23:44:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-10T23:44:00.334 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-10T23:44:00.334 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-10T23:44:00.334 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-10T23:44:00.334 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-10T23:44:00.334 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-10T23:44:00.334 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-10T23:44:00.334 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-10T23:44:00.334 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-10T23:44:00.335 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-10T23:44:00.335 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-10T23:44:00.335 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-10T23:44:00.335 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-10T23:44:00.335 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-10T23:44:00.335 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-10T23:44:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-10T23:44:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-10T23:44:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-10T23:44:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-10T23:44:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-10T23:44:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-10T23:44:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-10T23:44:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-10T23:44:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-10T23:44:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-10T23:44:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-10T23:44:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-10T23:44:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-10T23:44:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-10T23:44:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-10T23:44:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-10T23:44:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-10T23:44:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-10T23:44:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-10T23:44:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-10T23:44:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-10T23:44:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-10T23:44:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-10T23:44:00.339 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-10T23:44:00.339 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-10T23:44:00.339 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-10T23:44:00.339 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-10T23:44:00.339 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-10T23:44:00.339 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-10T23:44:00.339 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-10T23:44:00.339 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-10T23:44:00.340 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-10T23:44:00.340 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-10T23:44:00.340 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-10T23:44:00.340 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-10T23:44:00.340 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-10T23:44:00.340 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-10T23:44:00.340 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-10T23:44:00.341 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-10T23:44:00.341 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-10T23:44:00.341 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-10T23:44:00.341 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-10T23:44:00.341 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-10T23:44:00.341 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-10T23:44:00.341 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-10T23:44:00.341 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-10T23:44:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-10T23:44:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-10T23:44:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-10T23:44:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-10T23:44:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-10T23:44:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus 2023-07-10T23:44:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-10T23:44:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-10T23:44:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-10T23:44:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-10T23:44:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-10T23:44:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-10T23:44:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-10T23:44:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-10T23:44:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-10T23:44:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-10T23:44:00.344 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-10T23:44:00.344 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-10T23:44:00.344 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-10T23:44:00.344 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-10T23:44:00.344 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-10T23:44:00.344 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-10T23:44:00.344 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-10T23:44:00.345 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-10T23:44:00.345 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-10T23:44:00.345 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-10T23:44:00.345 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-10T23:44:00.345 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-10T23:44:00.345 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-10T23:44:00.345 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-10T23:44:00.345 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-10T23:44:00.346 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-10T23:44:00.346 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-10T23:44:00.346 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-10T23:44:00.346 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-10T23:44:00.346 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-10T23:44:00.346 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-10T23:44:00.346 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-10T23:44:00.346 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-10T23:44:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-10T23:44:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-10T23:44:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-10T23:44:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-10T23:44:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-10T23:44:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-10T23:44:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-10T23:44:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-10T23:44:00.348 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c 2023-07-10T23:44:00.348 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos 2023-07-10T23:44:00.348 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-10T23:44:00.348 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-10T23:44:00.348 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses 2023-07-10T23:44:00.348 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-10T23:44:00.348 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-10T23:44:00.349 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-10T23:44:00.349 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-10T23:44:00.349 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-10T23:44:00.349 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-10T23:44:00.349 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-10T23:44:00.349 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-10T23:44:00.349 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-10T23:44:00.349 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-10T23:44:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-10T23:44:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-10T23:44:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-10T23:44:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-10T23:44:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-10T23:44:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-10T23:44:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-10T23:44:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-10T23:44:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-10T23:44:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-10T23:44:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-10T23:44:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-10T23:44:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-10T23:44:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-dev.ko 2023-07-10T23:44:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-10T23:44:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-10T23:44:00.352 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-10T23:44:00.352 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-10T23:44:00.352 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband 2023-07-10T23:44:00.352 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core 2023-07-10T23:44:00.352 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-10T23:44:00.352 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-10T23:44:00.352 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-10T23:44:00.353 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-10T23:44:00.353 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-10T23:44:00.353 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-10T23:44:00.353 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-10T23:44:00.353 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw 2023-07-10T23:44:00.353 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4 2023-07-10T23:44:00.353 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-10T23:44:00.353 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4 2023-07-10T23:44:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-10T23:44:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5 2023-07-10T23:44:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-10T23:44:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca 2023-07-10T23:44:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-10T23:44:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp 2023-07-10T23:44:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib 2023-07-10T23:44:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-10T23:44:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser 2023-07-10T23:44:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-10T23:44:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert 2023-07-10T23:44:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-10T23:44:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp 2023-07-10T23:44:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-10T23:44:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt 2023-07-10T23:44:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-10T23:44:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input 2023-07-10T23:44:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport 2023-07-10T23:44:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-10T23:44:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-10T23:44:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-10T23:44:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-10T23:44:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-10T23:44:00.357 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-10T23:44:00.357 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard 2023-07-10T23:44:00.357 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-10T23:44:00.357 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse 2023-07-10T23:44:00.357 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-10T23:44:00.357 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-10T23:44:00.358 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-10T23:44:00.358 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-10T23:44:00.358 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-10T23:44:00.358 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-10T23:44:00.358 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-10T23:44:00.358 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-10T23:44:00.358 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4 2023-07-10T23:44:00.358 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-10T23:44:00.359 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio 2023-07-10T23:44:00.359 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-10T23:44:00.359 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-10T23:44:00.359 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-10T23:44:00.359 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-10T23:44:00.359 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-10T23:44:00.359 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu 2023-07-10T23:44:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd 2023-07-10T23:44:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-10T23:44:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds 2023-07-10T23:44:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-10T23:44:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-10T23:44:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-10T23:44:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-10T23:44:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger 2023-07-10T23:44:00.361 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-10T23:44:00.361 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-10T23:44:00.361 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-10T23:44:00.361 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-10T23:44:00.361 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-10T23:44:00.361 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-10T23:44:00.361 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-10T23:44:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-10T23:44:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md 2023-07-10T23:44:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache 2023-07-10T23:44:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-10T23:44:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-10T23:44:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-10T23:44:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-10T23:44:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-10T23:44:00.363 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-10T23:44:00.363 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-10T23:44:00.363 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-10T23:44:00.363 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-10T23:44:00.363 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-10T23:44:00.363 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-10T23:44:00.363 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-10T23:44:00.363 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-10T23:44:00.364 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-10T23:44:00.364 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-10T23:44:00.364 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-10T23:44:00.364 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-10T23:44:00.364 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-10T23:44:00.364 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-10T23:44:00.364 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data 2023-07-10T23:44:00.364 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-10T23:44:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-10T23:44:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-10T23:44:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-10T23:44:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-10T23:44:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message 2023-07-10T23:44:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion 2023-07-10T23:44:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-10T23:44:00.366 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-10T23:44:00.366 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-10T23:44:00.366 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-10T23:44:00.366 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-10T23:44:00.366 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-10T23:44:00.366 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-10T23:44:00.366 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd 2023-07-10T23:44:00.366 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-10T23:44:00.367 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-10T23:44:00.367 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mfd-core.ko 2023-07-10T23:44:00.367 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-10T23:44:00.367 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-10T23:44:00.367 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-10T23:44:00.367 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-10T23:44:00.367 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc 2023-07-10T23:44:00.367 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl 2023-07-10T23:44:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-10T23:44:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-10T23:44:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-10T23:44:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-10T23:44:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710 2023-07-10T23:44:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-10T23:44:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom 2023-07-10T23:44:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-10T23:44:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-10T23:44:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-10T23:44:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-10T23:44:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-10T23:44:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-10T23:44:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-10T23:44:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-10T23:44:00.370 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d 2023-07-10T23:44:00.370 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-10T23:44:00.370 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-10T23:44:00.370 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei 2023-07-10T23:44:00.370 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-10T23:44:00.370 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-10T23:44:00.370 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-10T23:44:00.370 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru 2023-07-10T23:44:00.371 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-10T23:44:00.371 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp 2023-07-10T23:44:00.371 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-10T23:44:00.371 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-10T23:44:00.371 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-10T23:44:00.371 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-10T23:44:00.371 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-10T23:44:00.371 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-10T23:44:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-10T23:44:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci 2023-07-10T23:44:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-10T23:44:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net 2023-07-10T23:44:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding 2023-07-10T23:44:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-10T23:44:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa 2023-07-10T23:44:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53 2023-07-10T23:44:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-10T23:44:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-10T23:44:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-10T23:44:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx 2023-07-10T23:44:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-10T23:44:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-10T23:44:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-10T23:44:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet 2023-07-10T23:44:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com 2023-07-10T23:44:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-10T23:44:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-10T23:44:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-10T23:44:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-10T23:44:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390 2023-07-10T23:44:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-10T23:44:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-10T23:44:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-10T23:44:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-10T23:44:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec 2023-07-10T23:44:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-10T23:44:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere 2023-07-10T23:44:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-10T23:44:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon 2023-07-10T23:44:00.376 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-10T23:44:00.376 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera 2023-07-10T23:44:00.376 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-10T23:44:00.376 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd 2023-07-10T23:44:00.377 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-10T23:44:00.377 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-10T23:44:00.377 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-10T23:44:00.377 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros 2023-07-10T23:44:00.377 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx 2023-07-10T23:44:00.378 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-10T23:44:00.378 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-10T23:44:00.378 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-10T23:44:00.378 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-10T23:44:00.378 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-10T23:44:00.378 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx 2023-07-10T23:44:00.379 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-10T23:44:00.379 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-10T23:44:00.379 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom 2023-07-10T23:44:00.379 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-10T23:44:00.379 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-10T23:44:00.379 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-10T23:44:00.379 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-10T23:44:00.379 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-10T23:44:00.380 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet 2023-07-10T23:44:00.380 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-10T23:44:00.380 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-10T23:44:00.380 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade 2023-07-10T23:44:00.380 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna 2023-07-10T23:44:00.380 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-10T23:44:00.380 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio 2023-07-10T23:44:00.381 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-10T23:44:00.381 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-10T23:44:00.381 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-10T23:44:00.381 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-10T23:44:00.381 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-10T23:44:00.381 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-10T23:44:00.381 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-10T23:44:00.381 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-10T23:44:00.382 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-10T23:44:00.382 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-10T23:44:00.382 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco 2023-07-10T23:44:00.382 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic 2023-07-10T23:44:00.382 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-10T23:44:00.382 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec 2023-07-10T23:44:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip 2023-07-10T23:44:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-10T23:44:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-10T23:44:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-10T23:44:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-10T23:44:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-10T23:44:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-10T23:44:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink 2023-07-10T23:44:00.384 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-10T23:44:00.384 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-10T23:44:00.384 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-10T23:44:00.384 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex 2023-07-10T23:44:00.384 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet 2023-07-10T23:44:00.384 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-10T23:44:00.384 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-10T23:44:00.384 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-10T23:44:00.385 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel 2023-07-10T23:44:00.385 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-10T23:44:00.385 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000 2023-07-10T23:44:00.385 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-10T23:44:00.385 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e 2023-07-10T23:44:00.385 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-10T23:44:00.385 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k 2023-07-10T23:44:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-10T23:44:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e 2023-07-10T23:44:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-10T23:44:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf 2023-07-10T23:44:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-10T23:44:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb 2023-07-10T23:44:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-10T23:44:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf 2023-07-10T23:44:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-10T23:44:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-10T23:44:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-10T23:44:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-10T23:44:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-10T23:44:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-10T23:44:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell 2023-07-10T23:44:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-10T23:44:00.388 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-10T23:44:00.388 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-10T23:44:00.388 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox 2023-07-10T23:44:00.388 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-10T23:44:00.388 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-10T23:44:00.388 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-10T23:44:00.389 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-10T23:44:00.389 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-10T23:44:00.389 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-10T23:44:00.389 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel 2023-07-10T23:44:00.389 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-10T23:44:00.389 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom 2023-07-10T23:44:00.389 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-10T23:44:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-10T23:44:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi 2023-07-10T23:44:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-10T23:44:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-10T23:44:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion 2023-07-10T23:44:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-10T23:44:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia 2023-07-10T23:44:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-10T23:44:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines 2023-07-10T23:44:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-10T23:44:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-10T23:44:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic 2023-07-10T23:44:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-10T23:44:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-10T23:44:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-10T23:44:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-10T23:44:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-10T23:44:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc 2023-07-10T23:44:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-10T23:44:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek 2023-07-10T23:44:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-10T23:44:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-10T23:44:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-10T23:44:00.393 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-10T23:44:00.393 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker 2023-07-10T23:44:00.393 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-10T23:44:00.393 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc 2023-07-10T23:44:00.393 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-10T23:44:00.393 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan 2023-07-10T23:44:00.393 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-10T23:44:00.393 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis 2023-07-10T23:44:00.394 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-10T23:44:00.394 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-10T23:44:00.394 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc 2023-07-10T23:44:00.394 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-10T23:44:00.394 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-10T23:44:00.394 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-10T23:44:00.394 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-10T23:44:00.394 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro 2023-07-10T23:44:00.395 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-10T23:44:00.395 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-10T23:44:00.395 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-10T23:44:00.395 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun 2023-07-10T23:44:00.395 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-10T23:44:00.395 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-10T23:44:00.395 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-10T23:44:00.395 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-10T23:44:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti 2023-07-10T23:44:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-10T23:44:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti 2023-07-10T23:44:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-10T23:44:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via 2023-07-10T23:44:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-10T23:44:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-10T23:44:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet 2023-07-10T23:44:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-10T23:44:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-10T23:44:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom 2023-07-10T23:44:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-10T23:44:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-10T23:44:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv 2023-07-10T23:44:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-10T23:44:00.398 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154 2023-07-10T23:44:00.398 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-10T23:44:00.398 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-10T23:44:00.398 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan 2023-07-10T23:44:00.398 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-10T23:44:00.398 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-10T23:44:00.398 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-10T23:44:00.398 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio 2023-07-10T23:44:00.399 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-10T23:44:00.399 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-10T23:44:00.399 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-10T23:44:00.399 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-10T23:44:00.399 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/net_failover.ko 2023-07-10T23:44:00.399 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-10T23:44:00.399 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-10T23:44:00.400 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs 2023-07-10T23:44:00.400 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-10T23:44:00.400 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-10T23:44:00.400 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy 2023-07-10T23:44:00.400 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-10T23:44:00.400 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-10T23:44:00.400 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-10T23:44:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-10T23:44:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-10T23:44:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-10T23:44:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-10T23:44:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-10T23:44:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/dp83640.ko 2023-07-10T23:44:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-10T23:44:00.402 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-10T23:44:00.402 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-10T23:44:00.402 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-10T23:44:00.402 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-10T23:44:00.402 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-10T23:44:00.402 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-10T23:44:00.402 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-10T23:44:00.403 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-10T23:44:00.403 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-10T23:44:00.403 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-10T23:44:00.403 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-10T23:44:00.403 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp 2023-07-10T23:44:00.403 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-10T23:44:00.403 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-10T23:44:00.403 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-10T23:44:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-10T23:44:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-10T23:44:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-10T23:44:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-10T23:44:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-10T23:44:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-10T23:44:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip 2023-07-10T23:44:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slhc.ko 2023-07-10T23:44:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-10T23:44:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-10T23:44:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-10T23:44:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team 2023-07-10T23:44:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-10T23:44:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-10T23:44:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-10T23:44:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-10T23:44:00.406 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-10T23:44:00.406 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-10T23:44:00.406 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tun.ko 2023-07-10T23:44:00.406 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-10T23:44:00.406 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/virtio_net.ko 2023-07-10T23:44:00.406 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3 2023-07-10T23:44:00.406 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-10T23:44:00.406 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan 2023-07-10T23:44:00.407 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-10T23:44:00.407 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback 2023-07-10T23:44:00.407 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-10T23:44:00.407 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netfront.ko 2023-07-10T23:44:00.407 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb 2023-07-10T23:44:00.407 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-10T23:44:00.407 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme 2023-07-10T23:44:00.407 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host 2023-07-10T23:44:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-10T23:44:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-10T23:44:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport 2023-07-10T23:44:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-10T23:44:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-10T23:44:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-10T23:44:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-10T23:44:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci 2023-07-10T23:44:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug 2023-07-10T23:44:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-10T23:44:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie 2023-07-10T23:44:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-10T23:44:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-10T23:44:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia 2023-07-10T23:44:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-10T23:44:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-10T23:44:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-10T23:44:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl 2023-07-10T23:44:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel 2023-07-10T23:44:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-10T23:44:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform 2023-07-10T23:44:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86 2023-07-10T23:44:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-10T23:44:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-10T23:44:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-10T23:44:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-10T23:44:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-10T23:44:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-10T23:44:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-10T23:44:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-10T23:44:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-10T23:44:00.412 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-10T23:44:00.412 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-10T23:44:00.412 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-10T23:44:00.412 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel 2023-07-10T23:44:00.412 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-10T23:44:00.412 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-10T23:44:00.412 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-10T23:44:00.413 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-10T23:44:00.413 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-10T23:44:00.413 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-10T23:44:00.413 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-10T23:44:00.413 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-10T23:44:00.413 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-10T23:44:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-10T23:44:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-10T23:44:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-10T23:44:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap 2023-07-10T23:44:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-10T23:44:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-10T23:44:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps 2023-07-10T23:44:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients 2023-07-10T23:44:00.415 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-10T23:44:00.415 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-10T23:44:00.415 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-10T23:44:00.415 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-10T23:44:00.415 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp 2023-07-10T23:44:00.415 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-10T23:44:00.415 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-10T23:44:00.415 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc 2023-07-10T23:44:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-10T23:44:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-10T23:44:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-10T23:44:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-10T23:44:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-10T23:44:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-10T23:44:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-10T23:44:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-10T23:44:00.417 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-10T23:44:00.417 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-10T23:44:00.417 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-10T23:44:00.417 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-10T23:44:00.417 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-10T23:44:00.417 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-10T23:44:00.417 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-10T23:44:00.417 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-10T23:44:00.418 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-10T23:44:00.418 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-10T23:44:00.418 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-10T23:44:00.418 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-10T23:44:00.418 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-10T23:44:00.418 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-10T23:44:00.418 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-10T23:44:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-10T23:44:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-10T23:44:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-10T23:44:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-10T23:44:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-10T23:44:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-10T23:44:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-10T23:44:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-10T23:44:00.420 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-10T23:44:00.420 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi 2023-07-10T23:44:00.420 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-10T23:44:00.420 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-10T23:44:00.420 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-10T23:44:00.420 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-10T23:44:00.420 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-10T23:44:00.420 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid 2023-07-10T23:44:00.421 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-10T23:44:00.421 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-10T23:44:00.421 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx 2023-07-10T23:44:00.421 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-10T23:44:00.421 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-10T23:44:00.421 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-10T23:44:00.421 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr 2023-07-10T23:44:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-10T23:44:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-10T23:44:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi 2023-07-10T23:44:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-10T23:44:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa 2023-07-10T23:44:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-10T23:44:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc 2023-07-10T23:44:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-10T23:44:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i 2023-07-10T23:44:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-10T23:44:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-10T23:44:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor 2023-07-10T23:44:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-10T23:44:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi 2023-07-10T23:44:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-10T23:44:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-10T23:44:00.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-10T23:44:00.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-10T23:44:00.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-10T23:44:00.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-10T23:44:00.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler 2023-07-10T23:44:00.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-10T23:44:00.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-10T23:44:00.424 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-10T23:44:00.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-10T23:44:00.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-10T23:44:00.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r 2023-07-10T23:44:00.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-10T23:44:00.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-10T23:44:00.425 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe 2023-07-10T23:44:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-10T23:44:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-10T23:44:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic 2023-07-10T23:44:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-10T23:44:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-10T23:44:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-10T23:44:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-10T23:44:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-10T23:44:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-10T23:44:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-10T23:44:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci 2023-07-10T23:44:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-10T23:44:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-10T23:44:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-10T23:44:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc 2023-07-10T23:44:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-10T23:44:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-10T23:44:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-10T23:44:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas 2023-07-10T23:44:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-10T23:44:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc 2023-07-10T23:44:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-10T23:44:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid 2023-07-10T23:44:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-10T23:44:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-10T23:44:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-10T23:44:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-10T23:44:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas 2023-07-10T23:44:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-10T23:44:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas 2023-07-10T23:44:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-10T23:44:00.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-10T23:44:00.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001 2023-07-10T23:44:00.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-10T23:44:00.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-10T23:44:00.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-10T23:44:00.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx 2023-07-10T23:44:00.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-10T23:44:00.430 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-10T23:44:00.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx 2023-07-10T23:44:00.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-10T23:44:00.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-10T23:44:00.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-10T23:44:00.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-10T23:44:00.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-10T23:44:00.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-10T23:44:00.431 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-10T23:44:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-10T23:44:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-10T23:44:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-10T23:44:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-10T23:44:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2 2023-07-10T23:44:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-10T23:44:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-10T23:44:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-10T23:44:00.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-10T23:44:00.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb 2023-07-10T23:44:00.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-10T23:44:00.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target 2023-07-10T23:44:00.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi 2023-07-10T23:44:00.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-10T23:44:00.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback 2023-07-10T23:44:00.433 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-10T23:44:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-10T23:44:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-10T23:44:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-10T23:44:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-10T23:44:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-10T23:44:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc 2023-07-10T23:44:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-10T23:44:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal 2023-07-10T23:44:00.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel 2023-07-10T23:44:00.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal 2023-07-10T23:44:00.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-10T23:44:00.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-10T23:44:00.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-10T23:44:00.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-10T23:44:00.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-10T23:44:00.435 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-10T23:44:00.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-10T23:44:00.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-10T23:44:00.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-10T23:44:00.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-10T23:44:00.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-10T23:44:00.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-10T23:44:00.436 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-10T23:44:00.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-10T23:44:00.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-10T23:44:00.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty 2023-07-10T23:44:00.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless 2023-07-10T23:44:00.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-10T23:44:00.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-10T23:44:00.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-10T23:44:00.437 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-10T23:44:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial 2023-07-10T23:44:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250 2023-07-10T23:44:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-10T23:44:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-10T23:44:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm 2023-07-10T23:44:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-10T23:44:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-10T23:44:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs 2023-07-10T23:44:00.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core 2023-07-10T23:44:00.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-10T23:44:00.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host 2023-07-10T23:44:00.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-10T23:44:00.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio 2023-07-10T23:44:00.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-10T23:44:00.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-10T23:44:00.439 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-10T23:44:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-10T23:44:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-10T23:44:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb 2023-07-10T23:44:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class 2023-07-10T23:44:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-10T23:44:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-10T23:44:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-10T23:44:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-10T23:44:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host 2023-07-10T23:44:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-10T23:44:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image 2023-07-10T23:44:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-10T23:44:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-10T23:44:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc 2023-07-10T23:44:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-10T23:44:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-10T23:44:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-10T23:44:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-10T23:44:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-10T23:44:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-10T23:44:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-10T23:44:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-10T23:44:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-10T23:44:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-10T23:44:00.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga 2023-07-10T23:44:00.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-10T23:44:00.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-10T23:44:00.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-10T23:44:00.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-10T23:44:00.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-10T23:44:00.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-10T23:44:00.443 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-10T23:44:00.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy 2023-07-10T23:44:00.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-10T23:44:00.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial 2023-07-10T23:44:00.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-10T23:44:00.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-10T23:44:00.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-10T23:44:00.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-10T23:44:00.444 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-10T23:44:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-10T23:44:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-10T23:44:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-10T23:44:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-10T23:44:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-10T23:44:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-10T23:44:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-10T23:44:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-10T23:44:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-10T23:44:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-10T23:44:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-10T23:44:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-10T23:44:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-10T23:44:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-10T23:44:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-10T23:44:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-10T23:44:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-10T23:44:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-10T23:44:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-10T23:44:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-10T23:44:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-10T23:44:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-10T23:44:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-10T23:44:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-10T23:44:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-10T23:44:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-10T23:44:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-10T23:44:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-10T23:44:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-10T23:44:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-10T23:44:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-10T23:44:00.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-10T23:44:00.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-10T23:44:00.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-10T23:44:00.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-10T23:44:00.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-10T23:44:00.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-10T23:44:00.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-10T23:44:00.449 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-10T23:44:00.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-10T23:44:00.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage 2023-07-10T23:44:00.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-10T23:44:00.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-10T23:44:00.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-10T23:44:00.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-10T23:44:00.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-10T23:44:00.450 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-10T23:44:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-10T23:44:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-10T23:44:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-10T23:44:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-10T23:44:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-10T23:44:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-10T23:44:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-10T23:44:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-10T23:44:00.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-10T23:44:00.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip 2023-07-10T23:44:00.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-10T23:44:00.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-10T23:44:00.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-10T23:44:00.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio 2023-07-10T23:44:00.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci 2023-07-10T23:44:00.452 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-10T23:44:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-10T23:44:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-10T23:44:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-10T23:44:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost 2023-07-10T23:44:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-10T23:44:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-10T23:44:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-10T23:44:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-10T23:44:00.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video 2023-07-10T23:44:00.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight 2023-07-10T23:44:00.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-10T23:44:00.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-10T23:44:00.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-10T23:44:00.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio 2023-07-10T23:44:00.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio.ko 2023-07-10T23:44:00.454 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_balloon.ko 2023-07-10T23:44:00.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_mmio.ko 2023-07-10T23:44:00.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci.ko 2023-07-10T23:44:00.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-10T23:44:00.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-10T23:44:00.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_ring.ko 2023-07-10T23:44:00.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1 2023-07-10T23:44:00.455 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters 2023-07-10T23:44:00.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-10T23:44:00.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-10T23:44:00.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves 2023-07-10T23:44:00.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-10T23:44:00.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-10T23:44:00.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-10T23:44:00.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-10T23:44:00.456 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-10T23:44:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-10T23:44:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-10T23:44:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-10T23:44:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-10T23:44:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-10T23:44:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-10T23:44:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-10T23:44:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog 2023-07-10T23:44:00.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-10T23:44:00.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-10T23:44:00.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-10T23:44:00.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-10T23:44:00.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-10T23:44:00.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-10T23:44:00.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-10T23:44:00.458 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-10T23:44:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-10T23:44:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-10T23:44:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-10T23:44:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-10T23:44:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-10T23:44:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-10T23:44:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-10T23:44:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-10T23:44:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-10T23:44:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-10T23:44:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-10T23:44:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-10T23:44:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-10T23:44:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-10T23:44:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-10T23:44:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-10T23:44:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-10T23:44:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-10T23:44:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen 2023-07-10T23:44:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-10T23:44:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-10T23:44:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-10T23:44:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-10T23:44:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback 2023-07-10T23:44:00.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-10T23:44:00.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-10T23:44:00.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs 2023-07-10T23:44:00.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-10T23:44:00.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs 2023-07-10T23:44:00.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p 2023-07-10T23:44:00.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-10T23:44:00.462 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs 2023-07-10T23:44:00.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-10T23:44:00.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs 2023-07-10T23:44:00.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-10T23:44:00.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-10T23:44:00.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs 2023-07-10T23:44:00.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-10T23:44:00.463 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles 2023-07-10T23:44:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-10T23:44:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph 2023-07-10T23:44:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-10T23:44:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda 2023-07-10T23:44:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-10T23:44:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs 2023-07-10T23:44:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-10T23:44:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm 2023-07-10T23:44:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-10T23:44:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs 2023-07-10T23:44:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-10T23:44:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs 2023-07-10T23:44:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-10T23:44:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat 2023-07-10T23:44:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/fat.ko 2023-07-10T23:44:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-10T23:44:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/vfat.ko 2023-07-10T23:44:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache 2023-07-10T23:44:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-10T23:44:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse 2023-07-10T23:44:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-10T23:44:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/fuse.ko 2023-07-10T23:44:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2 2023-07-10T23:44:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-10T23:44:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs 2023-07-10T23:44:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-10T23:44:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus 2023-07-10T23:44:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-10T23:44:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs 2023-07-10T23:44:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-10T23:44:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs 2023-07-10T23:44:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-10T23:44:00.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd 2023-07-10T23:44:00.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-10T23:44:00.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix 2023-07-10T23:44:00.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-10T23:44:00.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs 2023-07-10T23:44:00.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-10T23:44:00.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs 2023-07-10T23:44:00.468 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout 2023-07-10T23:44:00.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-10T23:44:00.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout 2023-07-10T23:44:00.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-10T23:44:00.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout 2023-07-10T23:44:00.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-10T23:44:00.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-10T23:44:00.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-10T23:44:00.469 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-10T23:44:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common 2023-07-10T23:44:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-10T23:44:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-10T23:44:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd 2023-07-10T23:44:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-10T23:44:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2 2023-07-10T23:44:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-10T23:44:00.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls 2023-07-10T23:44:00.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-10T23:44:00.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-10T23:44:00.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-10T23:44:00.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-10T23:44:00.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-10T23:44:00.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-10T23:44:00.471 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-10T23:44:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-10T23:44:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-10T23:44:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-10T23:44:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-10T23:44:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-10T23:44:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-10T23:44:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-10T23:44:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-10T23:44:00.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-10T23:44:00.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-10T23:44:00.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-10T23:44:00.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-10T23:44:00.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-10T23:44:00.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-10T23:44:00.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-10T23:44:00.473 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-10T23:44:00.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-10T23:44:00.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-10T23:44:00.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-10T23:44:00.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-10T23:44:00.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-10T23:44:00.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-10T23:44:00.474 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-10T23:44:00.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-10T23:44:00.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-10T23:44:00.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-10T23:44:00.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-10T23:44:00.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-10T23:44:00.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-10T23:44:00.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-10T23:44:00.475 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-10T23:44:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-10T23:44:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-10T23:44:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-10T23:44:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-10T23:44:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-10T23:44:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-10T23:44:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-10T23:44:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-10T23:44:00.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-10T23:44:00.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-10T23:44:00.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-10T23:44:00.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2 2023-07-10T23:44:00.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster 2023-07-10T23:44:00.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-10T23:44:00.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm 2023-07-10T23:44:00.477 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-10T23:44:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs 2023-07-10T23:44:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-10T23:44:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-10T23:44:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-10T23:44:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-10T23:44:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-10T23:44:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs 2023-07-10T23:44:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-10T23:44:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore 2023-07-10T23:44:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-10T23:44:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs 2023-07-10T23:44:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-10T23:44:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs 2023-07-10T23:44:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-10T23:44:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb 2023-07-10T23:44:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client 2023-07-10T23:44:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-10T23:44:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common 2023-07-10T23:44:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-10T23:44:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-10T23:44:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs 2023-07-10T23:44:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-10T23:44:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv 2023-07-10T23:44:00.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-10T23:44:00.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf 2023-07-10T23:44:00.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-10T23:44:00.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs 2023-07-10T23:44:00.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-10T23:44:00.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs 2023-07-10T23:44:00.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-10T23:44:00.481 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel 2023-07-10T23:44:00.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu 2023-07-10T23:44:00.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu/rcutorture.ko 2023-07-10T23:44:00.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-10T23:44:00.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace 2023-07-10T23:44:00.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-10T23:44:00.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib 2023-07-10T23:44:00.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/asn1_encoder.ko 2023-07-10T23:44:00.482 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-10T23:44:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-10T23:44:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto 2023-07-10T23:44:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-10T23:44:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-10T23:44:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-10T23:44:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-10T23:44:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4 2023-07-10T23:44:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-10T23:44:00.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-10T23:44:00.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math 2023-07-10T23:44:00.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-10T23:44:00.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6 2023-07-10T23:44:00.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-10T23:44:00.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon 2023-07-10T23:44:00.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-10T23:44:00.484 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-10T23:44:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-10T23:44:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-10T23:44:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd 2023-07-10T23:44:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd/zstd_compress.ko 2023-07-10T23:44:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm 2023-07-10T23:44:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-10T23:44:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net 2023-07-10T23:44:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan 2023-07-10T23:44:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-10T23:44:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-10T23:44:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-10T23:44:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-10T23:44:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-10T23:44:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-10T23:44:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-10T23:44:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-10T23:44:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802 2023-07-10T23:44:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-10T23:44:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-10T23:44:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-10T23:44:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-10T23:44:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-10T23:44:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q 2023-07-10T23:44:00.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-10T23:44:00.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p 2023-07-10T23:44:00.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-10T23:44:00.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-10T23:44:00.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-10T23:44:00.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-10T23:44:00.488 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv 2023-07-10T23:44:00.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-10T23:44:00.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge 2023-07-10T23:44:00.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-10T23:44:00.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-10T23:44:00.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter 2023-07-10T23:44:00.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-10T23:44:00.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-10T23:44:00.489 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-10T23:44:00.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-10T23:44:00.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-10T23:44:00.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-10T23:44:00.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-10T23:44:00.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-10T23:44:00.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-10T23:44:00.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-10T23:44:00.490 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-10T23:44:00.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-10T23:44:00.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-10T23:44:00.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-10T23:44:00.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-10T23:44:00.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-10T23:44:00.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-10T23:44:00.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-10T23:44:00.491 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-10T23:44:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-10T23:44:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-10T23:44:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-10T23:44:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-10T23:44:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-10T23:44:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph 2023-07-10T23:44:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-10T23:44:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core 2023-07-10T23:44:00.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/failover.ko 2023-07-10T23:44:00.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-10T23:44:00.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp 2023-07-10T23:44:00.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-10T23:44:00.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-10T23:44:00.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-10T23:44:00.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-10T23:44:00.493 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver 2023-07-10T23:44:00.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver/dns_resolver.ko 2023-07-10T23:44:00.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa 2023-07-10T23:44:00.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-10T23:44:00.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-10T23:44:00.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-10T23:44:00.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-10T23:44:00.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-10T23:44:00.494 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154 2023-07-10T23:44:00.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan 2023-07-10T23:44:00.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-10T23:44:00.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-10T23:44:00.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-10T23:44:00.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4 2023-07-10T23:44:00.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-10T23:44:00.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-10T23:44:00.495 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-10T23:44:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-10T23:44:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-10T23:44:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-10T23:44:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-10T23:44:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-10T23:44:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-10T23:44:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-10T23:44:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter 2023-07-10T23:44:00.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-10T23:44:00.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-10T23:44:00.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-10T23:44:00.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-10T23:44:00.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-10T23:44:00.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-10T23:44:00.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-10T23:44:00.497 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-10T23:44:00.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-10T23:44:00.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-10T23:44:00.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-10T23:44:00.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-10T23:44:00.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-10T23:44:00.498 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-10T23:44:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-10T23:44:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-10T23:44:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-10T23:44:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-10T23:44:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-10T23:44:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-10T23:44:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-10T23:44:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-10T23:44:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-10T23:44:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-10T23:44:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-10T23:44:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-10T23:44:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-10T23:44:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-10T23:44:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-10T23:44:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-10T23:44:00.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-10T23:44:00.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-10T23:44:00.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-10T23:44:00.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-10T23:44:00.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-10T23:44:00.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-10T23:44:00.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-10T23:44:00.501 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-10T23:44:00.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6 2023-07-10T23:44:00.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-10T23:44:00.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-10T23:44:00.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-10T23:44:00.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-10T23:44:00.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-10T23:44:00.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-10T23:44:00.502 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-10T23:44:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter 2023-07-10T23:44:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-10T23:44:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-10T23:44:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-10T23:44:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-10T23:44:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-10T23:44:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-10T23:44:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-10T23:44:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-10T23:44:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-10T23:44:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-10T23:44:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-10T23:44:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-10T23:44:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-10T23:44:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-10T23:44:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-10T23:44:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-10T23:44:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-10T23:44:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-10T23:44:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-10T23:44:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-10T23:44:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-10T23:44:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-10T23:44:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-10T23:44:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-10T23:44:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-10T23:44:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-10T23:44:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-10T23:44:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key 2023-07-10T23:44:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-10T23:44:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp 2023-07-10T23:44:00.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-10T23:44:00.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-10T23:44:00.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-10T23:44:00.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-10T23:44:00.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-10T23:44:00.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-10T23:44:00.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-10T23:44:00.507 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc 2023-07-10T23:44:00.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-10T23:44:00.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154 2023-07-10T23:44:00.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-10T23:44:00.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls 2023-07-10T23:44:00.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-10T23:44:00.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter 2023-07-10T23:44:00.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset 2023-07-10T23:44:00.508 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-10T23:44:00.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-10T23:44:00.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-10T23:44:00.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-10T23:44:00.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-10T23:44:00.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-10T23:44:00.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-10T23:44:00.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-10T23:44:00.509 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-10T23:44:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-10T23:44:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-10T23:44:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-10T23:44:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-10T23:44:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-10T23:44:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-10T23:44:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-10T23:44:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs 2023-07-10T23:44:00.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-10T23:44:00.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-10T23:44:00.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-10T23:44:00.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-10T23:44:00.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-10T23:44:00.511 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-10T23:44:00.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-10T23:44:00.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-10T23:44:00.512 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-10T23:44:00.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-10T23:44:00.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-10T23:44:00.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-10T23:44:00.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-10T23:44:00.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-10T23:44:00.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-10T23:44:00.513 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-10T23:44:00.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-10T23:44:00.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-10T23:44:00.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-10T23:44:00.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-10T23:44:00.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-10T23:44:00.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-10T23:44:00.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-10T23:44:00.514 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-10T23:44:00.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-10T23:44:00.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-10T23:44:00.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-10T23:44:00.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-10T23:44:00.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-10T23:44:00.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-10T23:44:00.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-10T23:44:00.515 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-10T23:44:00.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-10T23:44:00.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-10T23:44:00.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-10T23:44:00.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-10T23:44:00.516 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-10T23:44:00.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-10T23:44:00.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-10T23:44:00.517 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-10T23:44:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-10T23:44:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-10T23:44:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-10T23:44:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-10T23:44:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-10T23:44:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-10T23:44:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-10T23:44:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-10T23:44:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-10T23:44:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-10T23:44:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-10T23:44:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-10T23:44:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-10T23:44:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-10T23:44:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-10T23:44:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-10T23:44:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-10T23:44:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-10T23:44:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_quota.ko 2023-07-10T23:44:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-10T23:44:00.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-10T23:44:00.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-10T23:44:00.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-10T23:44:00.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tunnel.ko 2023-07-10T23:44:00.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-10T23:44:00.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-10T23:44:00.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-10T23:44:00.521 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-10T23:44:00.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-10T23:44:00.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-10T23:44:00.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-10T23:44:00.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-10T23:44:00.522 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-10T23:44:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-10T23:44:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-10T23:44:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-10T23:44:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-10T23:44:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-10T23:44:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-10T23:44:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-10T23:44:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-10T23:44:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-10T23:44:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-10T23:44:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-10T23:44:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-10T23:44:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-10T23:44:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-10T23:44:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-10T23:44:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-10T23:44:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-10T23:44:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-10T23:44:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-10T23:44:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-10T23:44:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-10T23:44:00.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-10T23:44:00.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-10T23:44:00.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-10T23:44:00.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-10T23:44:00.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-10T23:44:00.526 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-10T23:44:00.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-10T23:44:00.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-10T23:44:00.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-10T23:44:00.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-10T23:44:00.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-10T23:44:00.527 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-10T23:44:00.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-10T23:44:00.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-10T23:44:00.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-10T23:44:00.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-10T23:44:00.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-10T23:44:00.528 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-10T23:44:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-10T23:44:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-10T23:44:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-10T23:44:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-10T23:44:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-10T23:44:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-10T23:44:00.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-10T23:44:00.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-10T23:44:00.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-10T23:44:00.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-10T23:44:00.530 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-10T23:44:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-10T23:44:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-10T23:44:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-10T23:44:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-10T23:44:00.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-10T23:44:00.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-10T23:44:00.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-10T23:44:00.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-10T23:44:00.532 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-10T23:44:00.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-10T23:44:00.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-10T23:44:00.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-10T23:44:00.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink 2023-07-10T23:44:00.533 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-10T23:44:00.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh 2023-07-10T23:44:00.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-10T23:44:00.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch 2023-07-10T23:44:00.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-10T23:44:00.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-10T23:44:00.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-10T23:44:00.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-10T23:44:00.534 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet 2023-07-10T23:44:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-10T23:44:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds 2023-07-10T23:44:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-10T23:44:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-10T23:44:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-10T23:44:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched 2023-07-10T23:44:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-10T23:44:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-10T23:44:00.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-10T23:44:00.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-10T23:44:00.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-10T23:44:00.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-10T23:44:00.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-10T23:44:00.536 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-10T23:44:00.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-10T23:44:00.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-10T23:44:00.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-10T23:44:00.537 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-10T23:44:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-10T23:44:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-10T23:44:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-10T23:44:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-10T23:44:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-10T23:44:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-10T23:44:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-10T23:44:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-10T23:44:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-10T23:44:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-10T23:44:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-10T23:44:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-10T23:44:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-10T23:44:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-10T23:44:00.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-10T23:44:00.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-10T23:44:00.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-10T23:44:00.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-10T23:44:00.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-10T23:44:00.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-10T23:44:00.540 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-10T23:44:00.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-10T23:44:00.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-10T23:44:00.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-10T23:44:00.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-10T23:44:00.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-10T23:44:00.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-10T23:44:00.541 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-10T23:44:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-10T23:44:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-10T23:44:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-10T23:44:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-10T23:44:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp 2023-07-10T23:44:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-10T23:44:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-10T23:44:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc 2023-07-10T23:44:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss 2023-07-10T23:44:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-10T23:44:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-10T23:44:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-10T23:44:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma 2023-07-10T23:44:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-10T23:44:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc 2023-07-10T23:44:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-10T23:44:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-10T23:44:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix 2023-07-10T23:44:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-10T23:44:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock 2023-07-10T23:44:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-10T23:44:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-10T23:44:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-10T23:44:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-10T23:44:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-10T23:44:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm 2023-07-10T23:44:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-10T23:44:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security 2023-07-10T23:44:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys 2023-07-10T23:44:00.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys 2023-07-10T23:44:00.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-10T23:44:00.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys 2023-07-10T23:44:00.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys/trusted.ko 2023-07-10T23:44:00.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt 2023-07-10T23:44:00.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib 2023-07-10T23:44:00.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-10T23:44:00.546 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-10T23:44:00.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-10T23:44:00.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-10T23:44:00.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-10T23:44:00.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-10T23:44:00.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-10T23:44:00.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-10T23:44:00.547 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-10T23:44:00.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-10T23:44:00.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-10T23:44:00.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-10T23:44:00.548 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-10T23:44:00.549 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-10T23:44:00.549 DEBUG:teuthology.orchestra.run.smithi131:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-10T23:44:00.578 INFO:teuthology.orchestra.run.smithi131.stdout:postinstall scriptlet (using /bin/sh): 2023-07-10T23:44:00.578 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-g84139c18d56f -a -r /boot/System.map-6.4.0-g84139c18d56f ]; then 2023-07-10T23:44:00.579 INFO:teuthology.orchestra.run.smithi131.stdout:cp /boot/vmlinuz-6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm 2023-07-10T23:44:00.579 INFO:teuthology.orchestra.run.smithi131.stdout:cp /boot/System.map-6.4.0-g84139c18d56f /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-10T23:44:00.579 INFO:teuthology.orchestra.run.smithi131.stdout:rm -f /boot/vmlinuz-6.4.0-g84139c18d56f /boot/System.map-6.4.0-g84139c18d56f 2023-07-10T23:44:00.579 INFO:teuthology.orchestra.run.smithi131.stdout:/sbin/installkernel 6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-10T23:44:00.579 INFO:teuthology.orchestra.run.smithi131.stdout:rm -f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-10T23:44:00.579 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2023-07-10T23:44:00.579 INFO:teuthology.orchestra.run.smithi131.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-10T23:44:00.580 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-10T23:44:00.580 INFO:teuthology.orchestra.run.smithi131.stdout:new-kernel-pkg --remove 6.4.0-g84139c18d56f --rminitrd --initrdfile=/boot/initramfs-6.4.0-g84139c18d56f.img 2023-07-10T23:44:00.580 INFO:teuthology.orchestra.run.smithi131.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-10T23:44:00.580 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-install remove 6.4.0-g84139c18d56f 2023-07-10T23:44:00.580 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2023-07-10T23:44:00.580 INFO:teuthology.orchestra.run.smithi131.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-10T23:44:00.580 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-10T23:44:00.580 INFO:teuthology.orchestra.run.smithi131.stdout:/sbin/update-bootloader --remove 6.4.0-g84139c18d56f 2023-07-10T23:44:00.581 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2023-07-10T23:44:00.582 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -qi grub2-tools 2023-07-10T23:44:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:Name : grub2-tools 2023-07-10T23:44:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:Epoch : 1 2023-07-10T23:44:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:Version : 2.02 2023-07-10T23:44:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:Release : 129.el8 2023-07-10T23:44:00.664 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: x86_64 2023-07-10T23:44:00.664 INFO:teuthology.orchestra.run.smithi131.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-10T23:44:00.664 INFO:teuthology.orchestra.run.smithi131.stdout:Group : System Environment/Base 2023-07-10T23:44:00.664 INFO:teuthology.orchestra.run.smithi131.stdout:Size : 9265586 2023-07-10T23:44:00.664 INFO:teuthology.orchestra.run.smithi131.stdout:License : GPLv3+ 2023-07-10T23:44:00.664 INFO:teuthology.orchestra.run.smithi131.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-10T23:44:00.664 INFO:teuthology.orchestra.run.smithi131.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-10T23:44:00.665 INFO:teuthology.orchestra.run.smithi131.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-10T23:44:00.665 INFO:teuthology.orchestra.run.smithi131.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-10T23:44:00.665 INFO:teuthology.orchestra.run.smithi131.stdout:Relocations : (not relocatable) 2023-07-10T23:44:00.665 INFO:teuthology.orchestra.run.smithi131.stdout:Packager : CentOS BuildSystem 2023-07-10T23:44:00.665 INFO:teuthology.orchestra.run.smithi131.stdout:Vendor : CentOS 2023-07-10T23:44:00.665 INFO:teuthology.orchestra.run.smithi131.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-10T23:44:00.666 INFO:teuthology.orchestra.run.smithi131.stdout:Summary : Support tools for GRUB. 2023-07-10T23:44:00.666 INFO:teuthology.orchestra.run.smithi131.stdout:Description : 2023-07-10T23:44:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:44:00.666 INFO:teuthology.orchestra.run.smithi131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi131.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi131.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi131.stdout:hardware devices. 2023-07-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi131.stdout:This subpackage provides tools for support of all platforms. 2023-07-10T23:44:00.669 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-10T23:44:00.669 INFO:teuthology.task.kernel:Updating grub on smithi131 to boot 6.4.0-g84139c18d56f 2023-07-10T23:44:00.669 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-10T23:44:04.200 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2023-07-10T23:44:06.385 INFO:teuthology.orchestra.run.smithi131.stderr:done 2023-07-10T23:44:06.385 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2023-07-10T23:44:06.427 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.uxqI6w3VPW 2023-07-10T23:44:06.427 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uxqI6w3VPW 2023-07-10T23:44:06.501 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.uxqI6w3VPW 2023-07-10T23:44:06.660 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.uxqI6w3VPW is 6KB 2023-07-10T23:44:06.709 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.uxqI6w3VPW 2023-07-10T23:44:06.727 DEBUG:teuthology.orchestra.run.smithi131:> sudo /bin/ls /boot/loader/entries || true 2023-07-10T23:44:06.794 INFO:teuthology.orchestra.run.smithi131.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-10T23:44:06.794 INFO:teuthology.orchestra.run.smithi131.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-10T23:44:06.795 INFO:teuthology.orchestra.run.smithi131.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-10T23:44:06.795 INFO:teuthology.orchestra.run.smithi131.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f.conf 2023-07-10T23:44:06.796 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f 2023-07-10T23:44:06.936 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2023-07-10T23:44:36.940 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-10T23:44:36.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-10T23:44:36.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:44:55.408 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-07-10T23:45:04.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-10T23:45:04.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:46:04.414 DEBUG:teuthology.orchestra.remote:timed out 2023-07-10T23:46:16.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-10T23:46:16.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:46:16.755 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-07-10T23:46:17.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-10T23:46:17.105 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-g84139c18d56f"... 2023-07-10T23:46:17.106 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2023-07-10T23:46:17.154 INFO:teuthology.orchestra.run.smithi131.stdout:6.4.0-g84139c18d56f 2023-07-10T23:46:17.155 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-10T23:46:17.155 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-10T23:46:17.155 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-10T23:46:18.157 DEBUG:teuthology.parallel:result is None 2023-07-10T23:46:18.158 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-10T23:46:18.172 INFO:teuthology.task.internal:Creating test directory... 2023-07-10T23:46:18.173 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-10T23:46:18.177 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-10T23:46:18.179 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-10T23:46:18.230 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-10T23:46:18.238 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-10T23:46:18.250 INFO:teuthology.task.internal:Creating archive directory... 2023-07-10T23:46:18.251 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-10T23:46:18.254 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-10T23:46:18.256 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-10T23:46:18.332 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-10T23:46:18.340 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-10T23:46:18.340 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-10T23:46:18.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-10T23:46:18.363 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-10T23:46:18.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-10T23:46:18.392 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-10T23:46:18.406 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-10T23:46:18.437 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-10T23:46:18.449 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-10T23:46:18.466 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-10T23:46:18.489 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-10T23:46:18.508 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-10T23:46:18.566 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-10T23:46:18.598 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-10T23:46:18.601 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-10T23:46:18.617 INFO:teuthology.task.internal:Configuring sudo... 2023-07-10T23:46:18.619 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-10T23:46:18.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-10T23:46:18.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-10T23:46:18.694 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-10T23:46:18.704 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-10T23:46:18.704 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-10T23:46:18.711 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-10T23:46:18.714 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-10T23:46:18.759 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-10T23:46:18.831 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-10T23:46:18.882 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-10T23:46:18.976 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-10T23:46:19.026 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:46:19.026 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-10T23:46:19.097 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-10T23:46:19.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-10T23:46:19.215 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-10T23:46:19.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-10T23:46:19.309 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:46:19.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-10T23:46:19.382 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-10T23:46:19.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-10T23:46:19.533 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-10T23:46:19.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-10T23:46:19.690 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-10T23:46:19.690 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-10T23:46:19.759 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2023-07-10T23:46:19.762 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2023-07-10T23:46:19.765 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2023-07-10T23:46:19.817 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-10T23:46:19.822 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-10T23:46:19.929 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-10T23:46:20.339 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-10T23:46:20.356 INFO:teuthology.task.internal:Starting timer... 2023-07-10T23:46:20.356 INFO:teuthology.run_tasks:Running task pcp... 2023-07-10T23:46:20.371 INFO:teuthology.run_tasks:Running task selinux... 2023-07-10T23:46:20.386 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-10T23:46:20.387 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2023-07-10T23:46:20.473 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: 2023-07-10T23:46:20.475 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2023-07-10T23:46:20.597 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2023-07-10T23:46:20.597 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2023-07-10T23:46:20.744 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2023-07-10T23:46:20.747 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-10T23:46:20.748 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2023-07-10T23:46:20.773 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2023-07-10T23:46:20.773 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2023-07-10T23:46:20.799 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2023-07-10T23:46:20.800 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2023-07-10T23:46:20.849 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2023-07-10T23:46:20.850 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi131.front.sepia.ceph.com': 'permissive'} 2023-07-10T23:46:20.851 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-10T23:46:20.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-10T23:46:20.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-10T23:46:20.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-10T23:46:20.913 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-10T23:46:20.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-10T23:46:20.981 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-10T23:46:20.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2023-07-10T23:46:21.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2023-07-10T23:46:21.039 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2023-07-10T23:46:21.114 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-10T23:46:21.132 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-10T23:46:21.133 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-10T23:46:21.162 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-10T23:46:21.164 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi070.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-10T23:56:23.593 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2023-07-10T23:56:23.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-10T23:56:23.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:56:23.668 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-07-10T23:56:23.699 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-10T23:56:23.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-07-10T23:56:23.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:56:23.767 DEBUG:teuthology.orchestra.run.smithi070:> true 2023-07-10T23:56:23.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-07-10T23:56:23.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-10T23:56:23.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:56:23.928 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-07-10T23:56:24.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-10T23:56:24.050 INFO:teuthology.run_tasks:Running task clock... 2023-07-10T23:56:24.061 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-10T23:56:24.062 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-10T23:56:24.063 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-10T23:56:24.066 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-10T23:56:24.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-10T23:56:24.069 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-10T23:56:24.070 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-10T23:56:24.103 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-10T23:56:24.105 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-10T23:56:24.120 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-10T23:56:24.121 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-10T23:56:24.164 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-10T23:56:24.192 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2023-07-10T23:56:24.196 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-10T23:56:24.200 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2023-07-10T23:56:24.204 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2023-07-10T23:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2023-07-10T23:56:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-10T23:56:24.227 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-10T23:56:24.235 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-10T23:56:24.240 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-10T23:56:24.282 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2023-07-10T23:56:24.302 INFO:teuthology.orchestra.run.smithi038.stderr:bash: ntpq: command not found 2023-07-10T23:56:24.307 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-10T23:56:24.307 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2023-07-10T23:56:24.307 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.308 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.308 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.308 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.310 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2023-07-10T23:56:24.313 INFO:teuthology.orchestra.run.smithi070.stderr:bash: ntpq: command not found 2023-07-10T23:56:24.317 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-10T23:56:24.317 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2023-07-10T23:56:24.318 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.318 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.318 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.318 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.343 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-10T23:56:24.375 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-10T23:56:24.462 INFO:teuthology.orchestra.run.smithi131.stderr:bash: ntpq: command not found 2023-07-10T23:56:24.468 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-10T23:56:24.468 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2023-07-10T23:56:24.469 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.469 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.469 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.469 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-10T23:56:24.470 INFO:teuthology.run_tasks:Running task install... 2023-07-10T23:56:24.481 DEBUG:teuthology.task.install:project ceph 2023-07-10T23:56:24.482 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}} 2023-07-10T23:56:24.482 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'} 2023-07-10T23:56:24.483 INFO:teuthology.task.install:Using flavor: default 2023-07-10T23:56:24.488 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-10T23:56:24.489 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-10T23:56:24.489 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'tag': None, 'wait_for_package': False} 2023-07-10T23:56:24.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-10T23:56:24.492 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'tag': None, 'wait_for_package': False} 2023-07-10T23:56:24.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-10T23:56:24.493 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'tag': None, 'wait_for_package': False} 2023-07-10T23:56:24.494 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-10T23:56:24.643 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/ 2023-07-10T23:56:24.644 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4828.gb5891ed6 2023-07-10T23:56:24.709 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/ 2023-07-10T23:56:24.710 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4828.gb5891ed6 2023-07-10T23:56:24.714 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/ 2023-07-10T23:56:24.714 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4828.gb5891ed6 2023-07-10T23:56:24.980 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-10T23:56:24.980 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:56:24.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-10T23:56:25.007 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-10T23:56:25.007 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-10T23:56:25.008 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-10T23:56:25.014 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-10T23:56:25.014 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-10T23:56:25.047 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-10T23:56:25.047 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:56:25.048 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-10T23:56:25.078 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-10T23:56:25.078 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-10T23:56:25.082 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-10T23:56:25.083 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-10T23:56:25.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-10T23:56:25.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-10T23:56:25.170 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-10T23:56:25.188 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-10T23:56:25.240 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-10T23:56:25.242 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2023-07-10T23:56:25.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2023-07-10T23:56:25.283 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-10T23:56:25.310 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2023-07-10T23:56:25.311 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2023-07-10T23:56:25.351 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2023-07-10T23:56:25.354 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2023-07-10T23:56:25.514 INFO:teuthology.orchestra.run.smithi070.stdout:73 files removed 2023-07-10T23:56:25.542 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-10T23:56:25.600 INFO:teuthology.orchestra.run.smithi038.stdout:73 files removed 2023-07-10T23:56:25.631 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-10T23:56:25.698 INFO:teuthology.orchestra.run.smithi131.stdout:73 files removed 2023-07-10T23:56:25.732 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-10T23:56:26.478 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 144 kB/s | 81 kB 00:00 2023-07-10T23:56:26.670 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 126 kB/s | 81 kB 00:00 2023-07-10T23:56:26.770 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 161 kB/s | 81 kB 00:00 2023-07-10T23:56:27.087 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-07-10T23:56:27.196 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 19 kB/s | 9.4 kB 00:00 2023-07-10T23:56:27.354 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 17 kB/s | 9.4 kB 00:00 2023-07-10T23:56:27.796 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 2.2 kB/s | 1.5 kB 00:00 2023-07-10T23:56:27.962 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 2.0 kB/s | 1.5 kB 00:00 2023-07-10T23:56:28.088 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 2.1 kB/s | 1.5 kB 00:00 2023-07-10T23:56:28.779 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 8 - AppStream 32 MB/s | 31 MB 00:00 2023-07-10T23:56:29.313 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 8 - AppStream 23 MB/s | 31 MB 00:01 2023-07-10T23:56:30.121 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - AppStream 15 MB/s | 31 MB 00:02 2023-07-10T23:56:36.137 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 8 - BaseOS 23 MB/s | 41 MB 00:01 2023-07-10T23:56:36.705 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 8 - BaseOS 28 MB/s | 41 MB 00:01 2023-07-10T23:56:37.739 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - BaseOS 25 MB/s | 41 MB 00:01 2023-07-10T23:56:42.395 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 8 - Extras 62 kB/s | 18 kB 00:00 2023-07-10T23:56:42.948 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.6 kB 00:00 2023-07-10T23:56:43.671 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 8 - Extras 27 kB/s | 18 kB 00:00 2023-07-10T23:56:44.182 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 8 - PowerTools 5.8 MB/s | 6.3 MB 00:01 2023-07-10T23:56:44.239 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.6 kB 00:00 2023-07-10T23:56:44.472 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - Extras 38 kB/s | 18 kB 00:00 2023-07-10T23:56:45.206 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.6 kB 00:00 2023-07-10T23:56:45.490 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 8 - PowerTools 5.7 MB/s | 6.3 MB 00:01 2023-07-10T23:56:46.624 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - PowerTools 5.0 MB/s | 6.3 MB 00:01 2023-07-10T23:56:48.025 INFO:teuthology.orchestra.run.smithi070.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-10T23:56:48.808 INFO:teuthology.orchestra.run.smithi038.stdout:Copr repo for python3-asyncssh owned by ceph 1.7 kB/s | 3.5 kB 00:01 2023-07-10T23:56:49.026 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-07-10T23:56:50.642 INFO:teuthology.orchestra.run.smithi131.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-10T23:56:50.976 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 16 MB 00:01 2023-07-10T23:56:52.476 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 16 MB 00:01 2023-07-10T23:56:52.809 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 370 kB/s | 24 kB 00:00 2023-07-10T23:56:54.909 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 530 kB/s | 24 kB 00:00 2023-07-10T23:56:56.695 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-10T23:56:56.696 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-10T23:56:56.709 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-10T23:56:56.709 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-10T23:56:56.710 INFO:teuthology.orchestra.run.smithi070.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-10T23:56:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-10T23:56:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-10T23:56:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-10T23:56:56.717 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-10T23:56:56.718 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-10T23:56:56.810 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 418 kB/s | 24 kB 00:00 2023-07-10T23:56:56.900 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2023-07-10T23:56:56.914 INFO:teuthology.orchestra.run.smithi070.stdout:==================================================================================================== 2023-07-10T23:56:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2023-07-10T23:56:56.915 INFO:teuthology.orchestra.run.smithi070.stdout:==================================================================================================== 2023-07-10T23:56:56.915 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2023-07-10T23:56:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-10T23:56:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.4 k 2023-07-10T23:56:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 5.4 M 2023-07-10T23:56:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 848 k 2023-07-10T23:56:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 165 k 2023-07-10T23:56:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 1.5 M 2023-07-10T23:56:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 129 k 2023-07-10T23:56:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 1.7 M 2023-07-10T23:56:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 7.4 M 2023-07-10T23:56:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 47 k 2023-07-10T23:56:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 13 M 2023-07-10T23:56:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 48 M 2023-07-10T23:56:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 258 k 2023-07-10T23:56:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 164 k 2023-07-10T23:56:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 258 k 2023-07-10T23:56:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 18 k 2023-07-10T23:56:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-10T23:56:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-10T23:56:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-10T23:56:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 31 k 2023-07-10T23:56:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 771 k 2023-07-10T23:56:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 139 k 2023-07-10T23:56:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-10T23:56:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-10T23:56:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-10T23:56:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-10T23:56:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-10T23:56:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-10T23:56:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 197 k 2023-07-10T23:56:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 371 k 2023-07-10T23:56:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 364 k 2023-07-10T23:56:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 107 k 2023-07-10T23:56:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 94 k 2023-07-10T23:56:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.4 M 2023-07-10T23:56:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 180 k 2023-07-10T23:56:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-10T23:56:56.924 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2023-07-10T23:56:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-10T23:56:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-10T23:56:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-10T23:56:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-10T23:56:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-10T23:56:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-10T23:56:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-10T23:56:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-10T23:56:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.7 M 2023-07-10T23:56:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.6 M 2023-07-10T23:56:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-10T23:56:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-10T23:56:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-10T23:56:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-10T23:56:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-10T23:56:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-10T23:56:56.928 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2023-07-10T23:56:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-10T23:56:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 22 M 2023-07-10T23:56:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 23 k 2023-07-10T23:56:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 2.3 M 2023-07-10T23:56:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 240 k 2023-07-10T23:56:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 4.6 M 2023-07-10T23:56:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 18 M 2023-07-10T23:56:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 15 k 2023-07-10T23:56:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 24 k 2023-07-10T23:56:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-10T23:56:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-10T23:56:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-10T23:56:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-10T23:56:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-10T23:56:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 137 k 2023-07-10T23:56:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-10T23:56:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-10T23:56:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-10T23:56:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-10T23:56:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-10T23:56:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-10T23:56:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 473 k 2023-07-10T23:56:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-10T23:56:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.7 M 2023-07-10T23:56:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-10T23:56:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-10T23:56:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-10T23:56:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-10T23:56:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-10T23:56:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-10T23:56:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-10T23:56:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-10T23:56:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-10T23:56:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-10T23:56:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-10T23:56:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-10T23:56:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-10T23:56:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-10T23:56:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-10T23:56:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-10T23:56:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-10T23:56:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 45 k 2023-07-10T23:56:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 122 k 2023-07-10T23:56:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-10T23:56:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-10T23:56:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-10T23:56:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-10T23:56:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-10T23:56:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-10T23:56:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-10T23:56:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-10T23:56:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-10T23:56:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-10T23:56:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-10T23:56:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-10T23:56:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-10T23:56:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-10T23:56:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-10T23:56:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-10T23:56:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-10T23:56:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-10T23:56:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-10T23:56:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-10T23:56:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-10T23:56:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-10T23:56:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-10T23:56:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-10T23:56:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-10T23:56:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-10T23:56:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-10T23:56:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-10T23:56:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-10T23:56:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-10T23:56:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-10T23:56:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-10T23:56:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-10T23:56:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-10T23:56:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-10T23:56:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-10T23:56:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-10T23:56:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-10T23:56:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-10T23:56:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-10T23:56:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-10T23:56:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-10T23:56:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-10T23:56:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-10T23:56:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-10T23:56:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-10T23:56:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-10T23:56:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-10T23:56:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-10T23:56:56.947 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling module streams: 2023-07-10T23:56:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql 10 2023-07-10T23:56:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:56:56.948 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2023-07-10T23:56:56.948 INFO:teuthology.orchestra.run.smithi070.stdout:==================================================================================================== 2023-07-10T23:56:56.948 INFO:teuthology.orchestra.run.smithi070.stdout:Install 128 Packages 2023-07-10T23:56:56.948 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 16 Packages 2023-07-10T23:56:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:56:56.949 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 212 M 2023-07-10T23:56:56.949 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2023-07-10T23:56:57.678 INFO:teuthology.orchestra.run.smithi070.stdout:(1/144): ceph-18.0.0-4828.gb5891ed6.el8.x86_64. 15 kB/s | 6.4 kB 00:00 2023-07-10T23:56:58.727 INFO:teuthology.orchestra.run.smithi070.stdout:(2/144): ceph-fuse-18.0.0-4828.gb5891ed6.el8.x8 809 kB/s | 848 kB 00:01 2023-07-10T23:56:58.935 INFO:teuthology.orchestra.run.smithi070.stdout:(3/144): ceph-immutable-object-cache-18.0.0-482 795 kB/s | 165 kB 00:00 2023-07-10T23:56:58.984 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-10T23:56:58.985 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-10T23:56:58.999 INFO:teuthology.orchestra.run.smithi038.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-10T23:56:58.999 INFO:teuthology.orchestra.run.smithi038.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-10T23:56:59.000 INFO:teuthology.orchestra.run.smithi038.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-10T23:56:59.001 INFO:teuthology.orchestra.run.smithi038.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-10T23:56:59.002 INFO:teuthology.orchestra.run.smithi038.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-10T23:56:59.004 INFO:teuthology.orchestra.run.smithi038.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-10T23:56:59.007 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-10T23:56:59.008 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-10T23:56:59.205 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-07-10T23:56:59.220 INFO:teuthology.orchestra.run.smithi038.stdout:==================================================================================================== 2023-07-10T23:56:59.220 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-07-10T23:56:59.221 INFO:teuthology.orchestra.run.smithi038.stdout:==================================================================================================== 2023-07-10T23:56:59.221 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-07-10T23:56:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-10T23:56:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.4 k 2023-07-10T23:56:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 5.4 M 2023-07-10T23:56:59.221 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 848 k 2023-07-10T23:56:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 165 k 2023-07-10T23:56:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 1.5 M 2023-07-10T23:56:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 129 k 2023-07-10T23:56:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 1.7 M 2023-07-10T23:56:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 7.4 M 2023-07-10T23:56:59.222 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 47 k 2023-07-10T23:56:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 13 M 2023-07-10T23:56:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 48 M 2023-07-10T23:56:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 258 k 2023-07-10T23:56:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 164 k 2023-07-10T23:56:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 258 k 2023-07-10T23:56:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 18 k 2023-07-10T23:56:59.223 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-10T23:56:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-10T23:56:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-10T23:56:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 31 k 2023-07-10T23:56:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 771 k 2023-07-10T23:56:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 139 k 2023-07-10T23:56:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-10T23:56:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-10T23:56:59.225 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-10T23:56:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-10T23:56:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-10T23:56:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-10T23:56:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 197 k 2023-07-10T23:56:59.226 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 371 k 2023-07-10T23:56:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 364 k 2023-07-10T23:56:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 107 k 2023-07-10T23:56:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 94 k 2023-07-10T23:56:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.4 M 2023-07-10T23:56:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 180 k 2023-07-10T23:56:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-10T23:56:59.227 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2023-07-10T23:56:59.227 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-10T23:56:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-10T23:56:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-10T23:56:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-10T23:56:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-10T23:56:59.228 INFO:teuthology.orchestra.run.smithi038.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-10T23:56:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-10T23:56:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-10T23:56:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.7 M 2023-07-10T23:56:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.6 M 2023-07-10T23:56:59.229 INFO:teuthology.orchestra.run.smithi038.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-10T23:56:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-10T23:56:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-10T23:56:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-10T23:56:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-10T23:56:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-10T23:56:59.230 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-07-10T23:56:59.230 INFO:teuthology.orchestra.run.smithi038.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-10T23:56:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 22 M 2023-07-10T23:56:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 23 k 2023-07-10T23:56:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 2.3 M 2023-07-10T23:56:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 240 k 2023-07-10T23:56:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 4.6 M 2023-07-10T23:56:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 18 M 2023-07-10T23:56:59.231 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 15 k 2023-07-10T23:56:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 24 k 2023-07-10T23:56:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-10T23:56:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-10T23:56:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-10T23:56:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-10T23:56:59.232 INFO:teuthology.orchestra.run.smithi038.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-10T23:56:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 137 k 2023-07-10T23:56:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-10T23:56:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-10T23:56:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-10T23:56:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-10T23:56:59.233 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-10T23:56:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-10T23:56:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 473 k 2023-07-10T23:56:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-10T23:56:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.7 M 2023-07-10T23:56:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-10T23:56:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-10T23:56:59.234 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-10T23:56:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-10T23:56:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-10T23:56:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-10T23:56:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-10T23:56:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-10T23:56:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-10T23:56:59.235 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-10T23:56:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-10T23:56:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-10T23:56:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-10T23:56:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-10T23:56:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-10T23:56:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-10T23:56:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-10T23:56:59.236 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 45 k 2023-07-10T23:56:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 122 k 2023-07-10T23:56:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-10T23:56:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-10T23:56:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-10T23:56:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-10T23:56:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-10T23:56:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-10T23:56:59.237 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-10T23:56:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-10T23:56:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-10T23:56:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-10T23:56:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-10T23:56:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-10T23:56:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-10T23:56:59.238 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-10T23:56:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-10T23:56:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-10T23:56:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-10T23:56:59.239 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-10T23:56:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-10T23:56:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-10T23:56:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-10T23:56:59.240 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-10T23:56:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-10T23:56:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-10T23:56:59.241 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-10T23:56:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-10T23:56:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-10T23:56:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-10T23:56:59.242 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-10T23:56:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-10T23:56:59.243 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-10T23:56:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-10T23:56:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-10T23:56:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-10T23:56:59.244 INFO:teuthology.orchestra.run.smithi038.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-10T23:56:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-10T23:56:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-10T23:56:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-10T23:56:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-10T23:56:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-10T23:56:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-10T23:56:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-10T23:56:59.245 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-10T23:56:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-10T23:56:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-10T23:56:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-10T23:56:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-10T23:56:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-10T23:56:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-10T23:56:59.246 INFO:teuthology.orchestra.run.smithi038.stdout:Enabling module streams: 2023-07-10T23:56:59.246 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql 10 2023-07-10T23:56:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:56:59.247 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-07-10T23:56:59.247 INFO:teuthology.orchestra.run.smithi038.stdout:==================================================================================================== 2023-07-10T23:56:59.247 INFO:teuthology.orchestra.run.smithi038.stdout:Install 128 Packages 2023-07-10T23:56:59.247 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 16 Packages 2023-07-10T23:56:59.247 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:56:59.248 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 212 M 2023-07-10T23:56:59.248 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-07-10T23:56:59.819 INFO:teuthology.orchestra.run.smithi038.stdout:(1/144): ceph-18.0.0-4828.gb5891ed6.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2023-07-10T23:57:00.661 INFO:teuthology.orchestra.run.smithi038.stdout:(2/144): ceph-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.0 MB/s | 848 kB 00:00 2023-07-10T23:57:00.768 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-10T23:57:00.768 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-10T23:57:00.781 INFO:teuthology.orchestra.run.smithi131.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-10T23:57:00.781 INFO:teuthology.orchestra.run.smithi131.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-10T23:57:00.782 INFO:teuthology.orchestra.run.smithi131.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-10T23:57:00.783 INFO:teuthology.orchestra.run.smithi131.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-10T23:57:00.784 INFO:teuthology.orchestra.run.smithi131.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-10T23:57:00.786 INFO:teuthology.orchestra.run.smithi131.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-10T23:57:00.789 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-10T23:57:00.790 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-10T23:57:00.819 INFO:teuthology.orchestra.run.smithi038.stdout:(3/144): ceph-immutable-object-cache-18.0.0-482 1.0 MB/s | 165 kB 00:00 2023-07-10T23:57:00.982 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-07-10T23:57:00.995 INFO:teuthology.orchestra.run.smithi131.stdout:==================================================================================================== 2023-07-10T23:57:00.996 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2023-07-10T23:57:00.996 INFO:teuthology.orchestra.run.smithi131.stdout:==================================================================================================== 2023-07-10T23:57:00.997 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2023-07-10T23:57:00.997 INFO:teuthology.orchestra.run.smithi131.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-10T23:57:00.997 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.4 k 2023-07-10T23:57:00.997 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 5.4 M 2023-07-10T23:57:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 848 k 2023-07-10T23:57:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 165 k 2023-07-10T23:57:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 1.5 M 2023-07-10T23:57:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 129 k 2023-07-10T23:57:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 1.7 M 2023-07-10T23:57:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 7.4 M 2023-07-10T23:57:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 47 k 2023-07-10T23:57:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 13 M 2023-07-10T23:57:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 48 M 2023-07-10T23:57:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 258 k 2023-07-10T23:57:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 164 k 2023-07-10T23:57:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 258 k 2023-07-10T23:57:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 18 k 2023-07-10T23:57:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-10T23:57:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-10T23:57:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-10T23:57:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 31 k 2023-07-10T23:57:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 771 k 2023-07-10T23:57:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 139 k 2023-07-10T23:57:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-10T23:57:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-10T23:57:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-10T23:57:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-10T23:57:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-10T23:57:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-10T23:57:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 197 k 2023-07-10T23:57:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 371 k 2023-07-10T23:57:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 364 k 2023-07-10T23:57:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 107 k 2023-07-10T23:57:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 94 k 2023-07-10T23:57:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.4 M 2023-07-10T23:57:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 180 k 2023-07-10T23:57:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-10T23:57:01.004 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2023-07-10T23:57:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-10T23:57:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-10T23:57:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-10T23:57:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-10T23:57:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-10T23:57:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-10T23:57:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-10T23:57:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-10T23:57:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.7 M 2023-07-10T23:57:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.6 M 2023-07-10T23:57:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-10T23:57:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-10T23:57:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-10T23:57:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-10T23:57:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-10T23:57:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-10T23:57:01.007 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2023-07-10T23:57:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-10T23:57:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 22 M 2023-07-10T23:57:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 23 k 2023-07-10T23:57:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 2.3 M 2023-07-10T23:57:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 240 k 2023-07-10T23:57:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 4.6 M 2023-07-10T23:57:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 18 M 2023-07-10T23:57:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 15 k 2023-07-10T23:57:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 24 k 2023-07-10T23:57:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-10T23:57:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-10T23:57:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-10T23:57:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-10T23:57:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-10T23:57:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 137 k 2023-07-10T23:57:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-10T23:57:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-10T23:57:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-10T23:57:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-10T23:57:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-10T23:57:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-10T23:57:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 473 k 2023-07-10T23:57:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-10T23:57:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.7 M 2023-07-10T23:57:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-10T23:57:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-10T23:57:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-10T23:57:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-10T23:57:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-10T23:57:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-10T23:57:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-10T23:57:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-10T23:57:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-10T23:57:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-10T23:57:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-10T23:57:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-10T23:57:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-10T23:57:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-10T23:57:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-10T23:57:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-10T23:57:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-10T23:57:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 45 k 2023-07-10T23:57:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 122 k 2023-07-10T23:57:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-10T23:57:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-10T23:57:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-10T23:57:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-10T23:57:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-10T23:57:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-10T23:57:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-10T23:57:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-10T23:57:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-10T23:57:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-10T23:57:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-10T23:57:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-10T23:57:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-10T23:57:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-10T23:57:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-10T23:57:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-10T23:57:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-10T23:57:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-10T23:57:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-10T23:57:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-10T23:57:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-10T23:57:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-10T23:57:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-10T23:57:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-10T23:57:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-10T23:57:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-10T23:57:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-10T23:57:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-10T23:57:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-10T23:57:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-10T23:57:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-10T23:57:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-10T23:57:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-10T23:57:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-10T23:57:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-10T23:57:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-10T23:57:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-10T23:57:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-10T23:57:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-10T23:57:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-10T23:57:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-10T23:57:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-10T23:57:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-10T23:57:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-10T23:57:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-10T23:57:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-10T23:57:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-10T23:57:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-10T23:57:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-10T23:57:01.019 INFO:teuthology.orchestra.run.smithi131.stdout:Enabling module streams: 2023-07-10T23:57:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql 10 2023-07-10T23:57:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:57:01.019 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-07-10T23:57:01.019 INFO:teuthology.orchestra.run.smithi131.stdout:==================================================================================================== 2023-07-10T23:57:01.019 INFO:teuthology.orchestra.run.smithi131.stdout:Install 128 Packages 2023-07-10T23:57:01.020 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 16 Packages 2023-07-10T23:57:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:57:01.020 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 212 M 2023-07-10T23:57:01.021 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-07-10T23:57:01.085 INFO:teuthology.orchestra.run.smithi070.stdout:(4/144): ceph-base-18.0.0-4828.gb5891ed6.el8.x8 1.4 MB/s | 5.4 MB 00:03 2023-07-10T23:57:01.298 INFO:teuthology.orchestra.run.smithi070.stdout:(5/144): ceph-mds-18.0.0-4828.gb5891ed6.el8.x86 992 kB/s | 2.3 MB 00:02 2023-07-10T23:57:01.819 INFO:teuthology.orchestra.run.smithi131.stdout:(1/144): ceph-18.0.0-4828.gb5891ed6.el8.x86_64. 15 kB/s | 6.4 kB 00:00 2023-07-10T23:57:01.970 INFO:teuthology.orchestra.run.smithi038.stdout:(4/144): ceph-mds-18.0.0-4828.gb5891ed6.el8.x86 2.0 MB/s | 2.3 MB 00:01 2023-07-10T23:57:02.244 INFO:teuthology.orchestra.run.smithi070.stdout:(6/144): ceph-mgr-18.0.0-4828.gb5891ed6.el8.x86 1.3 MB/s | 1.5 MB 00:01 2023-07-10T23:57:02.744 INFO:teuthology.orchestra.run.smithi131.stdout:(2/144): ceph-fuse-18.0.0-4828.gb5891ed6.el8.x8 917 kB/s | 848 kB 00:00 2023-07-10T23:57:02.753 INFO:teuthology.orchestra.run.smithi038.stdout:(5/144): ceph-mgr-18.0.0-4828.gb5891ed6.el8.x86 2.0 MB/s | 1.5 MB 00:00 2023-07-10T23:57:02.953 INFO:teuthology.orchestra.run.smithi131.stdout:(3/144): ceph-immutable-object-cache-18.0.0-482 793 kB/s | 165 kB 00:00 2023-07-10T23:57:03.662 INFO:teuthology.orchestra.run.smithi038.stdout:(6/144): ceph-base-18.0.0-4828.gb5891ed6.el8.x8 1.3 MB/s | 5.4 MB 00:04 2023-07-10T23:57:04.395 INFO:teuthology.orchestra.run.smithi131.stdout:(4/144): ceph-mds-18.0.0-4828.gb5891ed6.el8.x86 1.6 MB/s | 2.3 MB 00:01 2023-07-10T23:57:05.245 INFO:teuthology.orchestra.run.smithi131.stdout:(5/144): ceph-mgr-18.0.0-4828.gb5891ed6.el8.x86 1.8 MB/s | 1.5 MB 00:00 2023-07-10T23:57:05.320 INFO:teuthology.orchestra.run.smithi038.stdout:(7/144): ceph-mon-18.0.0-4828.gb5891ed6.el8.x86 1.8 MB/s | 4.6 MB 00:02 2023-07-10T23:57:05.727 INFO:teuthology.orchestra.run.smithi070.stdout:(7/144): ceph-mon-18.0.0-4828.gb5891ed6.el8.x86 1.0 MB/s | 4.6 MB 00:04 2023-07-10T23:57:07.303 INFO:teuthology.orchestra.run.smithi131.stdout:(6/144): ceph-mon-18.0.0-4828.gb5891ed6.el8.x86 2.2 MB/s | 4.6 MB 00:02 2023-07-10T23:57:08.945 INFO:teuthology.orchestra.run.smithi131.stdout:(7/144): ceph-base-18.0.0-4828.gb5891ed6.el8.x8 731 kB/s | 5.4 MB 00:07 2023-07-10T23:57:10.752 INFO:teuthology.orchestra.run.smithi070.stdout:(8/144): ceph-common-18.0.0-4828.gb5891ed6.el8. 1.6 MB/s | 22 MB 00:13 2023-07-10T23:57:10.852 INFO:teuthology.orchestra.run.smithi070.stdout:(9/144): ceph-selinux-18.0.0-4828.gb5891ed6.el8 244 kB/s | 24 kB 00:00 2023-07-10T23:57:12.984 INFO:teuthology.orchestra.run.smithi070.stdout:(10/144): ceph-osd-18.0.0-4828.gb5891ed6.el8.x8 1.7 MB/s | 18 MB 00:10 2023-07-10T23:57:13.244 INFO:teuthology.orchestra.run.smithi070.stdout:(11/144): cephfs-mirror-18.0.0-4828.gb5891ed6.e 996 kB/s | 258 kB 00:00 2023-07-10T23:57:13.352 INFO:teuthology.orchestra.run.smithi070.stdout:(12/144): libcephfs-devel-18.0.0-4828.gb5891ed6 286 kB/s | 31 kB 00:00 2023-07-10T23:57:13.869 INFO:teuthology.orchestra.run.smithi038.stdout:(8/144): ceph-radosgw-18.0.0-4828.gb5891ed6.el8 1.6 MB/s | 13 MB 00:08 2023-07-10T23:57:13.969 INFO:teuthology.orchestra.run.smithi038.stdout:(9/144): ceph-selinux-18.0.0-4828.gb5891ed6.el8 244 kB/s | 24 kB 00:00 2023-07-10T23:57:14.127 INFO:teuthology.orchestra.run.smithi070.stdout:(13/144): libcephfs2-18.0.0-4828.gb5891ed6.el8. 996 kB/s | 771 kB 00:00 2023-07-10T23:57:14.319 INFO:teuthology.orchestra.run.smithi070.stdout:(14/144): libcephsqlite-18.0.0-4828.gb5891ed6.e 718 kB/s | 137 kB 00:00 2023-07-10T23:57:14.511 INFO:teuthology.orchestra.run.smithi070.stdout:(15/144): librados-devel-18.0.0-4828.gb5891ed6. 726 kB/s | 139 kB 00:00 2023-07-10T23:57:14.995 INFO:teuthology.orchestra.run.smithi070.stdout:(16/144): libradosstriper1-18.0.0-4828.gb5891ed 979 kB/s | 473 kB 00:00 2023-07-10T23:57:17.653 INFO:teuthology.orchestra.run.smithi070.stdout:(17/144): ceph-radosgw-18.0.0-4828.gb5891ed6.el 1.1 MB/s | 13 MB 00:11 2023-07-10T23:57:17.753 INFO:teuthology.orchestra.run.smithi070.stdout:(18/144): python3-ceph-argparse-18.0.0-4828.gb5 449 kB/s | 45 kB 00:00 2023-07-10T23:57:17.786 INFO:teuthology.orchestra.run.smithi131.stdout:(8/144): ceph-osd-18.0.0-4828.gb5891ed6.el8.x86 1.7 MB/s | 18 MB 00:10 2023-07-10T23:57:17.862 INFO:teuthology.orchestra.run.smithi070.stdout:(19/144): python3-ceph-common-18.0.0-4828.gb589 1.1 MB/s | 122 kB 00:00 2023-07-10T23:57:17.911 INFO:teuthology.orchestra.run.smithi131.stdout:(9/144): ceph-selinux-18.0.0-4828.gb5891ed6.el8 195 kB/s | 24 kB 00:00 2023-07-10T23:57:18.070 INFO:teuthology.orchestra.run.smithi070.stdout:(20/144): python3-cephfs-18.0.0-4828.gb5891ed6. 945 kB/s | 197 kB 00:00 2023-07-10T23:57:18.379 INFO:teuthology.orchestra.run.smithi070.stdout:(21/144): python3-rados-18.0.0-4828.gb5891ed6.e 1.2 MB/s | 371 kB 00:00 2023-07-10T23:57:18.679 INFO:teuthology.orchestra.run.smithi070.stdout:(22/144): python3-rbd-18.0.0-4828.gb5891ed6.el8 1.2 MB/s | 364 kB 00:00 2023-07-10T23:57:18.788 INFO:teuthology.orchestra.run.smithi070.stdout:(23/144): python3-rgw-18.0.0-4828.gb5891ed6.el8 987 kB/s | 107 kB 00:00 2023-07-10T23:57:18.836 INFO:teuthology.orchestra.run.smithi038.stdout:(10/144): ceph-osd-18.0.0-4828.gb5891ed6.el8.x8 1.2 MB/s | 18 MB 00:15 2023-07-10T23:57:18.913 INFO:teuthology.orchestra.run.smithi070.stdout:(24/144): rbd-fuse-18.0.0-4828.gb5891ed6.el8.x8 755 kB/s | 94 kB 00:00 2023-07-10T23:57:19.228 INFO:teuthology.orchestra.run.smithi038.stdout:(11/144): cephfs-mirror-18.0.0-4828.gb5891ed6.e 659 kB/s | 258 kB 00:00 2023-07-10T23:57:19.445 INFO:teuthology.orchestra.run.smithi038.stdout:(12/144): libcephfs-devel-18.0.0-4828.gb5891ed6 143 kB/s | 31 kB 00:00 2023-07-10T23:57:19.971 INFO:teuthology.orchestra.run.smithi070.stdout:(25/144): librgw2-18.0.0-4828.gb5891ed6.el8.x86 1.4 MB/s | 6.7 MB 00:04 2023-07-10T23:57:20.120 INFO:teuthology.orchestra.run.smithi038.stdout:(13/144): libcephfs2-18.0.0-4828.gb5891ed6.el8. 1.1 MB/s | 771 kB 00:00 2023-07-10T23:57:20.138 INFO:teuthology.orchestra.run.smithi070.stdout:(26/144): rbd-nbd-18.0.0-4828.gb5891ed6.el8.x86 1.1 MB/s | 180 kB 00:00 2023-07-10T23:57:20.222 INFO:teuthology.orchestra.run.smithi070.stdout:(27/144): ceph-grafana-dashboards-18.0.0-4828.g 276 kB/s | 23 kB 00:00 2023-07-10T23:57:20.270 INFO:teuthology.orchestra.run.smithi131.stdout:(10/144): ceph-radosgw-18.0.0-4828.gb5891ed6.el 1.2 MB/s | 13 MB 00:11 2023-07-10T23:57:20.329 INFO:teuthology.orchestra.run.smithi038.stdout:(14/144): libcephsqlite-18.0.0-4828.gb5891ed6.e 660 kB/s | 137 kB 00:00 2023-07-10T23:57:20.398 INFO:teuthology.orchestra.run.smithi070.stdout:(28/144): ceph-mgr-cephadm-18.0.0-4828.gb5891ed 737 kB/s | 129 kB 00:00 2023-07-10T23:57:20.536 INFO:teuthology.orchestra.run.smithi131.stdout:(11/144): cephfs-mirror-18.0.0-4828.gb5891ed6.e 969 kB/s | 258 kB 00:00 2023-07-10T23:57:20.537 INFO:teuthology.orchestra.run.smithi038.stdout:(15/144): librados-devel-18.0.0-4828.gb5891ed6. 667 kB/s | 139 kB 00:00 2023-07-10T23:57:20.628 INFO:teuthology.orchestra.run.smithi131.stdout:(12/144): libcephfs-devel-18.0.0-4828.gb5891ed6 339 kB/s | 31 kB 00:00 2023-07-10T23:57:20.664 INFO:teuthology.orchestra.run.smithi070.stdout:(29/144): rbd-mirror-18.0.0-4828.gb5891ed6.el8. 2.0 MB/s | 3.4 MB 00:01 2023-07-10T23:57:20.996 INFO:teuthology.orchestra.run.smithi038.stdout:(16/144): libradosstriper1-18.0.0-4828.gb5891ed 1.0 MB/s | 473 kB 00:00 2023-07-10T23:57:21.170 INFO:teuthology.orchestra.run.smithi131.stdout:(13/144): libcephfs2-18.0.0-4828.gb5891ed6.el8. 1.4 MB/s | 771 kB 00:00 2023-07-10T23:57:21.337 INFO:teuthology.orchestra.run.smithi131.stdout:(14/144): libcephsqlite-18.0.0-4828.gb5891ed6.e 825 kB/s | 137 kB 00:00 2023-07-10T23:57:21.496 INFO:teuthology.orchestra.run.smithi131.stdout:(15/144): librados-devel-18.0.0-4828.gb5891ed6. 880 kB/s | 139 kB 00:00 2023-07-10T23:57:21.796 INFO:teuthology.orchestra.run.smithi131.stdout:(16/144): libradosstriper1-18.0.0-4828.gb5891ed 1.5 MB/s | 473 kB 00:00 2023-07-10T23:57:22.273 INFO:teuthology.orchestra.run.smithi070.stdout:(30/144): ceph-mgr-dashboard-18.0.0-4828.gb5891 934 kB/s | 1.7 MB 00:01 2023-07-10T23:57:22.604 INFO:teuthology.orchestra.run.smithi070.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4828.gb5 728 kB/s | 240 kB 00:00 2023-07-10T23:57:22.698 INFO:teuthology.orchestra.run.smithi070.stdout:(32/144): ceph-mgr-rook-18.0.0-4828.gb5891ed6.e 503 kB/s | 47 kB 00:00 2023-07-10T23:57:22.790 INFO:teuthology.orchestra.run.smithi070.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4828.gb 159 kB/s | 15 kB 00:00 2023-07-10T23:57:22.913 INFO:teuthology.orchestra.run.smithi038.stdout:(17/144): ceph-common-18.0.0-4828.gb5891ed6.el8 966 kB/s | 22 MB 00:23 2023-07-10T23:57:23.080 INFO:teuthology.orchestra.run.smithi038.stdout:(18/144): python3-ceph-argparse-18.0.0-4828.gb5 269 kB/s | 45 kB 00:00 2023-07-10T23:57:23.091 INFO:teuthology.orchestra.run.smithi070.stdout:(34/144): ceph-volume-18.0.0-4828.gb5891ed6.el8 861 kB/s | 258 kB 00:00 2023-07-10T23:57:23.272 INFO:teuthology.orchestra.run.smithi038.stdout:(19/144): python3-ceph-common-18.0.0-4828.gb589 638 kB/s | 122 kB 00:00 2023-07-10T23:57:23.332 INFO:teuthology.orchestra.run.smithi070.stdout:(35/144): cephadm-18.0.0-4828.gb5891ed6.el8.noa 679 kB/s | 164 kB 00:00 2023-07-10T23:57:23.425 INFO:teuthology.orchestra.run.smithi070.stdout:(36/144): cephfs-top-18.0.0-4828.gb5891ed6.el8. 196 kB/s | 18 kB 00:00 2023-07-10T23:57:23.506 INFO:teuthology.orchestra.run.smithi038.stdout:(20/144): python3-cephfs-18.0.0-4828.gb5891ed6. 842 kB/s | 197 kB 00:00 2023-07-10T23:57:23.598 INFO:teuthology.orchestra.run.smithi070.stdout:(37/144): automake-1.16.1-7.el8.noarch.rpm 4.0 MB/s | 713 kB 00:00 2023-07-10T23:57:23.692 INFO:teuthology.orchestra.run.smithi070.stdout:(38/144): ceph-mgr-diskprediction-local-18.0.0- 2.4 MB/s | 7.4 MB 00:03 2023-07-10T23:57:23.726 INFO:teuthology.orchestra.run.smithi070.stdout:(39/144): bison-3.0.4-10.el8.x86_64.rpm 5.3 MB/s | 688 kB 00:00 2023-07-10T23:57:23.768 INFO:teuthology.orchestra.run.smithi070.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-10T23:57:23.810 INFO:teuthology.orchestra.run.smithi070.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-07-10T23:57:23.852 INFO:teuthology.orchestra.run.smithi070.stdout:(42/144): flex-2.6.1-9.el8.x86_64.rpm 2.0 MB/s | 320 kB 00:00 2023-07-10T23:57:23.856 INFO:teuthology.orchestra.run.smithi038.stdout:(21/144): python3-rados-18.0.0-4828.gb5891ed6.e 1.0 MB/s | 371 kB 00:00 2023-07-10T23:57:23.885 INFO:teuthology.orchestra.run.smithi070.stdout:(43/144): librdkafka-0.11.4-3.el8.x86_64.rpm 4.6 MB/s | 354 kB 00:00 2023-07-10T23:57:23.952 INFO:teuthology.orchestra.run.smithi070.stdout:(44/144): libtool-2.4.6-25.el8.x86_64.rpm 6.9 MB/s | 709 kB 00:00 2023-07-10T23:57:23.977 INFO:teuthology.orchestra.run.smithi070.stdout:(45/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-07-10T23:57:24.003 INFO:teuthology.orchestra.run.smithi070.stdout:(46/144): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-07-10T23:57:24.136 INFO:teuthology.orchestra.run.smithi070.stdout:(47/144): openblas-0.3.15-4.el8.x86_64.rpm 30 MB/s | 4.7 MB 00:00 2023-07-10T23:57:24.198 INFO:teuthology.orchestra.run.smithi038.stdout:(22/144): python3-rbd-18.0.0-4828.gb5891ed6.el8 1.0 MB/s | 364 kB 00:00 2023-07-10T23:57:24.228 INFO:teuthology.orchestra.run.smithi070.stdout:(48/144): openblas-threads-0.3.15-4.el8.x86_64. 22 MB/s | 4.9 MB 00:00 2023-07-10T23:57:24.295 INFO:teuthology.orchestra.run.smithi070.stdout:(49/144): postgresql-10.23-1.module_el8+300+2c5 9.9 MB/s | 1.6 MB 00:00 2023-07-10T23:57:24.329 INFO:teuthology.orchestra.run.smithi070.stdout:(50/144): postgresql-contrib-10.23-1.module_el8 8.8 MB/s | 903 kB 00:00 2023-07-10T23:57:24.339 INFO:teuthology.orchestra.run.smithi038.stdout:(23/144): python3-rgw-18.0.0-4828.gb5891ed6.el8 754 kB/s | 107 kB 00:00 2023-07-10T23:57:24.479 INFO:teuthology.orchestra.run.smithi070.stdout:(51/144): postgresql-server-10.23-1.module_el8+ 28 MB/s | 5.1 MB 00:00 2023-07-10T23:57:24.490 INFO:teuthology.orchestra.run.smithi038.stdout:(24/144): rbd-fuse-18.0.0-4828.gb5891ed6.el8.x8 628 kB/s | 94 kB 00:00 2023-07-10T23:57:24.563 INFO:teuthology.orchestra.run.smithi070.stdout:(52/144): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-07-10T23:57:24.605 INFO:teuthology.orchestra.run.smithi131.stdout:(17/144): ceph-common-18.0.0-4828.gb5891ed6.el8 974 kB/s | 22 MB 00:23 2023-07-10T23:57:24.613 INFO:teuthology.orchestra.run.smithi070.stdout:(53/144): python3-jinja2-2.10.1-3.el8.noarch.rp 3.9 MB/s | 538 kB 00:00 2023-07-10T23:57:24.638 INFO:teuthology.orchestra.run.smithi070.stdout:(54/144): python3-jsonpatch-1.21-2.el8.noarch.r 353 kB/s | 27 kB 00:00 2023-07-10T23:57:24.664 INFO:teuthology.orchestra.run.smithi070.stdout:(55/144): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-07-10T23:57:24.688 INFO:teuthology.orchestra.run.smithi131.stdout:(18/144): python3-ceph-argparse-18.0.0-4828.gb5 540 kB/s | 45 kB 00:00 2023-07-10T23:57:24.698 INFO:teuthology.orchestra.run.smithi070.stdout:(56/144): python3-mako-1.0.6-14.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-07-10T23:57:24.723 INFO:teuthology.orchestra.run.smithi070.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 658 kB/s | 39 kB 00:00 2023-07-10T23:57:24.790 INFO:teuthology.orchestra.run.smithi070.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.3 MB/s | 225 kB 00:00 2023-07-10T23:57:24.832 INFO:teuthology.orchestra.run.smithi070.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-07-10T23:57:24.839 INFO:teuthology.orchestra.run.smithi131.stdout:(19/144): python3-ceph-common-18.0.0-4828.gb589 813 kB/s | 122 kB 00:00 2023-07-10T23:57:25.064 INFO:teuthology.orchestra.run.smithi131.stdout:(20/144): librgw2-18.0.0-4828.gb5891ed6.el8.x86 2.1 MB/s | 6.7 MB 00:03 2023-07-10T23:57:25.089 INFO:teuthology.orchestra.run.smithi131.stdout:(21/144): python3-cephfs-18.0.0-4828.gb5891ed6. 787 kB/s | 197 kB 00:00 2023-07-10T23:57:25.248 INFO:teuthology.orchestra.run.smithi131.stdout:(22/144): python3-rados-18.0.0-4828.gb5891ed6.e 2.0 MB/s | 371 kB 00:00 2023-07-10T23:57:25.348 INFO:teuthology.orchestra.run.smithi131.stdout:(23/144): python3-rgw-18.0.0-4828.gb5891ed6.el8 1.0 MB/s | 107 kB 00:00 2023-07-10T23:57:25.374 INFO:teuthology.orchestra.run.smithi131.stdout:(24/144): python3-rbd-18.0.0-4828.gb5891ed6.el8 1.3 MB/s | 364 kB 00:00 2023-07-10T23:57:25.424 INFO:teuthology.orchestra.run.smithi131.stdout:(25/144): rbd-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.2 MB/s | 94 kB 00:00 2023-07-10T23:57:25.432 INFO:teuthology.orchestra.run.smithi070.stdout:(60/144): ceph-test-18.0.0-4828.gb5891ed6.el8.x 3.3 MB/s | 48 MB 00:14 2023-07-10T23:57:25.549 INFO:teuthology.orchestra.run.smithi131.stdout:(26/144): rbd-nbd-18.0.0-4828.gb5891ed6.el8.x86 1.4 MB/s | 180 kB 00:00 2023-07-10T23:57:25.616 INFO:teuthology.orchestra.run.smithi131.stdout:(27/144): ceph-grafana-dashboards-18.0.0-4828.g 347 kB/s | 23 kB 00:00 2023-07-10T23:57:25.666 INFO:teuthology.orchestra.run.smithi070.stdout:(61/144): python3-numpy-1.14.3-10.el8.x86_64.rp 3.9 MB/s | 3.7 MB 00:00 2023-07-10T23:57:25.691 INFO:teuthology.orchestra.run.smithi131.stdout:(28/144): ceph-mgr-cephadm-18.0.0-4828.gb5891ed 1.7 MB/s | 129 kB 00:00 2023-07-10T23:57:25.712 INFO:teuthology.orchestra.run.smithi070.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 452 kB/s | 126 kB 00:00 2023-07-10T23:57:25.741 INFO:teuthology.orchestra.run.smithi070.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-07-10T23:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 1.0 MB/s | 54 kB 00:00 2023-07-10T23:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout:(65/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 108 kB/s | 103 kB 00:00 2023-07-10T23:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-07-10T23:57:25.917 INFO:teuthology.orchestra.run.smithi070.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2023-07-10T23:57:25.976 INFO:teuthology.orchestra.run.smithi070.stdout:(68/144): python3-werkzeug-0.12.2-4.el8.noarch. 2.1 MB/s | 457 kB 00:00 2023-07-10T23:57:25.982 INFO:teuthology.orchestra.run.smithi038.stdout:(25/144): librgw2-18.0.0-4828.gb5891ed6.el8.x86 1.4 MB/s | 6.7 MB 00:04 2023-07-10T23:57:26.002 INFO:teuthology.orchestra.run.smithi070.stdout:(69/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 844 kB/s | 71 kB 00:00 2023-07-10T23:57:26.166 INFO:teuthology.orchestra.run.smithi038.stdout:(26/144): rbd-nbd-18.0.0-4828.gb5891ed6.el8.x86 981 kB/s | 180 kB 00:00 2023-07-10T23:57:26.266 INFO:teuthology.orchestra.run.smithi038.stdout:(27/144): ceph-grafana-dashboards-18.0.0-4828.g 231 kB/s | 23 kB 00:00 2023-07-10T23:57:26.285 INFO:teuthology.orchestra.run.smithi070.stdout:(70/144): python3-scipy-1.0.0-21.module_el8.5.0 25 MB/s | 14 MB 00:00 2023-07-10T23:57:26.302 INFO:teuthology.orchestra.run.smithi070.stdout:(71/144): elfutils-libelf-devel-0.189-2.el8.x86 189 kB/s | 61 kB 00:00 2023-07-10T23:57:26.319 INFO:teuthology.orchestra.run.smithi070.stdout:(72/144): fuse-2.9.7-17.el8.x86_64.rpm 262 kB/s | 83 kB 00:00 2023-07-10T23:57:26.333 INFO:teuthology.orchestra.run.smithi131.stdout:(29/144): ceph-mgr-dashboard-18.0.0-4828.gb5891 2.7 MB/s | 1.7 MB 00:00 2023-07-10T23:57:26.366 INFO:teuthology.orchestra.run.smithi038.stdout:(28/144): ceph-mgr-cephadm-18.0.0-4828.gb5891ed 1.3 MB/s | 129 kB 00:00 2023-07-10T23:57:26.394 INFO:teuthology.orchestra.run.smithi070.stdout:(73/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 442 kB/s | 48 kB 00:00 2023-07-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi070.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 933 kB/s | 39 kB 00:00 2023-07-10T23:57:26.470 INFO:teuthology.orchestra.run.smithi070.stdout:(75/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 124 kB/s | 19 kB 00:00 2023-07-10T23:57:26.516 INFO:teuthology.orchestra.run.smithi038.stdout:(29/144): rbd-mirror-18.0.0-4828.gb5891ed6.el8. 1.7 MB/s | 3.4 MB 00:02 2023-07-10T23:57:26.595 INFO:teuthology.orchestra.run.smithi070.stdout:(76/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.9 MB/s | 561 kB 00:00 2023-07-10T23:57:26.654 INFO:teuthology.orchestra.run.smithi070.stdout:(77/144): libquadmath-8.5.0-20.el8.x86_64.rpm 939 kB/s | 172 kB 00:00 2023-07-10T23:57:26.670 INFO:teuthology.orchestra.run.smithi070.stdout:(78/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 625 kB/s | 47 kB 00:00 2023-07-10T23:57:26.738 INFO:teuthology.orchestra.run.smithi070.stdout:(79/144): libgfortran-8.5.0-20.el8.x86_64.rpm 2.1 MB/s | 645 kB 00:00 2023-07-10T23:57:26.763 INFO:teuthology.orchestra.run.smithi070.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 945 kB/s | 87 kB 00:00 2023-07-10T23:57:26.788 INFO:teuthology.orchestra.run.smithi070.stdout:(81/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.9 MB/s | 99 kB 00:00 2023-07-10T23:57:26.813 INFO:teuthology.orchestra.run.smithi070.stdout:(82/144): libselinux-devel-2.9-8.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2023-07-10T23:57:26.830 INFO:teuthology.orchestra.run.smithi070.stdout:(83/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 268 kB/s | 18 kB 00:00 2023-07-10T23:57:26.856 INFO:teuthology.orchestra.run.smithi070.stdout:(84/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 650 kB/s | 44 kB 00:00 2023-07-10T23:57:26.940 INFO:teuthology.orchestra.run.smithi070.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-07-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi070.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.9 MB/s | 220 kB 00:00 2023-07-10T23:57:27.098 INFO:teuthology.orchestra.run.smithi070.stdout:(87/144): pcre2-devel-10.32-3.el8.x86_64.rpm 2.2 MB/s | 605 kB 00:00 2023-07-10T23:57:27.157 INFO:teuthology.orchestra.run.smithi070.stdout:(88/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.4 MB/s | 249 kB 00:00 2023-07-10T23:57:27.199 INFO:teuthology.orchestra.run.smithi070.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-07-10T23:57:27.258 INFO:teuthology.orchestra.run.smithi131.stdout:(30/144): rbd-mirror-18.0.0-4828.gb5891ed6.el8. 1.8 MB/s | 3.4 MB 00:01 2023-07-10T23:57:27.266 INFO:teuthology.orchestra.run.smithi070.stdout:(90/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 7.0 MB/s | 3.2 MB 00:00 2023-07-10T23:57:27.291 INFO:teuthology.orchestra.run.smithi070.stdout:(91/144): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2023-07-10T23:57:27.325 INFO:teuthology.orchestra.run.smithi070.stdout:(92/144): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-07-10T23:57:27.358 INFO:teuthology.orchestra.run.smithi038.stdout:(30/144): ceph-mgr-dashboard-18.0.0-4828.gb5891 1.7 MB/s | 1.7 MB 00:00 2023-07-10T23:57:27.384 INFO:teuthology.orchestra.run.smithi070.stdout:(93/144): python3-cryptography-3.2.1-6.el8.x86_ 2.2 MB/s | 641 kB 00:00 2023-07-10T23:57:27.409 INFO:teuthology.orchestra.run.smithi070.stdout:(94/144): python3-requests-oauthlib-1.0.0-1.el8 363 kB/s | 43 kB 00:00 2023-07-10T23:57:27.410 INFO:teuthology.orchestra.run.smithi131.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4828.gb5 1.6 MB/s | 240 kB 00:00 2023-07-10T23:57:27.434 INFO:teuthology.orchestra.run.smithi070.stdout:(95/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 684 kB/s | 74 kB 00:00 2023-07-10T23:57:27.459 INFO:teuthology.orchestra.run.smithi070.stdout:(96/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 770 kB/s | 58 kB 00:00 2023-07-10T23:57:27.492 INFO:teuthology.orchestra.run.smithi131.stdout:(32/144): ceph-mgr-rook-18.0.0-4828.gb5891ed6.e 569 kB/s | 47 kB 00:00 2023-07-10T23:57:27.542 INFO:teuthology.orchestra.run.smithi038.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4828.gb5 1.3 MB/s | 240 kB 00:00 2023-07-10T23:57:27.543 INFO:teuthology.orchestra.run.smithi070.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 542 kB/s | 59 kB 00:00 2023-07-10T23:57:27.560 INFO:teuthology.orchestra.run.smithi131.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4828.gb 218 kB/s | 15 kB 00:00 2023-07-10T23:57:27.568 INFO:teuthology.orchestra.run.smithi070.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 759 kB/s | 75 kB 00:00 2023-07-10T23:57:27.594 INFO:teuthology.orchestra.run.smithi070.stdout:(99/144): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-07-10T23:57:27.619 INFO:teuthology.orchestra.run.smithi070.stdout:(100/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 870 kB/s | 44 kB 00:00 2023-07-10T23:57:27.642 INFO:teuthology.orchestra.run.smithi038.stdout:(32/144): ceph-mgr-rook-18.0.0-4828.gb5891ed6.e 475 kB/s | 47 kB 00:00 2023-07-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi070.stdout:(101/144): python3-asyncssh-2.7.0-2.el8.noarch. 4.3 MB/s | 476 kB 00:00 2023-07-10T23:57:27.701 INFO:teuthology.orchestra.run.smithi070.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 402 kB/s | 33 kB 00:00 2023-07-10T23:57:27.728 INFO:teuthology.orchestra.run.smithi070.stdout:(103/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.3 MB/s | 185 kB 00:00 2023-07-10T23:57:27.742 INFO:teuthology.orchestra.run.smithi038.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4828.gb 145 kB/s | 15 kB 00:00 2023-07-10T23:57:27.753 INFO:teuthology.orchestra.run.smithi070.stdout:(104/144): python3-certifi-2018.10.15-7.el8.noa 162 kB/s | 16 kB 00:00 2023-07-10T23:57:27.768 INFO:teuthology.orchestra.run.smithi131.stdout:(34/144): ceph-volume-18.0.0-4828.gb5891ed6.el8 1.2 MB/s | 258 kB 00:00 2023-07-10T23:57:27.779 INFO:teuthology.orchestra.run.smithi070.stdout:(105/144): python3-cheroot-8.5.2-1.el8.noarch.r 2.2 MB/s | 173 kB 00:00 2023-07-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi070.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2023-07-10T23:57:27.821 INFO:teuthology.orchestra.run.smithi070.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 265 kB/s | 11 kB 00:00 2023-07-10T23:57:27.838 INFO:teuthology.orchestra.run.smithi070.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 523 kB/s | 18 kB 00:00 2023-07-10T23:57:27.863 INFO:teuthology.orchestra.run.smithi070.stdout:(109/144): python3-cherrypy-18.4.0-1.el8.noarch 2.8 MB/s | 384 kB 00:00 2023-07-10T23:57:27.880 INFO:teuthology.orchestra.run.smithi070.stdout:(110/144): python3-logutils-0.3.5-11.el8.noarch 1.1 MB/s | 49 kB 00:00 2023-07-10T23:57:27.897 INFO:teuthology.orchestra.run.smithi070.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 1.7 MB/s | 59 kB 00:00 2023-07-10T23:57:27.918 INFO:teuthology.orchestra.run.smithi038.stdout:(34/144): ceph-volume-18.0.0-4828.gb5891ed6.el8 1.4 MB/s | 258 kB 00:00 2023-07-10T23:57:27.918 INFO:teuthology.orchestra.run.smithi131.stdout:(35/144): cephadm-18.0.0-4828.gb5891ed6.el8.noa 1.1 MB/s | 164 kB 00:00 2023-07-10T23:57:27.923 INFO:teuthology.orchestra.run.smithi070.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 1.4 MB/s | 60 kB 00:00 2023-07-10T23:57:27.948 INFO:teuthology.orchestra.run.smithi070.stdout:(113/144): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-07-10T23:57:27.965 INFO:teuthology.orchestra.run.smithi070.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 374 kB/s | 16 kB 00:00 2023-07-10T23:57:27.982 INFO:teuthology.orchestra.run.smithi070.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 1.0 MB/s | 34 kB 00:00 2023-07-10T23:57:28.002 INFO:teuthology.orchestra.run.smithi131.stdout:(36/144): cephfs-top-18.0.0-4828.gb5891ed6.el8. 216 kB/s | 18 kB 00:00 2023-07-10T23:57:28.038 INFO:teuthology.orchestra.run.smithi070.stdout:(116/144): python3-kubernetes-11.0.0-6.el8.noar 5.4 MB/s | 1.2 MB 00:00 2023-07-10T23:57:28.066 INFO:teuthology.orchestra.run.smithi070.stdout:(117/144): python3-routes-2.4.1-12.el8.noarch.r 1.9 MB/s | 196 kB 00:00 2023-07-10T23:57:28.083 INFO:teuthology.orchestra.run.smithi070.stdout:(118/144): python3-rsa-4.8-1.el8.noarch.rpm 612 kB/s | 61 kB 00:00 2023-07-10T23:57:28.084 INFO:teuthology.orchestra.run.smithi038.stdout:(35/144): cephadm-18.0.0-4828.gb5891ed6.el8.noa 986 kB/s | 164 kB 00:00 2023-07-10T23:57:28.100 INFO:teuthology.orchestra.run.smithi070.stdout:(119/144): python3-simplegeneric-0.8.1-17.el8.n 306 kB/s | 19 kB 00:00 2023-07-10T23:57:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:(120/144): python3-singledispatch-3.4.0.3-18.el 474 kB/s | 24 kB 00:00 2023-07-10T23:57:28.133 INFO:teuthology.orchestra.run.smithi070.stdout:(121/144): python3-tempora-1.14.1-5.el8.noarch. 578 kB/s | 29 kB 00:00 2023-07-10T23:57:28.151 INFO:teuthology.orchestra.run.smithi070.stdout:(122/144): python3-trustme-0.6.0-4.el8.noarch.r 546 kB/s | 27 kB 00:00 2023-07-10T23:57:28.152 INFO:teuthology.orchestra.run.smithi131.stdout:(37/144): automake-1.16.1-7.el8.noarch.rpm 4.7 MB/s | 713 kB 00:00 2023-07-10T23:57:28.176 INFO:teuthology.orchestra.run.smithi070.stdout:(123/144): python3-waitress-1.4.3-1.el8.noarch. 4.2 MB/s | 255 kB 00:00 2023-07-10T23:57:28.201 INFO:teuthology.orchestra.run.smithi070.stdout:(124/144): python3-websocket-client-0.56.0-5.el 1.2 MB/s | 61 kB 00:00 2023-07-10T23:57:28.203 INFO:teuthology.orchestra.run.smithi131.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 14 MB/s | 688 kB 00:00 2023-07-10T23:57:28.210 INFO:teuthology.orchestra.run.smithi038.stdout:(36/144): cephfs-top-18.0.0-4828.gb5891ed6.el8. 144 kB/s | 18 kB 00:00 2023-07-10T23:57:28.227 INFO:teuthology.orchestra.run.smithi070.stdout:(125/144): python3-webob-1.8.5-1.el8.1.noarch.r 2.7 MB/s | 251 kB 00:00 2023-07-10T23:57:28.245 INFO:teuthology.orchestra.run.smithi131.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-10T23:57:28.252 INFO:teuthology.orchestra.run.smithi070.stdout:(126/144): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2023-07-10T23:57:28.268 INFO:teuthology.orchestra.run.smithi070.stdout:(127/144): python3-zc-lockfile-2.0-2.el8.noarch 343 kB/s | 23 kB 00:00 2023-07-10T23:57:28.287 INFO:teuthology.orchestra.run.smithi131.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-10T23:57:28.329 INFO:teuthology.orchestra.run.smithi131.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-07-10T23:57:28.352 INFO:teuthology.orchestra.run.smithi038.stdout:(37/144): automake-1.16.1-7.el8.noarch.rpm 4.9 MB/s | 713 kB 00:00 2023-07-10T23:57:28.370 INFO:teuthology.orchestra.run.smithi131.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-07-10T23:57:28.402 INFO:teuthology.orchestra.run.smithi038.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-07-10T23:57:28.421 INFO:teuthology.orchestra.run.smithi131.stdout:(43/144): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-07-10T23:57:28.427 INFO:teuthology.orchestra.run.smithi070.stdout:(128/144): thrift-0.13.0-2.el8.x86_64.rpm 8.7 MB/s | 1.7 MB 00:00 2023-07-10T23:57:28.444 INFO:teuthology.orchestra.run.smithi038.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-10T23:57:28.471 INFO:teuthology.orchestra.run.smithi131.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-07-10T23:57:28.487 INFO:teuthology.orchestra.run.smithi038.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-10T23:57:28.513 INFO:teuthology.orchestra.run.smithi131.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-07-10T23:57:28.528 INFO:teuthology.orchestra.run.smithi038.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-07-10T23:57:28.570 INFO:teuthology.orchestra.run.smithi038.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-07-10T23:57:28.620 INFO:teuthology.orchestra.run.smithi038.stdout:(43/144): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-07-10T23:57:28.662 INFO:teuthology.orchestra.run.smithi038.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-07-10T23:57:28.672 INFO:teuthology.orchestra.run.smithi131.stdout:(46/144): openblas-0.3.15-4.el8.x86_64.rpm 30 MB/s | 4.7 MB 00:00 2023-07-10T23:57:28.729 INFO:teuthology.orchestra.run.smithi038.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2023-07-10T23:57:28.736 INFO:teuthology.orchestra.run.smithi070.stdout:(129/144): NetworkManager-initscripts-updown-1. 465 kB/s | 143 kB 00:00 2023-07-10T23:57:28.831 INFO:teuthology.orchestra.run.smithi131.stdout:(47/144): ceph-mgr-diskprediction-local-18.0.0- 3.0 MB/s | 7.4 MB 00:02 2023-07-10T23:57:28.844 INFO:teuthology.orchestra.run.smithi070.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 702 kB/s | 76 kB 00:00 2023-07-10T23:57:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:(46/144): openblas-0.3.15-4.el8.x86_64.rpm 33 MB/s | 4.7 MB 00:00 2023-07-10T23:57:28.931 INFO:teuthology.orchestra.run.smithi131.stdout:(48/144): openblas-threads-0.3.15-4.el8.x86_64. 19 MB/s | 4.9 MB 00:00 2023-07-10T23:57:28.982 INFO:teuthology.orchestra.run.smithi131.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 18 MB/s | 903 kB 00:00 2023-07-10T23:57:29.022 INFO:teuthology.orchestra.run.smithi038.stdout:(47/144): openblas-threads-0.3.15-4.el8.x86_64. 32 MB/s | 4.9 MB 00:00 2023-07-10T23:57:29.053 INFO:teuthology.orchestra.run.smithi070.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.1 MB/s | 232 kB 00:00 2023-07-10T23:57:29.122 INFO:teuthology.orchestra.run.smithi038.stdout:(48/144): postgresql-10.23-1.module_el8+300+2c5 16 MB/s | 1.6 MB 00:00 2023-07-10T23:57:29.140 INFO:teuthology.orchestra.run.smithi131.stdout:(50/144): postgresql-server-10.23-1.module_el8+ 32 MB/s | 5.1 MB 00:00 2023-07-10T23:57:29.182 INFO:teuthology.orchestra.run.smithi131.stdout:(51/144): postgresql-10.23-1.module_el8+300+2c5 4.5 MB/s | 1.6 MB 00:00 2023-07-10T23:57:29.195 INFO:teuthology.orchestra.run.smithi070.stdout:(132/144): elfutils-libs-0.189-2.el8.x86_64.rpm 2.1 MB/s | 302 kB 00:00 2023-07-10T23:57:29.240 INFO:teuthology.orchestra.run.smithi131.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 9.0 MB/s | 538 kB 00:00 2023-07-10T23:57:29.312 INFO:teuthology.orchestra.run.smithi038.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 4.7 MB/s | 903 kB 00:00 2023-07-10T23:57:29.333 INFO:teuthology.orchestra.run.smithi131.stdout:(53/144): python3-babel-2.5.1-7.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2023-07-10T23:57:29.358 INFO:teuthology.orchestra.run.smithi131.stdout:(54/144): python3-jsonpatch-1.21-2.el8.noarch.r 227 kB/s | 27 kB 00:00 2023-07-10T23:57:29.375 INFO:teuthology.orchestra.run.smithi131.stdout:(55/144): python3-jsonpointer-1.10-11.el8.noarc 477 kB/s | 20 kB 00:00 2023-07-10T23:57:29.400 INFO:teuthology.orchestra.run.smithi131.stdout:(56/144): python3-mako-1.0.6-14.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-07-10T23:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 4.0 MB/s | 880 kB 00:00 2023-07-10T23:57:29.417 INFO:teuthology.orchestra.run.smithi131.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 932 kB/s | 39 kB 00:00 2023-07-10T23:57:29.456 INFO:teuthology.orchestra.run.smithi038.stdout:(50/144): postgresql-server-10.23-1.module_el8+ 36 MB/s | 5.1 MB 00:00 2023-07-10T23:57:29.467 INFO:teuthology.orchestra.run.smithi131.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2023-07-10T23:57:29.470 INFO:teuthology.orchestra.run.smithi070.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-07-10T23:57:29.501 INFO:teuthology.orchestra.run.smithi131.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-07-10T23:57:29.529 INFO:teuthology.orchestra.run.smithi070.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2023-07-10T23:57:29.552 INFO:teuthology.orchestra.run.smithi131.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-07-10T23:57:29.588 INFO:teuthology.orchestra.run.smithi070.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 4.0 MB/s | 236 kB 00:00 2023-07-10T23:57:29.593 INFO:teuthology.orchestra.run.smithi131.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2023-07-10T23:57:29.598 INFO:teuthology.orchestra.run.smithi038.stdout:(51/144): python3-babel-2.5.1-7.el8.noarch.rpm 34 MB/s | 4.8 MB 00:00 2023-07-10T23:57:29.646 INFO:teuthology.orchestra.run.smithi070.stdout:(137/144): libsmartcols-2.32.1-42.el8.x86_64.rp 3.0 MB/s | 179 kB 00:00 2023-07-10T23:57:29.656 INFO:teuthology.orchestra.run.smithi038.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 9.1 MB/s | 538 kB 00:00 2023-07-10T23:57:29.660 INFO:teuthology.orchestra.run.smithi131.stdout:(62/144): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-07-10T23:57:29.686 INFO:teuthology.orchestra.run.smithi131.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 1.2 MB/s | 110 kB 00:00 2023-07-10T23:57:29.705 INFO:teuthology.orchestra.run.smithi070.stdout:(138/144): libuuid-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 98 kB 00:00 2023-07-10T23:57:29.711 INFO:teuthology.orchestra.run.smithi131.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-07-10T23:57:29.715 INFO:teuthology.orchestra.run.smithi038.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 455 kB/s | 27 kB 00:00 2023-07-10T23:57:29.757 INFO:teuthology.orchestra.run.smithi038.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 479 kB/s | 20 kB 00:00 2023-07-10T23:57:29.761 INFO:teuthology.orchestra.run.smithi131.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-07-10T23:57:29.799 INFO:teuthology.orchestra.run.smithi038.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-07-10T23:57:29.820 INFO:teuthology.orchestra.run.smithi131.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-07-10T23:57:29.833 INFO:teuthology.orchestra.run.smithi038.stdout:(56/144): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-07-10T23:57:29.870 INFO:teuthology.orchestra.run.smithi131.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2023-07-10T23:57:29.880 INFO:teuthology.orchestra.run.smithi070.stdout:(139/144): librados2-18.0.0-4828.gb5891ed6.el8. 2.3 MB/s | 3.7 MB 00:01 2023-07-10T23:57:29.966 INFO:teuthology.orchestra.run.smithi038.stdout:(57/144): python3-numpy-1.14.3-10.el8.x86_64.rp 28 MB/s | 3.7 MB 00:00 2023-07-10T23:57:30.008 INFO:teuthology.orchestra.run.smithi038.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-07-10T23:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout:(140/144): util-linux-2.32.1-42.el8.x86_64.rpm 7.8 MB/s | 2.6 MB 00:00 2023-07-10T23:57:30.050 INFO:teuthology.orchestra.run.smithi038.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-07-10T23:57:30.064 INFO:teuthology.orchestra.run.smithi070.stdout:(141/144): util-linux-user-2.32.1-42.el8.x86_64 556 kB/s | 102 kB 00:00 2023-07-10T23:57:30.084 INFO:teuthology.orchestra.run.smithi038.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 3.0 MB/s | 103 kB 00:00 2023-07-10T23:57:30.118 INFO:teuthology.orchestra.run.smithi038.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.7 MB/s | 126 kB 00:00 2023-07-10T23:57:30.140 INFO:teuthology.orchestra.run.smithi070.stdout:(142/144): xfsdump-3.1.8-6.el8.x86_64.rpm 3.3 MB/s | 334 kB 00:00 2023-07-10T23:57:30.160 INFO:teuthology.orchestra.run.smithi038.stdout:(62/144): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-07-10T23:57:30.162 INFO:teuthology.orchestra.run.smithi131.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 242 kB/s | 71 kB 00:00 2023-07-10T23:57:30.218 INFO:teuthology.orchestra.run.smithi038.stdout:(63/144): python3-pytz-2017.2-9.el8.noarch.rpm 928 kB/s | 54 kB 00:00 2023-07-10T23:57:30.338 INFO:teuthology.orchestra.run.smithi131.stdout:(69/144): python3-scipy-1.0.0-21.module_el8.5.0 21 MB/s | 14 MB 00:00 2023-07-10T23:57:30.363 INFO:teuthology.orchestra.run.smithi131.stdout:(70/144): elfutils-libelf-devel-0.189-2.el8.x86 307 kB/s | 61 kB 00:00 2023-07-10T23:57:30.415 INFO:teuthology.orchestra.run.smithi070.stdout:(143/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.1 MB/s | 1.1 MB 00:00 2023-07-10T23:57:30.447 INFO:teuthology.orchestra.run.smithi131.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 577 kB/s | 48 kB 00:00 2023-07-10T23:57:30.502 INFO:teuthology.orchestra.run.smithi038.stdout:(64/144): python3-scipy-1.0.0-21.module_el8.5.0 48 MB/s | 14 MB 00:00 2023-07-10T23:57:30.539 INFO:teuthology.orchestra.run.smithi131.stdout:(72/144): fuse-2.9.7-17.el8.x86_64.rpm 414 kB/s | 83 kB 00:00 2023-07-10T23:57:30.561 INFO:teuthology.orchestra.run.smithi038.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-07-10T23:57:30.597 INFO:teuthology.orchestra.run.smithi131.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 320 kB/s | 19 kB 00:00 2023-07-10T23:57:30.602 INFO:teuthology.orchestra.run.smithi038.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-07-10T23:57:30.644 INFO:teuthology.orchestra.run.smithi038.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-07-10T23:57:30.681 INFO:teuthology.orchestra.run.smithi131.stdout:(74/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.3 MB/s | 561 kB 00:00 2023-07-10T23:57:30.706 INFO:teuthology.orchestra.run.smithi131.stdout:(75/144): libcom_err-devel-1.45.6-5.el8.x86_64. 357 kB/s | 39 kB 00:00 2023-07-10T23:57:30.711 INFO:teuthology.orchestra.run.smithi038.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2023-07-10T23:57:30.820 INFO:teuthology.orchestra.run.smithi038.stdout:(69/144): ceph-mgr-diskprediction-local-18.0.0- 1.7 MB/s | 7.4 MB 00:04 2023-07-10T23:57:30.848 INFO:teuthology.orchestra.run.smithi131.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 172 kB 00:00 2023-07-10T23:57:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:(77/144): libgfortran-8.5.0-20.el8.x86_64.rpm 2.8 MB/s | 645 kB 00:00 2023-07-10T23:57:30.932 INFO:teuthology.orchestra.run.smithi131.stdout:(78/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 561 kB/s | 47 kB 00:00 2023-07-10T23:57:30.937 INFO:teuthology.orchestra.run.smithi038.stdout:(70/144): elfutils-libelf-devel-0.189-2.el8.x86 273 kB/s | 61 kB 00:00 2023-07-10T23:57:30.991 INFO:teuthology.orchestra.run.smithi131.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 2.3 MB/s | 200 kB 00:00 2023-07-10T23:57:30.995 INFO:teuthology.orchestra.run.smithi038.stdout:(71/144): fuse-2.9.7-17.el8.x86_64.rpm 474 kB/s | 83 kB 00:00 2023-07-10T23:57:31.017 INFO:teuthology.orchestra.run.smithi131.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2023-07-10T23:57:31.020 INFO:teuthology.orchestra.run.smithi038.stdout:(72/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 576 kB/s | 48 kB 00:00 2023-07-10T23:57:31.042 INFO:teuthology.orchestra.run.smithi131.stdout:(81/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.9 MB/s | 99 kB 00:00 2023-07-10T23:57:31.075 INFO:teuthology.orchestra.run.smithi131.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 307 kB/s | 18 kB 00:00 2023-07-10T23:57:31.079 INFO:teuthology.orchestra.run.smithi038.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 319 kB/s | 19 kB 00:00 2023-07-10T23:57:31.101 INFO:teuthology.orchestra.run.smithi131.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 748 kB/s | 44 kB 00:00 2023-07-10T23:57:31.138 INFO:teuthology.orchestra.run.smithi038.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 665 kB/s | 39 kB 00:00 2023-07-10T23:57:31.230 INFO:teuthology.orchestra.run.smithi038.stdout:(75/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.3 MB/s | 561 kB 00:00 2023-07-10T23:57:31.257 INFO:teuthology.orchestra.run.smithi070.stdout:(144/144): librbd1-18.0.0-4828.gb5891ed6.el8.x8 1.2 MB/s | 3.6 MB 00:02 2023-07-10T23:57:31.259 INFO:teuthology.orchestra.run.smithi131.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-07-10T23:57:31.262 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2023-07-10T23:57:31.262 INFO:teuthology.orchestra.run.smithi070.stdout:Total 6.2 MB/s | 212 MB 00:34 2023-07-10T23:57:31.322 INFO:teuthology.orchestra.run.smithi038.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.8 MB/s | 172 kB 00:00 2023-07-10T23:57:31.343 INFO:teuthology.orchestra.run.smithi131.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-07-10T23:57:31.372 INFO:teuthology.orchestra.run.smithi038.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 943 kB/s | 47 kB 00:00 2023-07-10T23:57:31.401 INFO:teuthology.orchestra.run.smithi131.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-07-10T23:57:31.473 INFO:teuthology.orchestra.run.smithi038.stdout:(78/144): libgfortran-8.5.0-20.el8.x86_64.rpm 1.9 MB/s | 645 kB 00:00 2023-07-10T23:57:31.485 INFO:teuthology.orchestra.run.smithi131.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.9 MB/s | 249 kB 00:00 2023-07-10T23:57:31.498 INFO:teuthology.orchestra.run.smithi038.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2023-07-10T23:57:31.532 INFO:teuthology.orchestra.run.smithi038.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-07-10T23:57:31.557 INFO:teuthology.orchestra.run.smithi038.stdout:(81/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.7 MB/s | 99 kB 00:00 2023-07-10T23:57:31.582 INFO:teuthology.orchestra.run.smithi038.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 358 kB/s | 18 kB 00:00 2023-07-10T23:57:31.607 INFO:teuthology.orchestra.run.smithi038.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 872 kB/s | 44 kB 00:00 2023-07-10T23:57:31.611 INFO:teuthology.orchestra.run.smithi131.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 5.0 MB/s | 641 kB 00:00 2023-07-10T23:57:31.669 INFO:teuthology.orchestra.run.smithi131.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 734 kB/s | 43 kB 00:00 2023-07-10T23:57:31.728 INFO:teuthology.orchestra.run.smithi131.stdout:(90/144): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-07-10T23:57:31.733 INFO:teuthology.orchestra.run.smithi038.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-07-10T23:57:31.787 INFO:teuthology.orchestra.run.smithi131.stdout:(91/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 4.5 MB/s | 3.2 MB 00:00 2023-07-10T23:57:31.792 INFO:teuthology.orchestra.run.smithi038.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-07-10T23:57:31.812 INFO:teuthology.orchestra.run.smithi131.stdout:(92/144): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2023-07-10T23:57:31.845 INFO:teuthology.orchestra.run.smithi131.stdout:(93/144): python3-requests-oauthlib-1.0.0-1.el8 728 kB/s | 43 kB 00:00 2023-07-10T23:57:31.850 INFO:teuthology.orchestra.run.smithi038.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-07-10T23:57:31.871 INFO:teuthology.orchestra.run.smithi131.stdout:(94/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.2 MB/s | 74 kB 00:00 2023-07-10T23:57:31.904 INFO:teuthology.orchestra.run.smithi131.stdout:(95/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 994 kB/s | 58 kB 00:00 2023-07-10T23:57:31.908 INFO:teuthology.orchestra.run.smithi038.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.2 MB/s | 249 kB 00:00 2023-07-10T23:57:32.034 INFO:teuthology.orchestra.run.smithi038.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 5.0 MB/s | 641 kB 00:00 2023-07-10T23:57:32.071 INFO:teuthology.orchestra.run.smithi131.stdout:(96/144): liboath-2.6.2-3.el8.x86_64.rpm 353 kB/s | 59 kB 00:00 2023-07-10T23:57:32.084 INFO:teuthology.orchestra.run.smithi038.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 853 kB/s | 43 kB 00:00 2023-07-10T23:57:32.139 INFO:teuthology.orchestra.run.smithi131.stdout:(97/144): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-07-10T23:57:32.143 INFO:teuthology.orchestra.run.smithi038.stdout:(90/144): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-07-10T23:57:32.164 INFO:teuthology.orchestra.run.smithi131.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 818 kB/s | 75 kB 00:00 2023-07-10T23:57:32.194 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2023-07-10T23:57:32.210 INFO:teuthology.orchestra.run.smithi038.stdout:(91/144): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-07-10T23:57:32.231 INFO:teuthology.orchestra.run.smithi131.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 653 kB/s | 44 kB 00:00 2023-07-10T23:57:32.256 INFO:teuthology.orchestra.run.smithi131.stdout:(100/144): python3-asyncssh-2.7.0-2.el8.noarch. 4.0 MB/s | 476 kB 00:00 2023-07-10T23:57:32.268 INFO:teuthology.orchestra.run.smithi038.stdout:(92/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 4.6 MB/s | 3.2 MB 00:00 2023-07-10T23:57:32.285 INFO:teuthology.orchestra.run.smithi038.stdout:(93/144): python3-requests-oauthlib-1.0.0-1.el8 566 kB/s | 43 kB 00:00 2023-07-10T23:57:32.306 INFO:teuthology.orchestra.run.smithi131.stdout:(101/144): python3-cachetools-3.1.1-4.el8.noarc 662 kB/s | 33 kB 00:00 2023-07-10T23:57:32.319 INFO:teuthology.orchestra.run.smithi038.stdout:(94/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.5 MB/s | 74 kB 00:00 2023-07-10T23:57:32.336 INFO:teuthology.orchestra.run.smithi038.stdout:(95/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-07-10T23:57:32.340 INFO:teuthology.orchestra.run.smithi131.stdout:(102/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.7 MB/s | 185 kB 00:00 2023-07-10T23:57:32.365 INFO:teuthology.orchestra.run.smithi131.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 277 kB/s | 16 kB 00:00 2023-07-10T23:57:32.424 INFO:teuthology.orchestra.run.smithi131.stdout:(104/144): python3-cheroot-8.5.2-1.el8.noarch.r 2.0 MB/s | 173 kB 00:00 2023-07-10T23:57:32.458 INFO:teuthology.orchestra.run.smithi131.stdout:(105/144): python3-cherrypy-18.4.0-1.el8.noarch 4.1 MB/s | 384 kB 00:00 2023-07-10T23:57:32.491 INFO:teuthology.orchestra.run.smithi131.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 1.2 MB/s | 81 kB 00:00 2023-07-10T23:57:32.508 INFO:teuthology.orchestra.run.smithi131.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-07-10T23:57:32.542 INFO:teuthology.orchestra.run.smithi131.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 350 kB/s | 18 kB 00:00 2023-07-10T23:57:32.558 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2023-07-10T23:57:32.558 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2023-07-10T23:57:32.586 INFO:teuthology.orchestra.run.smithi038.stdout:(96/144): liboath-2.6.2-3.el8.x86_64.rpm 235 kB/s | 59 kB 00:00 2023-07-10T23:57:32.592 INFO:teuthology.orchestra.run.smithi131.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 975 kB/s | 49 kB 00:00 2023-07-10T23:57:32.642 INFO:teuthology.orchestra.run.smithi131.stdout:(110/144): python3-more-itertools-7.2.0-3.el8.n 1.2 MB/s | 59 kB 00:00 2023-07-10T23:57:32.676 INFO:teuthology.orchestra.run.smithi131.stdout:(111/144): python3-kubernetes-11.0.0-6.el8.noar 7.0 MB/s | 1.2 MB 00:00 2023-07-10T23:57:32.702 INFO:teuthology.orchestra.run.smithi131.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 1.0 MB/s | 60 kB 00:00 2023-07-10T23:57:32.728 INFO:teuthology.orchestra.run.smithi038.stdout:(97/144): libunwind-1.3.1-3.el8.x86_64.rpm 529 kB/s | 75 kB 00:00 2023-07-10T23:57:32.735 INFO:teuthology.orchestra.run.smithi131.stdout:(113/144): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-07-10T23:57:32.760 INFO:teuthology.orchestra.run.smithi131.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2023-07-10T23:57:32.794 INFO:teuthology.orchestra.run.smithi131.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 577 kB/s | 34 kB 00:00 2023-07-10T23:57:32.819 INFO:teuthology.orchestra.run.smithi131.stdout:(116/144): python3-routes-2.4.1-12.el8.noarch.r 3.3 MB/s | 196 kB 00:00 2023-07-10T23:57:32.837 INFO:teuthology.orchestra.run.smithi038.stdout:(98/144): gperftools-libs-2.7-9.el8.x86_64.rpm 592 kB/s | 306 kB 00:00 2023-07-10T23:57:32.870 INFO:teuthology.orchestra.run.smithi131.stdout:(117/144): python3-rsa-4.8-1.el8.noarch.rpm 818 kB/s | 61 kB 00:00 2023-07-10T23:57:32.895 INFO:teuthology.orchestra.run.smithi131.stdout:(118/144): python3-simplegeneric-0.8.1-17.el8.n 249 kB/s | 19 kB 00:00 2023-07-10T23:57:32.904 INFO:teuthology.orchestra.run.smithi038.stdout:(99/144): python3-asyncssh-2.7.0-2.el8.noarch.r 2.7 MB/s | 476 kB 00:00 2023-07-10T23:57:32.929 INFO:teuthology.orchestra.run.smithi131.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 410 kB/s | 24 kB 00:00 2023-07-10T23:57:32.929 INFO:teuthology.orchestra.run.smithi038.stdout:(100/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 474 kB/s | 44 kB 00:00 2023-07-10T23:57:32.954 INFO:teuthology.orchestra.run.smithi131.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 500 kB/s | 29 kB 00:00 2023-07-10T23:57:32.979 INFO:teuthology.orchestra.run.smithi038.stdout:(101/144): python3-beautifulsoup4-4.6.3-2.el8.1 2.4 MB/s | 185 kB 00:00 2023-07-10T23:57:32.987 INFO:teuthology.orchestra.run.smithi131.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 472 kB/s | 27 kB 00:00 2023-07-10T23:57:33.013 INFO:teuthology.orchestra.run.smithi131.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 4.3 MB/s | 255 kB 00:00 2023-07-10T23:57:33.038 INFO:teuthology.orchestra.run.smithi038.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 303 kB/s | 33 kB 00:00 2023-07-10T23:57:33.055 INFO:teuthology.orchestra.run.smithi131.stdout:(123/144): python3-webob-1.8.5-1.el8.1.noarch.r 3.7 MB/s | 251 kB 00:00 2023-07-10T23:57:33.072 INFO:teuthology.orchestra.run.smithi038.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 177 kB/s | 16 kB 00:00 2023-07-10T23:57:33.081 INFO:teuthology.orchestra.run.smithi131.stdout:(124/144): python3-websocket-client-0.56.0-5.el 909 kB/s | 61 kB 00:00 2023-07-10T23:57:33.114 INFO:teuthology.orchestra.run.smithi038.stdout:(104/144): python3-cheroot-8.5.2-1.el8.noarch.r 2.2 MB/s | 173 kB 00:00 2023-07-10T23:57:33.114 INFO:teuthology.orchestra.run.smithi131.stdout:(125/144): python3-webtest-2.0.33-1.el8.noarch. 1.4 MB/s | 85 kB 00:00 2023-07-10T23:57:33.139 INFO:teuthology.orchestra.run.smithi131.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 393 kB/s | 23 kB 00:00 2023-07-10T23:57:33.181 INFO:teuthology.orchestra.run.smithi038.stdout:(105/144): python3-cherrypy-18.4.0-1.el8.noarch 3.4 MB/s | 384 kB 00:00 2023-07-10T23:57:33.206 INFO:teuthology.orchestra.run.smithi038.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 884 kB/s | 81 kB 00:00 2023-07-10T23:57:33.248 INFO:teuthology.orchestra.run.smithi038.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 167 kB/s | 11 kB 00:00 2023-07-10T23:57:33.256 INFO:teuthology.orchestra.run.smithi131.stdout:(127/144): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-07-10T23:57:33.273 INFO:teuthology.orchestra.run.smithi038.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 263 kB/s | 18 kB 00:00 2023-07-10T23:57:33.340 INFO:teuthology.orchestra.run.smithi038.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 730 kB/s | 49 kB 00:00 2023-07-10T23:57:33.433 INFO:teuthology.orchestra.run.smithi038.stdout:(110/144): python3-kubernetes-11.0.0-6.el8.noar 6.3 MB/s | 1.2 MB 00:00 2023-07-10T23:57:33.457 INFO:teuthology.orchestra.run.smithi038.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 503 kB/s | 59 kB 00:00 2023-07-10T23:57:33.516 INFO:teuthology.orchestra.run.smithi038.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 722 kB/s | 60 kB 00:00 2023-07-10T23:57:33.541 INFO:teuthology.orchestra.run.smithi038.stdout:(113/144): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-07-10T23:57:33.583 INFO:teuthology.orchestra.run.smithi038.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2023-07-10T23:57:33.609 INFO:teuthology.orchestra.run.smithi038.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 503 kB/s | 34 kB 00:00 2023-07-10T23:57:33.684 INFO:teuthology.orchestra.run.smithi038.stdout:(116/144): python3-routes-2.4.1-12.el8.noarch.r 1.9 MB/s | 196 kB 00:00 2023-07-10T23:57:33.705 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2023-07-10T23:57:33.709 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2023-07-10T23:57:33.751 INFO:teuthology.orchestra.run.smithi038.stdout:(117/144): python3-simplegeneric-0.8.1-17.el8.n 283 kB/s | 19 kB 00:00 2023-07-10T23:57:33.768 INFO:teuthology.orchestra.run.smithi038.stdout:(118/144): python3-rsa-4.8-1.el8.noarch.rpm 387 kB/s | 61 kB 00:00 2023-07-10T23:57:33.810 INFO:teuthology.orchestra.run.smithi038.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 408 kB/s | 24 kB 00:00 2023-07-10T23:57:33.827 INFO:teuthology.orchestra.run.smithi038.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 500 kB/s | 29 kB 00:00 2023-07-10T23:57:33.869 INFO:teuthology.orchestra.run.smithi038.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 469 kB/s | 27 kB 00:00 2023-07-10T23:57:33.902 INFO:teuthology.orchestra.run.smithi038.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2023-07-10T23:57:33.944 INFO:teuthology.orchestra.run.smithi038.stdout:(123/144): python3-webob-1.8.5-1.el8.1.noarch.r 3.3 MB/s | 251 kB 00:00 2023-07-10T23:57:34.011 INFO:teuthology.orchestra.run.smithi038.stdout:(124/144): python3-websocket-client-0.56.0-5.el 564 kB/s | 61 kB 00:00 2023-07-10T23:57:34.036 INFO:teuthology.orchestra.run.smithi038.stdout:(125/144): python3-webtest-2.0.33-1.el8.noarch. 930 kB/s | 85 kB 00:00 2023-07-10T23:57:34.078 INFO:teuthology.orchestra.run.smithi038.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 343 kB/s | 23 kB 00:00 2023-07-10T23:57:34.220 INFO:teuthology.orchestra.run.smithi038.stdout:(127/144): thrift-0.13.0-2.el8.x86_64.rpm 9.5 MB/s | 1.7 MB 00:00 2023-07-10T23:57:35.123 INFO:teuthology.orchestra.run.smithi131.stdout:(128/144): librados2-18.0.0-4828.gb5891ed6.el8. 1.8 MB/s | 3.7 MB 00:01 2023-07-10T23:57:35.407 INFO:teuthology.orchestra.run.smithi131.stdout:(129/144): librbd1-18.0.0-4828.gb5891ed6.el8.x8 1.7 MB/s | 3.6 MB 00:02 2023-07-10T23:57:35.432 INFO:teuthology.orchestra.run.smithi131.stdout:(130/144): NetworkManager-initscripts-updown-1. 465 kB/s | 143 kB 00:00 2023-07-10T23:57:35.583 INFO:teuthology.orchestra.run.smithi131.stdout:(131/144): elfutils-debuginfod-client-0.189-2.e 433 kB/s | 76 kB 00:00 2023-07-10T23:57:35.641 INFO:teuthology.orchestra.run.smithi131.stdout:(132/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.1 MB/s | 232 kB 00:00 2023-07-10T23:57:35.858 INFO:teuthology.orchestra.run.smithi131.stdout:(133/144): elfutils-libs-0.189-2.el8.x86_64.rpm 1.1 MB/s | 302 kB 00:00 2023-07-10T23:57:35.975 INFO:teuthology.orchestra.run.smithi131.stdout:(134/144): iproute-6.2.0-2.el8.x86_64.rpm 2.6 MB/s | 880 kB 00:00 2023-07-10T23:57:36.000 INFO:teuthology.orchestra.run.smithi131.stdout:(135/144): libblkid-2.32.1-42.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-07-10T23:57:36.059 INFO:teuthology.orchestra.run.smithi131.stdout:(136/144): libfdisk-2.32.1-42.el8.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2023-07-10T23:57:36.118 INFO:teuthology.orchestra.run.smithi131.stdout:(137/144): libmount-2.32.1-42.el8.x86_64.rpm 2.0 MB/s | 236 kB 00:00 2023-07-10T23:57:36.143 INFO:teuthology.orchestra.run.smithi131.stdout:(138/144): libsmartcols-2.32.1-42.el8.x86_64.rp 2.1 MB/s | 179 kB 00:00 2023-07-10T23:57:36.177 INFO:teuthology.orchestra.run.smithi131.stdout:(139/144): libuuid-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 98 kB 00:00 2023-07-10T23:57:36.235 INFO:teuthology.orchestra.run.smithi131.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 1.7 MB/s | 102 kB 00:00 2023-07-10T23:57:36.327 INFO:teuthology.orchestra.run.smithi131.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 3.6 MB/s | 334 kB 00:00 2023-07-10T23:57:36.495 INFO:teuthology.orchestra.run.smithi038.stdout:(128/144): librbd1-18.0.0-4828.gb5891ed6.el8.x8 1.6 MB/s | 3.6 MB 00:02 2023-07-10T23:57:36.519 INFO:teuthology.orchestra.run.smithi131.stdout:(142/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.7 MB/s | 1.1 MB 00:00 2023-07-10T23:57:36.554 INFO:teuthology.orchestra.run.smithi038.stdout:(129/144): librados2-18.0.0-4828.gb5891ed6.el8. 1.5 MB/s | 3.7 MB 00:02 2023-07-10T23:57:36.738 INFO:teuthology.orchestra.run.smithi038.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 414 kB/s | 76 kB 00:00 2023-07-10T23:57:36.829 INFO:teuthology.orchestra.run.smithi038.stdout:(131/144): NetworkManager-initscripts-updown-1. 430 kB/s | 143 kB 00:00 2023-07-10T23:57:36.988 INFO:teuthology.orchestra.run.smithi038.stdout:(132/144): elfutils-libelf-0.189-2.el8.x86_64.r 926 kB/s | 232 kB 00:00 2023-07-10T23:57:36.994 INFO:teuthology.orchestra.run.smithi131.stdout:(143/144): ceph-test-18.0.0-4828.gb5891ed6.el8. 2.5 MB/s | 48 MB 00:19 2023-07-10T23:57:37.053 INFO:teuthology.orchestra.run.smithi131.stdout:(144/144): util-linux-2.32.1-42.el8.x86_64.rpm 2.9 MB/s | 2.6 MB 00:00 2023-07-10T23:57:37.056 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-07-10T23:57:37.057 INFO:teuthology.orchestra.run.smithi131.stdout:Total 5.9 MB/s | 212 MB 00:36 2023-07-10T23:57:37.105 INFO:teuthology.orchestra.run.smithi038.stdout:(133/144): elfutils-libs-0.189-2.el8.x86_64.rpm 1.1 MB/s | 302 kB 00:00 2023-07-10T23:57:37.256 INFO:teuthology.orchestra.run.smithi038.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-07-10T23:57:37.364 INFO:teuthology.orchestra.run.smithi038.stdout:(135/144): iproute-6.2.0-2.el8.x86_64.rpm 2.3 MB/s | 880 kB 00:00 2023-07-10T23:57:37.389 INFO:teuthology.orchestra.run.smithi038.stdout:(136/144): libfdisk-2.32.1-42.el8.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2023-07-10T23:57:37.448 INFO:teuthology.orchestra.run.smithi038.stdout:(137/144): libmount-2.32.1-42.el8.x86_64.rpm 2.8 MB/s | 236 kB 00:00 2023-07-10T23:57:37.473 INFO:teuthology.orchestra.run.smithi038.stdout:(138/144): libsmartcols-2.32.1-42.el8.x86_64.rp 2.1 MB/s | 179 kB 00:00 2023-07-10T23:57:37.507 INFO:teuthology.orchestra.run.smithi038.stdout:(139/144): libuuid-2.32.1-42.el8.x86_64.rpm 1.6 MB/s | 98 kB 00:00 2023-07-10T23:57:37.566 INFO:teuthology.orchestra.run.smithi038.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 1.7 MB/s | 102 kB 00:00 2023-07-10T23:57:37.666 INFO:teuthology.orchestra.run.smithi038.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 3.3 MB/s | 334 kB 00:00 2023-07-10T23:57:38.146 INFO:teuthology.orchestra.run.smithi038.stdout:(142/144): ceph-test-18.0.0-4828.gb5891ed6.el8. 2.0 MB/s | 48 MB 00:24 2023-07-10T23:57:38.191 INFO:teuthology.orchestra.run.smithi038.stdout:(143/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.1 MB/s | 1.1 MB 00:00 2023-07-10T23:57:38.300 INFO:teuthology.orchestra.run.smithi038.stdout:(144/144): util-linux-2.32.1-42.el8.x86_64.rpm 3.1 MB/s | 2.6 MB 00:00 2023-07-10T23:57:38.303 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-07-10T23:57:38.303 INFO:teuthology.orchestra.run.smithi038.stdout:Total 5.4 MB/s | 212 MB 00:39 2023-07-10T23:57:38.868 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-07-10T23:57:39.237 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-07-10T23:57:39.280 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-07-10T23:57:39.280 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-07-10T23:57:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2023-07-10T23:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-10T23:57:39.624 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-07-10T23:57:39.624 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-07-10T23:57:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-10T23:57:40.008 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-10T23:57:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-10T23:57:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-10T23:57:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-10T23:57:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-10T23:57:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-10T23:57:40.784 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-07-10T23:57:40.788 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-07-10T23:57:40.868 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-07-10T23:57:40.872 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-07-10T23:57:40.953 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-10T23:57:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-10T23:57:41.539 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-10T23:57:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-10T23:57:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-10T23:57:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-10T23:57:42.458 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-10T23:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-10T23:57:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-10T23:57:43.005 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-10T23:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-10T23:57:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-10T23:57:43.599 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-10T23:57:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-10T23:57:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-10T23:57:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-10T23:57:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-10T23:57:44.786 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-10T23:57:44.932 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-10T23:57:45.023 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-10T23:57:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-10T23:57:45.305 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-10T23:57:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-10T23:57:45.670 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-10T23:57:45.858 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-10T23:57:45.989 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-10T23:57:46.065 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-07-10T23:57:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-10T23:57:46.285 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-10T23:57:46.477 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-07-10T23:57:46.483 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-10T23:57:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-10T23:57:46.665 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-10T23:57:46.735 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-10T23:57:46.838 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-10T23:57:46.839 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-10T23:57:46.861 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-10T23:57:46.953 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-10T23:57:46.960 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-10T23:57:47.034 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-10T23:57:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-10T23:57:47.134 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-10T23:57:47.194 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-10T23:57:47.262 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-10T23:57:47.366 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-10T23:57:47.444 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-10T23:57:47.564 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-10T23:57:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-10T23:57:47.674 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-10T23:57:47.711 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-10T23:57:47.843 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-10T23:57:47.857 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-10T23:57:48.010 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-10T23:57:48.163 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-10T23:57:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-10T23:57:48.464 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-10T23:57:48.532 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-10T23:57:48.677 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-10T23:57:48.784 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-10T23:57:48.917 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-10T23:57:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-10T23:57:49.091 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-10T23:57:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-10T23:57:49.179 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-10T23:57:49.268 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-10T23:57:49.285 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-10T23:57:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-10T23:57:49.389 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-10T23:57:49.399 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-10T23:57:49.585 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-10T23:57:49.591 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-10T23:57:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-10T23:57:49.684 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-10T23:57:49.744 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-10T23:57:49.829 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 30/160 2023-07-10T23:57:49.927 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-10T23:57:49.959 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 31/160 2023-07-10T23:57:49.987 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-10T23:57:50.110 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-10T23:57:50.177 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-10T23:57:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 32/160 2023-07-10T23:57:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-10T23:57:50.303 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-10T23:57:50.478 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-10T23:57:50.518 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-10T23:57:50.622 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-10T23:57:50.670 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-10T23:57:50.812 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-10T23:57:51.017 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-10T23:57:51.110 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-10T23:57:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-10T23:57:51.324 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-10T23:57:51.450 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-10T23:57:51.494 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-10T23:57:51.581 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-10T23:57:51.616 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-10T23:57:51.681 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-10T23:57:51.752 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-10T23:57:51.826 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-10T23:57:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-10T23:57:51.898 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-10T23:57:51.935 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-10T23:57:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-10T23:57:52.118 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-10T23:57:52.161 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-10T23:57:52.238 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-10T23:57:52.319 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-10T23:57:52.433 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-10T23:57:52.452 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-10T23:57:52.604 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-10T23:57:52.607 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-10T23:57:52.726 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-10T23:57:52.727 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-10T23:57:52.854 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-10T23:57:53.159 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-10T23:57:53.407 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-10T23:57:53.560 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-10T23:57:53.777 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-10T23:57:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-10T23:57:53.959 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-10T23:57:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-10T23:57:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-10T23:57:54.365 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-10T23:57:54.418 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-10T23:57:54.596 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-10T23:57:54.606 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-10T23:57:54.742 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-10T23:57:54.836 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 40/160 2023-07-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 41/160 2023-07-10T23:57:55.220 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-10T23:57:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-10T23:57:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-10T23:57:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-10T23:57:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-10T23:57:55.638 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-10T23:57:55.715 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-10T23:57:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-10T23:57:55.843 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-10T23:57:55.957 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-10T23:57:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-10T23:57:56.010 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-10T23:57:56.100 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-10T23:57:56.183 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-10T23:57:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-10T23:57:56.273 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-10T23:57:56.355 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-10T23:57:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 30/160 2023-07-10T23:57:56.483 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-10T23:57:56.589 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 31/160 2023-07-10T23:57:56.700 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 30/160 2023-07-10T23:57:56.819 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 32/160 2023-07-10T23:57:56.830 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 31/160 2023-07-10T23:57:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-10T23:57:57.047 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 32/160 2023-07-10T23:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-10T23:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-10T23:57:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-10T23:57:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-10T23:57:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-10T23:57:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-10T23:57:57.992 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-10T23:57:58.090 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-10T23:57:58.173 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-10T23:57:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-10T23:57:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-10T23:57:58.535 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-10T23:57:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-10T23:57:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-10T23:57:58.734 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-10T23:57:58.811 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-10T23:57:58.839 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-10T23:57:58.999 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-10T23:57:59.011 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-10T23:57:59.193 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-10T23:57:59.365 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-10T23:57:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-10T23:57:59.721 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-10T23:57:59.913 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-10T23:58:00.115 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-10T23:58:00.354 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-10T23:58:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-10T23:58:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-10T23:58:00.884 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-10T23:58:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-10T23:58:01.189 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-10T23:58:01.200 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-10T23:58:01.305 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-10T23:58:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-10T23:58:01.396 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-10T23:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-10T23:58:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-10T23:58:01.754 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-10T23:58:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 40/160 2023-07-10T23:58:01.932 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 40/160 2023-07-10T23:58:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 41/160 2023-07-10T23:58:02.158 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 41/160 2023-07-10T23:58:02.160 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-10T23:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-10T23:58:02.331 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-10T23:58:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-10T23:58:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-10T23:58:02.551 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-10T23:58:02.592 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-10T23:58:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-10T23:58:02.673 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-10T23:58:02.767 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-10T23:58:02.834 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-10T23:58:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 71/160 2023-07-10T23:58:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-10T23:58:02.924 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-10T23:58:03.050 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-10T23:58:03.079 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-10T23:58:03.080 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-10T23:58:03.120 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-10T23:58:03.250 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-10T23:58:03.262 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-10T23:58:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-10T23:58:03.508 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-10T23:58:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-10T23:58:03.829 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-10T23:58:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-10T23:58:03.993 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-10T23:58:04.093 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-10T23:58:04.121 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-10T23:58:04.242 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-10T23:58:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-10T23:58:04.258 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-10T23:58:04.317 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-10T23:58:04.430 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-10T23:58:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-10T23:58:04.601 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-10T23:58:04.699 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-10T23:58:04.831 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-10T23:58:04.898 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-10T23:58:04.972 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-10T23:58:05.054 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-10T23:58:05.105 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-10T23:58:05.203 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-10T23:58:05.289 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-10T23:58:05.388 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-10T23:58:05.491 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-10T23:58:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-10T23:58:05.591 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-10T23:58:05.699 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-10T23:58:05.764 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-10T23:58:05.912 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-10T23:58:05.921 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-10T23:58:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-10T23:58:06.074 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-10T23:58:06.098 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-10T23:58:06.232 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-10T23:58:06.235 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-10T23:58:06.255 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-10T23:58:06.398 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-10T23:58:06.407 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-10T23:58:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-10T23:58:06.552 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-10T23:58:06.592 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-10T23:58:06.721 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-10T23:58:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-10T23:58:06.768 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-10T23:58:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-10T23:58:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-10T23:58:07.050 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-10T23:58:07.182 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-10T23:58:07.254 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-10T23:58:07.296 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-10T23:58:07.391 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-10T23:58:07.461 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-10T23:58:07.546 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-10T23:58:07.732 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-10T23:58:07.793 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-10T23:58:07.864 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-10T23:58:07.985 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-10T23:58:08.034 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-10T23:58:08.065 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-10T23:58:08.196 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-10T23:58:08.218 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-10T23:58:08.262 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-10T23:58:08.449 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-10T23:58:08.787 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-10T23:58:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-10T23:58:09.030 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-10T23:58:09.098 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-10T23:58:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-10T23:58:09.224 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-10T23:58:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-10T23:58:09.313 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-10T23:58:09.371 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-10T23:58:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-10T23:58:09.502 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 71/160 2023-07-10T23:58:09.598 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 71/160 2023-07-10T23:58:09.628 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-10T23:58:09.743 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-10T23:58:09.857 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-10T23:58:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-10T23:58:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-10T23:58:10.146 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-10T23:58:10.255 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-10T23:58:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-10T23:58:10.424 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-10T23:58:10.424 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-10T23:58:10.520 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-10T23:58:10.616 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-10T23:58:10.644 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-10T23:58:10.686 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-10T23:58:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-10T23:58:10.874 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-10T23:58:10.901 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-10T23:58:11.144 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-10T23:58:11.148 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-10T23:58:12.288 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-10T23:58:12.443 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-10T23:58:12.677 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-10T23:58:12.821 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-10T23:58:12.857 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-10T23:58:13.050 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-10T23:58:13.104 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-10T23:58:13.286 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-10T23:58:13.380 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-10T23:58:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-10T23:58:13.593 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-10T23:58:13.632 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-10T23:58:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-10T23:58:13.827 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-10T23:58:13.856 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-10T23:58:14.086 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-10T23:58:14.095 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-10T23:58:14.293 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-10T23:58:14.310 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-10T23:58:14.394 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-10T23:58:14.612 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-10T23:58:14.644 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-10T23:58:14.662 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-10T23:58:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-10T23:58:14.759 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-10T23:58:14.863 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-10T23:58:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-10T23:58:14.965 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-10T23:58:15.034 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-10T23:58:15.210 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-10T23:58:15.254 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-10T23:58:15.486 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-10T23:58:15.549 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-10T23:58:15.620 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-10T23:58:15.770 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-10T23:58:15.826 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-10T23:58:15.931 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-10T23:58:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-10T23:58:16.115 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-10T23:58:16.275 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-10T23:58:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-10T23:58:16.493 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-10T23:58:16.501 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-10T23:58:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-10T23:58:16.681 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-10T23:58:16.756 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-10T23:58:16.865 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-10T23:58:16.982 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-10T23:58:17.000 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-10T23:58:17.149 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-10T23:58:17.157 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-10T23:58:17.299 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-10T23:58:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-10T23:58:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-10T23:58:20.143 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-10T23:58:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-10T23:58:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-10T23:58:21.030 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-10T23:58:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-10T23:58:21.117 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-10T23:58:21.264 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-10T23:58:21.759 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-10T23:58:21.972 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-10T23:58:22.172 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-10T23:58:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-10T23:58:33.820 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2023-07-10T23:58:33.821 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2023-07-10T23:58:33.821 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /dev 2023-07-10T23:58:33.821 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /run 2023-07-10T23:58:33.821 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2023-07-10T23:58:33.821 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2023-07-10T23:58:33.821 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2023-07-10T23:58:33.821 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2023-07-10T23:58:33.822 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /dev 2023-07-10T23:58:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:58:34.221 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-10T23:58:35.788 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-10T23:58:36.056 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-10T23:58:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-10T23:58:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-10T23:58:36.941 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-10T23:58:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-10T23:58:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-10T23:58:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-10T23:58:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-10T23:58:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-10T23:58:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-10T23:58:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-10T23:58:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-10T23:58:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-10T23:58:39.149 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-10T23:58:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 113/160 2023-07-10T23:58:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 114/160 2023-07-10T23:58:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-10T23:58:39.947 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-10T23:58:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-10T23:58:41.092 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-10T23:58:41.093 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2023-07-10T23:58:41.093 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2023-07-10T23:58:41.093 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /dev 2023-07-10T23:58:41.093 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /run 2023-07-10T23:58:41.093 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2023-07-10T23:58:41.093 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2023-07-10T23:58:41.093 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2023-07-10T23:58:41.094 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2023-07-10T23:58:41.094 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /dev 2023-07-10T23:58:41.094 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:58:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-10T23:58:41.419 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-10T23:58:41.495 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-10T23:58:41.511 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-10T23:58:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 118/160 2023-07-10T23:58:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-10T23:58:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-10T23:58:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-10T23:58:42.430 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-10T23:58:42.546 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-10T23:58:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2023-07-10T23:58:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2023-07-10T23:58:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2023-07-10T23:58:42.546 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /run 2023-07-10T23:58:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2023-07-10T23:58:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2023-07-10T23:58:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2023-07-10T23:58:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2023-07-10T23:58:42.547 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2023-07-10T23:58:42.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:58:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 121/160 2023-07-10T23:58:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-10T23:58:42.953 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-10T23:58:43.165 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-10T23:58:43.385 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-10T23:58:43.617 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-10T23:58:43.795 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-10T23:58:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-10T23:58:44.494 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-10T23:58:44.519 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-10T23:58:44.673 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-10T23:58:44.677 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-10T23:58:44.856 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-10T23:58:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-10T23:58:45.036 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-10T23:58:45.119 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-10T23:58:45.224 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-10T23:58:45.370 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-10T23:58:45.403 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-10T23:58:45.628 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-10T23:58:45.928 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-10T23:58:46.119 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-10T23:58:46.153 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-10T23:58:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-10T23:58:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-10T23:58:46.353 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-10T23:58:46.484 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 113/160 2023-07-10T23:58:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-10T23:58:46.655 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 114/160 2023-07-10T23:58:46.694 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-10T23:58:46.790 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-10T23:58:46.860 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-10T23:58:47.090 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-10T23:58:47.114 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-10T23:58:47.301 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-10T23:58:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-10T23:58:47.352 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-10T23:58:47.898 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-10T23:58:48.066 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-10T23:58:48.176 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 113/160 2023-07-10T23:58:48.325 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-10T23:58:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 114/160 2023-07-10T23:58:48.510 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-10T23:58:48.576 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-10T23:58:48.608 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-10T23:58:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 123/160 2023-07-10T23:58:48.836 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-10T23:58:48.979 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 118/160 2023-07-10T23:58:49.046 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-10T23:58:49.053 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-10T23:58:49.086 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-10T23:58:49.176 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-10T23:58:49.213 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-10T23:58:49.277 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-10T23:58:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-10T23:58:49.418 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-10T23:58:49.430 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-10T23:58:49.510 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-10T23:58:49.643 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 121/160 2023-07-10T23:58:49.793 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-10T23:58:49.854 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-10T23:58:50.085 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-10T23:58:50.161 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-10T23:58:50.285 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-10T23:58:50.343 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-10T23:58:50.471 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-10T23:58:50.615 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-10T23:58:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 118/160 2023-07-10T23:58:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-10T23:58:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-10T23:58:51.293 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-10T23:58:51.319 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-10T23:58:51.510 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 121/160 2023-07-10T23:58:51.513 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-10T23:58:51.693 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-10T23:58:51.813 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-10T23:58:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-10T23:58:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-10T23:58:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-10T23:58:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 134/160 2023-07-10T23:58:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-10T23:58:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-10T23:58:53.996 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-10T23:58:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-10T23:58:54.484 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 137/160 2023-07-10T23:58:54.578 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-10T23:58:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 138/160 2023-07-10T23:58:55.067 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 139/160 2023-07-10T23:58:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-10T23:58:55.575 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-10T23:58:55.594 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-10T23:58:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-10T23:58:56.041 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-10T23:58:56.106 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 123/160 2023-07-10T23:58:56.121 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-10T23:58:56.317 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-10T23:58:56.350 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-10T23:58:56.352 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-10T23:58:56.363 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-10T23:58:56.518 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-10T23:58:56.562 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-10T23:58:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-10T23:58:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-10T23:58:56.743 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-10T23:58:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-10T23:58:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-10T23:58:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-10T23:58:57.110 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-10T23:58:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-10T23:58:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-10T23:58:57.318 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-10T23:58:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-10T23:58:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-10T23:58:57.535 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-10T23:58:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-10T23:58:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-10T23:58:57.879 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-10T23:58:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-10T23:58:58.093 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-10T23:58:58.169 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 123/160 2023-07-10T23:58:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-10T23:58:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-10T23:58:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-10T23:58:58.501 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-10T23:58:58.501 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-10T23:58:58.684 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-10T23:58:58.718 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-10T23:58:58.719 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-10T23:58:58.754 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-10T23:58:58.808 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-10T23:58:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-10T23:58:58.960 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-10T23:58:58.960 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-10T23:58:59.097 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-10T23:58:59.210 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-10T23:58:59.210 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-10T23:58:59.315 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-10T23:58:59.349 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-10T23:58:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-10T23:58:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-10T23:58:59.504 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-10T23:58:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-10T23:58:59.664 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-10T23:58:59.668 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-10T23:58:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-10T23:58:59.877 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 134/160 2023-07-10T23:58:59.899 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-10T23:59:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-10T23:59:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-10T23:59:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 1/160 2023-07-10T23:59:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2/160 2023-07-10T23:59:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 3/160 2023-07-10T23:59:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 4/160 2023-07-10T23:59:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 5/160 2023-07-10T23:59:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 6/160 2023-07-10T23:59:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 7/160 2023-07-10T23:59:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-10T23:59:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-10T23:59:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-10T23:59:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-10T23:59:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 12/160 2023-07-10T23:59:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 13/160 2023-07-10T23:59:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 14/160 2023-07-10T23:59:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 15/160 2023-07-10T23:59:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 16/160 2023-07-10T23:59:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 17/160 2023-07-10T23:59:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 18/160 2023-07-10T23:59:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 19/160 2023-07-10T23:59:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 20/160 2023-07-10T23:59:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 21/160 2023-07-10T23:59:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 22/160 2023-07-10T23:59:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 23/160 2023-07-10T23:59:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 24/160 2023-07-10T23:59:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 25/160 2023-07-10T23:59:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 26/160 2023-07-10T23:59:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 27/160 2023-07-10T23:59:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 28/160 2023-07-10T23:59:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 29/160 2023-07-10T23:59:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 30/160 2023-07-10T23:59:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 31/160 2023-07-10T23:59:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 32/160 2023-07-10T23:59:00.477 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 33/160 2023-07-10T23:59:00.477 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 34/160 2023-07-10T23:59:00.477 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 35/160 2023-07-10T23:59:00.478 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 36/160 2023-07-10T23:59:00.478 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 37/160 2023-07-10T23:59:00.478 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 38/160 2023-07-10T23:59:00.478 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-10T23:59:00.478 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-10T23:59:00.478 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-10T23:59:00.478 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-10T23:59:00.479 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-10T23:59:00.479 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-10T23:59:00.479 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-10T23:59:00.479 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-10T23:59:00.479 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-10T23:59:00.479 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-10T23:59:00.479 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-10T23:59:00.479 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-10T23:59:00.480 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-10T23:59:00.480 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-10T23:59:00.480 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-10T23:59:00.480 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-10T23:59:00.480 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-10T23:59:00.480 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-10T23:59:00.480 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-10T23:59:00.481 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-10T23:59:00.481 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-10T23:59:00.481 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-10T23:59:00.481 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-10T23:59:00.481 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-10T23:59:00.481 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-10T23:59:00.481 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-10T23:59:00.481 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-10T23:59:00.482 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-10T23:59:00.482 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-10T23:59:00.482 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-10T23:59:00.482 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-10T23:59:00.482 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-10T23:59:00.482 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-10T23:59:00.482 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-10T23:59:00.482 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-10T23:59:00.483 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-10T23:59:00.483 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-10T23:59:00.483 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-10T23:59:00.483 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-10T23:59:00.483 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-10T23:59:00.483 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-10T23:59:00.483 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-10T23:59:00.483 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-10T23:59:00.484 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-10T23:59:00.484 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-10T23:59:00.484 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-10T23:59:00.484 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-10T23:59:00.484 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-10T23:59:00.484 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-10T23:59:00.484 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-10T23:59:00.485 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-10T23:59:00.485 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-10T23:59:00.485 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-10T23:59:00.485 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-10T23:59:00.485 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-10T23:59:00.485 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-10T23:59:00.485 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-10T23:59:00.485 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-10T23:59:00.486 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-10T23:59:00.486 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-10T23:59:00.486 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-10T23:59:00.486 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-10T23:59:00.486 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-10T23:59:00.486 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-10T23:59:00.486 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-10T23:59:00.486 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-10T23:59:00.487 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-10T23:59:00.487 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-10T23:59:00.487 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-10T23:59:00.487 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-10T23:59:00.487 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-10T23:59:00.487 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-10T23:59:00.487 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-10T23:59:00.487 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-10T23:59:00.488 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-10T23:59:00.488 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-10T23:59:00.488 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-10T23:59:00.488 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-10T23:59:00.488 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-10T23:59:00.488 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-10T23:59:00.488 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-10T23:59:00.489 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-10T23:59:00.489 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-10T23:59:00.489 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-10T23:59:00.489 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-10T23:59:00.489 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-10T23:59:00.489 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-10T23:59:00.489 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-10T23:59:00.489 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-10T23:59:00.490 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-10T23:59:00.490 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-10T23:59:00.490 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-10T23:59:00.490 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 131/160 2023-07-10T23:59:00.490 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-10T23:59:00.490 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-10T23:59:00.490 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-10T23:59:00.490 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-10T23:59:00.491 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-10T23:59:00.491 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-10T23:59:00.491 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-10T23:59:00.491 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-10T23:59:00.491 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-10T23:59:00.491 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-10T23:59:00.491 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-10T23:59:00.492 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-10T23:59:00.492 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-10T23:59:00.492 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-10T23:59:00.492 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-10T23:59:00.492 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-10T23:59:00.492 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-10T23:59:00.492 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-10T23:59:00.492 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-10T23:59:00.493 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-10T23:59:00.493 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-10T23:59:00.493 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-10T23:59:00.493 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-10T23:59:00.493 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-10T23:59:00.493 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-10T23:59:00.493 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-10T23:59:00.493 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-10T23:59:00.494 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-10T23:59:00.898 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-10T23:59:01.126 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-10T23:59:01.174 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-10T23:59:01.352 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-10T23:59:01.422 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-10T23:59:01.593 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 137/160 2023-07-10T23:59:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-10T23:59:01.835 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 138/160 2023-07-10T23:59:01.848 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-10T23:59:02.013 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-10T23:59:02.166 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 139/160 2023-07-10T23:59:02.188 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-10T23:59:02.401 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 134/160 2023-07-10T23:59:02.486 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-10T23:59:02.650 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-10T23:59:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-10T23:59:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:02.659 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2023-07-10T23:59:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-10T23:59:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-10T23:59:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-10T23:59:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-10T23:59:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-10T23:59:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-10T23:59:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-10T23:59:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-10T23:59:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-10T23:59:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-10T23:59:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-10T23:59:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-10T23:59:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-10T23:59:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-10T23:59:02.662 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2023-07-10T23:59:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.1-7.el8.noarch 2023-07-10T23:59:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.0.4-10.el8.x86_64 2023-07-10T23:59:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-10T23:59:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.1-9.el8.x86_64 2023-07-10T23:59:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-10T23:59:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-10T23:59:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: jq-1.6-7.el8.x86_64 2023-07-10T23:59:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-10T23:59:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-10T23:59:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-10T23:59:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-10T23:59:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-10T23:59:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-10T23:59:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: libpq-13.5-1.el8.x86_64 2023-07-10T23:59:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-10T23:59:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-10T23:59:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-10T23:59:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-10T23:59:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-10T23:59:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-10T23:59:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-10T23:59:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-10T23:59:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-10T23:59:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-10T23:59:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-10T23:59:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-10T23:59:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-10T23:59:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-10T23:59:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-10T23:59:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-10T23:59:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-10T23:59:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-10T23:59:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-10T23:59:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-10T23:59:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-10T23:59:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-10T23:59:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-10T23:59:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-10T23:59:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-10T23:59:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-10T23:59:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-10T23:59:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-10T23:59:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-10T23:59:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-10T23:59:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-10T23:59:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-10T23:59:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-10T23:59:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-10T23:59:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-10T23:59:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-10T23:59:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-10T23:59:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-10T23:59:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-10T23:59:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-10T23:59:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-10T23:59:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-10T23:59:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-10T23:59:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-10T23:59:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-10T23:59:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-10T23:59:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-10T23:59:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-10T23:59:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-2.6-1.el8.noarch 2023-07-10T23:59:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-10T23:59:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-10T23:59:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-10T23:59:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-10T23:59:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-10T23:59:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-10T23:59:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-10T23:59:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-10T23:59:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-10T23:59:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-10T23:59:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-10T23:59:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-10T23:59:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-10T23:59:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-10T23:59:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-10T23:59:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-10T23:59:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-10T23:59:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-10T23:59:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-10T23:59:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-10T23:59:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-10T23:59:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-10T23:59:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-10T23:59:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-10T23:59:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-10T23:59:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-10T23:59:02.684 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-10T23:59:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-10T23:59:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:02.685 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2023-07-10T23:59:02.839 DEBUG:teuthology.parallel:result is None 2023-07-10T23:59:02.874 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-10T23:59:03.083 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-10T23:59:03.167 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-10T23:59:03.425 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-10T23:59:03.439 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-10T23:59:03.619 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-10T23:59:03.669 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-10T23:59:03.842 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-10T23:59:03.893 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-10T23:59:03.931 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-10T23:59:04.046 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-10T23:59:04.046 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-10T23:59:04.171 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-10T23:59:04.320 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-10T23:59:04.321 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-10T23:59:04.409 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 137/160 2023-07-10T23:59:04.536 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-10T23:59:04.542 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-10T23:59:04.617 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 138/160 2023-07-10T23:59:04.654 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-10T23:59:04.654 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-10T23:59:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-10T23:59:04.964 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 139/160 2023-07-10T23:59:05.102 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-10T23:59:05.252 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-10T23:59:05.289 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-10T23:59:05.390 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-10T23:59:05.420 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-10T23:59:05.494 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-10T23:59:05.494 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-10T23:59:05.612 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-10T23:59:05.695 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-10T23:59:05.695 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-10T23:59:05.899 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-10T23:59:05.920 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-10T23:59:05.920 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-10T23:59:06.005 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-10T23:59:06.128 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-10T23:59:06.129 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-10T23:59:06.241 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-10T23:59:06.267 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-10T23:59:06.378 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-10T23:59:06.378 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-10T23:59:06.484 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-10T23:59:06.595 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-10T23:59:06.679 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-10T23:59:06.809 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-10T23:59:06.845 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-10T23:59:06.845 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-10T23:59:07.103 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-10T23:59:07.104 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-10T23:59:07.343 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-10T23:59:07.360 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-10T23:59:07.421 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-10T23:59:07.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 1/160 2023-07-10T23:59:07.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2/160 2023-07-10T23:59:07.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 3/160 2023-07-10T23:59:07.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 4/160 2023-07-10T23:59:07.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 5/160 2023-07-10T23:59:07.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 6/160 2023-07-10T23:59:07.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 7/160 2023-07-10T23:59:07.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-10T23:59:07.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-10T23:59:07.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-10T23:59:07.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-10T23:59:07.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 12/160 2023-07-10T23:59:07.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 13/160 2023-07-10T23:59:07.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 14/160 2023-07-10T23:59:07.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 15/160 2023-07-10T23:59:07.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 16/160 2023-07-10T23:59:07.424 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 17/160 2023-07-10T23:59:07.424 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 18/160 2023-07-10T23:59:07.424 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 19/160 2023-07-10T23:59:07.424 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 20/160 2023-07-10T23:59:07.424 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 21/160 2023-07-10T23:59:07.424 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 22/160 2023-07-10T23:59:07.424 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 23/160 2023-07-10T23:59:07.424 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 24/160 2023-07-10T23:59:07.425 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 25/160 2023-07-10T23:59:07.425 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 26/160 2023-07-10T23:59:07.425 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 27/160 2023-07-10T23:59:07.425 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 28/160 2023-07-10T23:59:07.425 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 29/160 2023-07-10T23:59:07.425 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 30/160 2023-07-10T23:59:07.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 31/160 2023-07-10T23:59:07.433 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 32/160 2023-07-10T23:59:07.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 33/160 2023-07-10T23:59:07.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 34/160 2023-07-10T23:59:07.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 35/160 2023-07-10T23:59:07.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 36/160 2023-07-10T23:59:07.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 37/160 2023-07-10T23:59:07.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 38/160 2023-07-10T23:59:07.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-10T23:59:07.434 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-10T23:59:07.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-10T23:59:07.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-10T23:59:07.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-10T23:59:07.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-10T23:59:07.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-10T23:59:07.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-10T23:59:07.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-10T23:59:07.435 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-10T23:59:07.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-10T23:59:07.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-10T23:59:07.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-10T23:59:07.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-10T23:59:07.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-10T23:59:07.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-10T23:59:07.436 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-10T23:59:07.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-10T23:59:07.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-10T23:59:07.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-10T23:59:07.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-10T23:59:07.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-10T23:59:07.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-10T23:59:07.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-10T23:59:07.437 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-10T23:59:07.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-10T23:59:07.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-10T23:59:07.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-10T23:59:07.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-10T23:59:07.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-10T23:59:07.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-10T23:59:07.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-10T23:59:07.438 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-10T23:59:07.439 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-10T23:59:07.439 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-10T23:59:07.439 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-10T23:59:07.439 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-10T23:59:07.439 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-10T23:59:07.439 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-10T23:59:07.439 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-10T23:59:07.439 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-10T23:59:07.440 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-10T23:59:07.440 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-10T23:59:07.440 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-10T23:59:07.440 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-10T23:59:07.440 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-10T23:59:07.440 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-10T23:59:07.440 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-10T23:59:07.441 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-10T23:59:07.441 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-10T23:59:07.441 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-10T23:59:07.441 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-10T23:59:07.441 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-10T23:59:07.441 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-10T23:59:07.441 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-10T23:59:07.441 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-10T23:59:07.442 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-10T23:59:07.442 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-10T23:59:07.442 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-10T23:59:07.442 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-10T23:59:07.442 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-10T23:59:07.442 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-10T23:59:07.442 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-10T23:59:07.442 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-10T23:59:07.443 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-10T23:59:07.443 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-10T23:59:07.443 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-10T23:59:07.443 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-10T23:59:07.443 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-10T23:59:07.443 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-10T23:59:07.443 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-10T23:59:07.443 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-10T23:59:07.444 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-10T23:59:07.444 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-10T23:59:07.444 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-10T23:59:07.444 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-10T23:59:07.444 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-10T23:59:07.444 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-10T23:59:07.444 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-10T23:59:07.444 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-10T23:59:07.445 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-10T23:59:07.445 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-10T23:59:07.445 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-10T23:59:07.445 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-10T23:59:07.445 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-10T23:59:07.445 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-10T23:59:07.445 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-10T23:59:07.445 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-10T23:59:07.446 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-10T23:59:07.446 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-10T23:59:07.446 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-10T23:59:07.446 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-10T23:59:07.446 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 131/160 2023-07-10T23:59:07.446 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-10T23:59:07.446 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-10T23:59:07.447 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-10T23:59:07.447 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-10T23:59:07.447 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-10T23:59:07.447 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-10T23:59:07.447 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-10T23:59:07.447 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-10T23:59:07.447 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-10T23:59:07.447 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-10T23:59:07.448 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-10T23:59:07.448 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-10T23:59:07.448 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-10T23:59:07.448 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-10T23:59:07.448 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-10T23:59:07.448 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-10T23:59:07.448 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-10T23:59:07.448 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-10T23:59:07.449 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-10T23:59:07.449 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-10T23:59:07.449 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-10T23:59:07.449 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-10T23:59:07.449 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-10T23:59:07.449 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-10T23:59:07.449 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-10T23:59:07.449 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-10T23:59:07.450 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-10T23:59:07.450 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-10T23:59:07.472 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-10T23:59:07.472 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-10T23:59:07.749 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-10T23:59:07.901 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-10T23:59:08.061 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-10T23:59:08.292 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-10T23:59:08.293 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-10T23:59:08.493 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-10T23:59:08.494 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-10T23:59:08.669 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-10T23:59:08.669 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-10T23:59:08.852 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-10T23:59:08.852 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-10T23:59:09.052 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-10T23:59:09.052 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-10T23:59:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-10T23:59:09.433 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-10T23:59:09.642 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-10T23:59:09.643 INFO:teuthology.orchestra.run.smithi131.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-10T23:59:09.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:09.643 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-10T23:59:09.643 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:09.644 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2023-07-10T23:59:09.644 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-10T23:59:09.644 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-10T23:59:09.644 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-10T23:59:09.644 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-10T23:59:09.644 INFO:teuthology.orchestra.run.smithi038.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-10T23:59:09.644 INFO:teuthology.orchestra.run.smithi038.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-10T23:59:09.645 INFO:teuthology.orchestra.run.smithi038.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-10T23:59:09.645 INFO:teuthology.orchestra.run.smithi038.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-10T23:59:09.645 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.645 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.645 INFO:teuthology.orchestra.run.smithi038.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-10T23:59:09.645 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-10T23:59:09.645 INFO:teuthology.orchestra.run.smithi038.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-10T23:59:09.645 INFO:teuthology.orchestra.run.smithi038.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-10T23:59:09.646 INFO:teuthology.orchestra.run.smithi038.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-10T23:59:09.646 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-10T23:59:09.646 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-07-10T23:59:09.646 INFO:teuthology.orchestra.run.smithi038.stdout: automake-1.16.1-7.el8.noarch 2023-07-10T23:59:09.646 INFO:teuthology.orchestra.run.smithi038.stdout: bison-3.0.4-10.el8.x86_64 2023-07-10T23:59:09.646 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.646 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.647 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.647 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.647 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:09.647 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.647 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.647 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:09.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:09.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:09.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:09.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:09.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.648 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.649 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:09.649 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.649 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.649 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.649 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:09.649 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:09.649 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.650 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:09.650 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-10T23:59:09.650 INFO:teuthology.orchestra.run.smithi038.stdout: flex-2.6.1-9.el8.x86_64 2023-07-10T23:59:09.650 INFO:teuthology.orchestra.run.smithi038.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-10T23:59:09.650 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-10T23:59:09.650 INFO:teuthology.orchestra.run.smithi038.stdout: jq-1.6-7.el8.x86_64 2023-07-10T23:59:09.651 INFO:teuthology.orchestra.run.smithi038.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-10T23:59:09.651 INFO:teuthology.orchestra.run.smithi038.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-10T23:59:09.651 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-10T23:59:09.651 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.651 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.651 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.651 INFO:teuthology.orchestra.run.smithi038.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-10T23:59:09.652 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-10T23:59:09.652 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-10T23:59:09.652 INFO:teuthology.orchestra.run.smithi038.stdout: libpq-13.5-1.el8.x86_64 2023-07-10T23:59:09.652 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-10T23:59:09.652 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-10T23:59:09.652 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.652 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.653 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-10T23:59:09.653 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.653 INFO:teuthology.orchestra.run.smithi038.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-10T23:59:09.653 INFO:teuthology.orchestra.run.smithi038.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-10T23:59:09.653 INFO:teuthology.orchestra.run.smithi038.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-10T23:59:09.653 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-10T23:59:09.653 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-10T23:59:09.653 INFO:teuthology.orchestra.run.smithi038.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-10T23:59:09.654 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-10T23:59:09.654 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-10T23:59:09.654 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-10T23:59:09.654 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-10T23:59:09.654 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-10T23:59:09.654 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-10T23:59:09.654 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-10T23:59:09.654 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-10T23:59:09.655 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-10T23:59:09.655 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-10T23:59:09.655 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-10T23:59:09.655 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-10T23:59:09.655 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-10T23:59:09.655 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-10T23:59:09.655 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-10T23:59:09.655 INFO:teuthology.orchestra.run.smithi038.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-10T23:59:09.656 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-10T23:59:09.656 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.656 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.656 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.656 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-10T23:59:09.656 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-10T23:59:09.656 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-10T23:59:09.657 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-10T23:59:09.657 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-10T23:59:09.657 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-10T23:59:09.657 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-10T23:59:09.657 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-10T23:59:09.657 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-10T23:59:09.657 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-10T23:59:09.658 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-10T23:59:09.658 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-10T23:59:09.658 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-10T23:59:09.658 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-10T23:59:09.658 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-10T23:59:09.658 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-10T23:59:09.659 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-10T23:59:09.659 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-10T23:59:09.659 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-10T23:59:09.659 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-10T23:59:09.659 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-10T23:59:09.659 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-10T23:59:09.659 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-2.6-1.el8.noarch 2023-07-10T23:59:09.659 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-10T23:59:09.660 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-10T23:59:09.660 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-10T23:59:09.660 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-10T23:59:09.660 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-10T23:59:09.660 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-10T23:59:09.660 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.660 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.661 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-10T23:59:09.661 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-10T23:59:09.661 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.661 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-10T23:59:09.661 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-10T23:59:09.661 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-10T23:59:09.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-10T23:59:09.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-10T23:59:09.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-10T23:59:09.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-10T23:59:09.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-10T23:59:09.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-10T23:59:09.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-10T23:59:09.662 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-10T23:59:09.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-10T23:59:09.663 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-10T23:59:09.663 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.663 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.663 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:09.663 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-10T23:59:09.663 INFO:teuthology.orchestra.run.smithi038.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-10T23:59:09.663 INFO:teuthology.orchestra.run.smithi038.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-10T23:59:09.664 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-10T23:59:09.664 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-10T23:59:09.664 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-10T23:59:09.664 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:09.664 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-07-10T23:59:09.872 DEBUG:teuthology.parallel:result is None 2023-07-10T23:59:10.351 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 1/160 2023-07-10T23:59:10.351 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2/160 2023-07-10T23:59:10.351 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 3/160 2023-07-10T23:59:10.351 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 4/160 2023-07-10T23:59:10.351 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 5/160 2023-07-10T23:59:10.351 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 6/160 2023-07-10T23:59:10.352 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 7/160 2023-07-10T23:59:10.352 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-10T23:59:10.352 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-10T23:59:10.352 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-10T23:59:10.352 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-10T23:59:10.352 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 12/160 2023-07-10T23:59:10.352 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 13/160 2023-07-10T23:59:10.353 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 14/160 2023-07-10T23:59:10.353 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 15/160 2023-07-10T23:59:10.353 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 16/160 2023-07-10T23:59:10.353 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 17/160 2023-07-10T23:59:10.353 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 18/160 2023-07-10T23:59:10.353 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 19/160 2023-07-10T23:59:10.353 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 20/160 2023-07-10T23:59:10.353 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 21/160 2023-07-10T23:59:10.354 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 22/160 2023-07-10T23:59:10.354 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 23/160 2023-07-10T23:59:10.354 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 24/160 2023-07-10T23:59:10.354 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 25/160 2023-07-10T23:59:10.354 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 26/160 2023-07-10T23:59:10.354 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 27/160 2023-07-10T23:59:10.354 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 28/160 2023-07-10T23:59:10.355 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 29/160 2023-07-10T23:59:10.355 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 30/160 2023-07-10T23:59:10.355 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 31/160 2023-07-10T23:59:10.355 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 32/160 2023-07-10T23:59:10.355 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 33/160 2023-07-10T23:59:10.355 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 34/160 2023-07-10T23:59:10.355 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 35/160 2023-07-10T23:59:10.363 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 36/160 2023-07-10T23:59:10.364 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 37/160 2023-07-10T23:59:10.364 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 38/160 2023-07-10T23:59:10.364 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-10T23:59:10.364 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-10T23:59:10.364 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-10T23:59:10.365 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-10T23:59:10.365 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-10T23:59:10.365 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-10T23:59:10.365 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-10T23:59:10.365 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-10T23:59:10.365 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-10T23:59:10.365 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-10T23:59:10.366 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-10T23:59:10.366 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-10T23:59:10.366 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-10T23:59:10.366 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-10T23:59:10.366 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-10T23:59:10.366 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-10T23:59:10.366 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-10T23:59:10.366 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-10T23:59:10.367 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-10T23:59:10.367 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-10T23:59:10.367 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-10T23:59:10.367 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-10T23:59:10.367 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-10T23:59:10.367 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-10T23:59:10.367 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-10T23:59:10.368 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-10T23:59:10.368 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-10T23:59:10.368 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-10T23:59:10.368 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-10T23:59:10.368 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-10T23:59:10.368 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-10T23:59:10.368 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-10T23:59:10.369 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-10T23:59:10.369 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-10T23:59:10.369 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-10T23:59:10.369 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-10T23:59:10.369 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-10T23:59:10.369 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-10T23:59:10.369 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-10T23:59:10.369 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-10T23:59:10.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-10T23:59:10.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-10T23:59:10.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-10T23:59:10.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-10T23:59:10.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-10T23:59:10.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-10T23:59:10.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-10T23:59:10.371 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-10T23:59:10.371 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-10T23:59:10.371 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-10T23:59:10.371 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-10T23:59:10.371 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-10T23:59:10.371 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-10T23:59:10.371 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-10T23:59:10.371 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-10T23:59:10.372 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-10T23:59:10.372 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-10T23:59:10.372 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-10T23:59:10.372 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-10T23:59:10.372 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-10T23:59:10.372 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-10T23:59:10.372 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-10T23:59:10.373 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-10T23:59:10.373 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-10T23:59:10.373 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-10T23:59:10.373 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-10T23:59:10.373 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-10T23:59:10.373 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-10T23:59:10.373 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-10T23:59:10.373 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-10T23:59:10.374 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-10T23:59:10.374 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-10T23:59:10.374 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-10T23:59:10.374 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-10T23:59:10.374 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-10T23:59:10.374 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-10T23:59:10.374 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-10T23:59:10.375 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-10T23:59:10.375 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-10T23:59:10.375 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-10T23:59:10.375 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-10T23:59:10.375 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-10T23:59:10.375 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-10T23:59:10.375 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-10T23:59:10.375 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-10T23:59:10.376 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-10T23:59:10.376 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-10T23:59:10.376 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-10T23:59:10.376 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-10T23:59:10.376 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-10T23:59:10.376 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-10T23:59:10.376 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-10T23:59:10.376 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 131/160 2023-07-10T23:59:10.377 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-10T23:59:10.377 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-10T23:59:10.377 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-10T23:59:10.377 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-10T23:59:10.377 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-10T23:59:10.377 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-10T23:59:10.377 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-10T23:59:10.378 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-10T23:59:10.378 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-10T23:59:10.378 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-10T23:59:10.378 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-10T23:59:10.378 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-10T23:59:10.378 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-10T23:59:10.378 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-10T23:59:10.379 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-10T23:59:10.379 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-10T23:59:10.379 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-10T23:59:10.379 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-10T23:59:10.379 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-10T23:59:10.379 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-10T23:59:10.379 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-10T23:59:10.379 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-10T23:59:10.380 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-10T23:59:10.380 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-10T23:59:10.380 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-10T23:59:10.380 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-10T23:59:10.380 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-10T23:59:10.380 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-10T23:59:12.458 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-10T23:59:12.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:12.459 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2023-07-10T23:59:12.459 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-10T23:59:12.459 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-10T23:59:12.459 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-10T23:59:12.460 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-10T23:59:12.460 INFO:teuthology.orchestra.run.smithi131.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-10T23:59:12.460 INFO:teuthology.orchestra.run.smithi131.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-10T23:59:12.460 INFO:teuthology.orchestra.run.smithi131.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-10T23:59:12.460 INFO:teuthology.orchestra.run.smithi131.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-10T23:59:12.460 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.460 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.461 INFO:teuthology.orchestra.run.smithi131.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-10T23:59:12.461 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-10T23:59:12.461 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-10T23:59:12.461 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-10T23:59:12.461 INFO:teuthology.orchestra.run.smithi131.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-10T23:59:12.461 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-10T23:59:12.461 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2023-07-10T23:59:12.461 INFO:teuthology.orchestra.run.smithi131.stdout: automake-1.16.1-7.el8.noarch 2023-07-10T23:59:12.462 INFO:teuthology.orchestra.run.smithi131.stdout: bison-3.0.4-10.el8.x86_64 2023-07-10T23:59:12.462 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.462 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.462 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.462 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.462 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:12.462 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.462 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.463 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.463 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:12.463 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:12.463 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:12.463 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:12.463 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:12.463 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.464 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.464 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:12.464 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.464 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.464 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.464 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:12.464 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:12.464 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.465 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-10T23:59:12.465 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-10T23:59:12.465 INFO:teuthology.orchestra.run.smithi131.stdout: flex-2.6.1-9.el8.x86_64 2023-07-10T23:59:12.465 INFO:teuthology.orchestra.run.smithi131.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-10T23:59:12.465 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-10T23:59:12.465 INFO:teuthology.orchestra.run.smithi131.stdout: jq-1.6-7.el8.x86_64 2023-07-10T23:59:12.465 INFO:teuthology.orchestra.run.smithi131.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-10T23:59:12.465 INFO:teuthology.orchestra.run.smithi131.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-10T23:59:12.466 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-10T23:59:12.466 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.466 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.466 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.466 INFO:teuthology.orchestra.run.smithi131.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-10T23:59:12.466 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-10T23:59:12.466 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-10T23:59:12.467 INFO:teuthology.orchestra.run.smithi131.stdout: libpq-13.5-1.el8.x86_64 2023-07-10T23:59:12.467 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-10T23:59:12.467 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-10T23:59:12.467 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.467 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.467 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-10T23:59:12.467 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.467 INFO:teuthology.orchestra.run.smithi131.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-10T23:59:12.468 INFO:teuthology.orchestra.run.smithi131.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-10T23:59:12.468 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-10T23:59:12.468 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-10T23:59:12.468 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-10T23:59:12.468 INFO:teuthology.orchestra.run.smithi131.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-10T23:59:12.468 INFO:teuthology.orchestra.run.smithi131.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-10T23:59:12.468 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-10T23:59:12.468 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-10T23:59:12.469 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-10T23:59:12.469 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-10T23:59:12.469 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-10T23:59:12.469 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-10T23:59:12.469 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-10T23:59:12.469 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-10T23:59:12.469 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-10T23:59:12.470 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-10T23:59:12.470 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-10T23:59:12.470 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-10T23:59:12.470 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-10T23:59:12.470 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-10T23:59:12.470 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-10T23:59:12.470 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-10T23:59:12.470 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.471 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.471 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.471 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-10T23:59:12.471 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-10T23:59:12.471 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-10T23:59:12.471 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-10T23:59:12.471 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-10T23:59:12.471 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-10T23:59:12.472 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-10T23:59:12.472 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-10T23:59:12.472 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-10T23:59:12.472 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-10T23:59:12.472 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-10T23:59:12.472 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-10T23:59:12.472 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-10T23:59:12.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-10T23:59:12.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-10T23:59:12.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-10T23:59:12.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-10T23:59:12.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-10T23:59:12.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-10T23:59:12.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-10T23:59:12.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-10T23:59:12.474 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-10T23:59:12.474 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-2.6-1.el8.noarch 2023-07-10T23:59:12.474 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-10T23:59:12.474 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-10T23:59:12.474 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-10T23:59:12.474 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-10T23:59:12.474 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-10T23:59:12.474 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-10T23:59:12.475 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.475 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.475 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-10T23:59:12.475 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-10T23:59:12.475 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.475 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-10T23:59:12.475 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-10T23:59:12.475 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-10T23:59:12.476 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-10T23:59:12.476 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-10T23:59:12.476 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-10T23:59:12.476 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-10T23:59:12.476 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-10T23:59:12.476 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-10T23:59:12.476 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-10T23:59:12.477 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-10T23:59:12.477 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-10T23:59:12.477 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-10T23:59:12.477 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.477 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.477 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-10T23:59:12.477 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-10T23:59:12.477 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-10T23:59:12.478 INFO:teuthology.orchestra.run.smithi131.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-10T23:59:12.478 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-10T23:59:12.478 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-10T23:59:12.478 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-10T23:59:12.479 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:12.479 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-07-10T23:59:12.772 DEBUG:teuthology.parallel:result is None 2023-07-10T23:59:12.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-10T23:59:12.912 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-10T23:59:12.942 INFO:teuthology.orchestra.run.smithi038.stdout:18.0.0-4828.gb5891ed6.el8 2023-07-10T23:59:12.943 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4828.gb5891ed6.el8 2023-07-10T23:59:12.943 INFO:teuthology.task.install:The correct ceph version 18.0.0-4828.gb5891ed6 is installed. 2023-07-10T23:59:12.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-10T23:59:13.085 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-10T23:59:13.115 INFO:teuthology.orchestra.run.smithi070.stdout:18.0.0-4828.gb5891ed6.el8 2023-07-10T23:59:13.115 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4828.gb5891ed6.el8 2023-07-10T23:59:13.115 INFO:teuthology.task.install:The correct ceph version 18.0.0-4828.gb5891ed6 is installed. 2023-07-10T23:59:13.116 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-10T23:59:13.332 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-10T23:59:13.388 INFO:teuthology.orchestra.run.smithi131.stdout:18.0.0-4828.gb5891ed6.el8 2023-07-10T23:59:13.388 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4828.gb5891ed6.el8 2023-07-10T23:59:13.389 INFO:teuthology.task.install:The correct ceph version 18.0.0-4828.gb5891ed6 is installed. 2023-07-10T23:59:13.389 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-10T23:59:13.389 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:13.390 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-10T23:59:13.428 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:13.428 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-10T23:59:13.464 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-10T23:59:13.465 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-10T23:59:13.537 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-10T23:59:13.538 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:13.538 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2023-07-10T23:59:13.573 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-10T23:59:13.645 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:13.646 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2023-07-10T23:59:13.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-10T23:59:13.750 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-10T23:59:13.750 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2023-07-10T23:59:13.819 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-10T23:59:13.928 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-10T23:59:13.929 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:13.929 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-10T23:59:13.963 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-10T23:59:14.035 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:14.036 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-10T23:59:14.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-10T23:59:14.137 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-10T23:59:14.137 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-10T23:59:14.207 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-10T23:59:14.317 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-10T23:59:14.318 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:14.318 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2023-07-10T23:59:14.352 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-10T23:59:14.424 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:14.425 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2023-07-10T23:59:14.457 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-10T23:59:14.527 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-10T23:59:14.528 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2023-07-10T23:59:14.597 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-10T23:59:14.710 INFO:teuthology.run_tasks:Running task ceph... 2023-07-10T23:59:14.783 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-10T23:59:14.783 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /var/log/ceph 2023-07-10T23:59:14.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2023-07-10T23:59:14.788 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2023-07-10T23:59:14.858 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-10T23:59:14.858 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-10T23:59:14.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-10T23:59:14.863 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-10T23:59:14.936 INFO:tasks.ceph:Creating extra log directories... 2023-07-10T23:59:14.936 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-10T23:59:14.938 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-10T23:59:14.940 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-10T23:59:15.019 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-10T23:59:15.019 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-10T23:59:15.019 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-10T23:59:15.020 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:15.020 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-10T23:59:15.042 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-10T23:59:15.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-10T23:59:15.193 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:15.194 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-10T23:59:15.216 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-10T23:59:15.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-10T23:59:15.374 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-10T23:59:15.375 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-10T23:59:15.423 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-10T23:59:15.632 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-10T23:59:15.708 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-10T23:59:15.708 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-10T23:59:15.709 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332875', 'branch': 'wip-pdonnell-testing-20230710.195410', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7332875', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20230710.195410'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20230710.195410', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 948, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'sleep_before_teardown': 0, 'subset': '199/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20230710.195410', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi038.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt25siIA6MYEBXhiCv8Bh93AzbLdnUocN++/TZL3ckhP9mgFiHaNXym8D8ZkWco36nOZBf3EvmS7ljKYtS4wrfABUlXrDnWV+mXfWU9O6k57OA/e4UGzMvG+D/cLBuyZAiUMOeDAF9Kpo4R7rJreoDo8ML4k9QZbZMcYvUcsWhPDR9YO+Ot/fLgQtv2/lH44eyS+6jt2Wq9EJ5p+CKbLkTaNQNY3D66uNSeji78SCSPT3wngit8y20TFS+Gh/KmvlMfumYrT7cuv/4xMmOkrE9nQ9ATx9/aeNM2N003vQzjrOBZyLOgYD9ERN5+/2jOt/ehKmof50igLcDpwaEZC01rZc0NPFHDzn+OjMUqKkqo5BD32ZNn0yPNWy+RUBuLYSRkIx7WbGL6elYK5wh2YNoO/VAgBBFxMrf03+tSZnm5amdA4Hu9iiXmPY+7medWlAYhEnTP8TrpwjrZCMGGQBmjawmLXmv1RkKABSb9gQqrZvISpdwmLEI2Icimnh7ajU=', 'smithi070.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5gBBeJ4VIYP9vAIimgxj78oANJ9g7eg70vSqsHyG+lmebF66wBndpoVukGYR4AeXvced9I5TnFxDB40f9ZNMQGS1afS4KHB4VAsZbvNrw5G+ERa3oHkKOWOCIUKUxas9PheklXwIHMePr2sqq2sonMPKjWbBwDYet6AEUeazLI4Ldc+LOGxu9ooPWDk1qPnHljoQJVqMV00R4VK+at7CK7ZWccPOvxRM1az9N5tg4Bb5ldI1p2nipqtVpQDXU3v57jCdnHB6CwLnfp8bWsR/IUUkfneYaphRQl8Llth42rsKGvI8dvJa5o91PXWuufci++TCdLRXERgwHQaQPyCpfhIpVg2Hy10feHikhtXFBnCV1af9nXLJPNz6YhjAOdLfH7rPhfMr6Ys/TvNftSsJ7B6NXm6kUFm/1GQQaEz3UxXazzwHT5eWkIPaUC5hwy7SgxkebKg1XTei/CJXHrsLME6W0uq6Z0Xqma3cMkwakr4RKid3cuztANLQUd5HBgA0=', 'smithi131.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpDcpGz7PBH8tYX9I/hzmzNwG2Mn5lCyVvUJaRp2Hj+gCq0J8PzbvI5jAozgDMGdIdPszbgQTeM94bdrDsms1zqnTpXBQlGGhALsNm5+KL2E6InCjd4dD2cqv1u3GyYIQ1fFsInFL9Gbwlioio3/eVv5vloKcTOuqC400u/GyPorT27QR/fvLvURNGaOZYqpBPrllyxUlEZBlJ/jKhUskCNUJONqU9BhHS98Yxrybo/LCWmDWiXqQS45GPwET6ZeCAC8zB5INSwmdZy3c9g3ORoOMrW1SL6203lqp4rgt3aYTU+l1oouj+KVzhVtDb3wEgUzJpBXpMMXrzyvqs9lC1aoTT8wLFSiKSr+KdIAevoIIeevdxGCeXO7OgamvDxzFLDkX1bR2FOw1BEHacaxKJKruD4mdt7vuBSr0yImAGo7+zHG800m/WTiDwoULAuHbj0kBZwjDCQegg99YJZHjHrtOcgCmk28npuuaVyy7NY0Ad1jMwW4p+XEekFSRLFAs='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-10_22:55:54', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-10T23:59:15.710 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-10T23:59:15.713 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-10T23:59:15.715 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-10T23:59:15.761 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/run/ceph 2023-07-10T23:59:15.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2023-07-10T23:59:15.778 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2023-07-10T23:59:15.848 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:15.848 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2023-07-10T23:59:15.870 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-10T23:59:15.870 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2023-07-10T23:59:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-10T23:59:15.933 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-10T23:59:15.933 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 388169 Links: 1 2023-07-10T23:59:15.933 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-10T23:59:15.934 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-07-10T23:59:15.934 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-07-10 23:59:07.041611878 +0000 2023-07-10T23:59:15.934 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-07-10 23:53:44.699876330 +0000 2023-07-10T23:59:15.934 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-07-10 23:53:44.699876330 +0000 2023-07-10T23:59:15.934 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-07-10T23:59:15.934 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-10T23:59:16.005 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-07-10T23:59:16.006 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-07-10T23:59:16.006 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.00034745 s, 1.5 MB/s 2023-07-10T23:59:16.007 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-10T23:59:16.069 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2023-07-10T23:59:16.131 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-10T23:59:16.132 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-10T23:59:16.132 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 374697 Links: 1 2023-07-10T23:59:16.132 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-10T23:59:16.132 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-07-10T23:59:16.132 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-07-10 23:59:07.041611878 +0000 2023-07-10T23:59:16.132 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-07-10 23:53:45.230866356 +0000 2023-07-10T23:59:16.132 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-07-10 23:53:45.230866356 +0000 2023-07-10T23:59:16.133 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-07-10T23:59:16.133 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-10T23:59:16.202 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-07-10T23:59:16.202 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-07-10T23:59:16.203 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000379037 s, 1.4 MB/s 2023-07-10T23:59:16.203 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-10T23:59:16.265 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2023-07-10T23:59:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-10T23:59:16.327 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-10T23:59:16.328 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 388241 Links: 1 2023-07-10T23:59:16.328 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-10T23:59:16.328 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-07-10T23:59:16.328 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-07-10 23:59:07.041611878 +0000 2023-07-10T23:59:16.328 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-07-10 23:53:45.774856137 +0000 2023-07-10T23:59:16.328 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-07-10 23:53:45.774856137 +0000 2023-07-10T23:59:16.328 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-07-10T23:59:16.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-10T23:59:16.397 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-07-10T23:59:16.398 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-07-10T23:59:16.398 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000286695 s, 1.8 MB/s 2023-07-10T23:59:16.399 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-10T23:59:16.459 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2023-07-10T23:59:16.519 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-10T23:59:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-10T23:59:16.520 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 391497 Links: 1 2023-07-10T23:59:16.520 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-10T23:59:16.520 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-07-10T23:59:16.520 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-07-10 23:59:07.041611878 +0000 2023-07-10T23:59:16.520 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-07-10 23:53:46.318845919 +0000 2023-07-10T23:59:16.521 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-07-10 23:53:46.318845919 +0000 2023-07-10T23:59:16.521 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-07-10T23:59:16.521 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-10T23:59:16.589 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-07-10T23:59:16.589 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-07-10T23:59:16.589 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000381401 s, 1.3 MB/s 2023-07-10T23:59:16.590 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-10T23:59:16.651 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-10T23:59:16.651 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:16.652 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2023-07-10T23:59:16.674 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-10T23:59:16.674 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2023-07-10T23:59:16.736 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-10T23:59:16.737 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-10T23:59:16.737 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 386871 Links: 1 2023-07-10T23:59:16.737 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-10T23:59:16.737 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2023-07-10T23:59:16.737 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-07-10 23:59:00.122198535 +0000 2023-07-10T23:59:16.737 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-07-10 23:53:29.923506610 +0000 2023-07-10T23:59:16.737 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-07-10 23:53:29.923506610 +0000 2023-07-10T23:59:16.738 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-07-10T23:59:16.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-10T23:59:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-07-10T23:59:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-07-10T23:59:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000120811 s, 4.2 MB/s 2023-07-10T23:59:16.809 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-10T23:59:16.871 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2023-07-10T23:59:16.931 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-10T23:59:16.932 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-10T23:59:16.932 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 386917 Links: 1 2023-07-10T23:59:16.932 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-10T23:59:16.932 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2023-07-10T23:59:16.932 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-07-10 23:59:00.122198535 +0000 2023-07-10T23:59:16.932 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-07-10 23:53:30.452490788 +0000 2023-07-10T23:59:16.932 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-07-10 23:53:30.452490788 +0000 2023-07-10T23:59:16.933 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-07-10T23:59:16.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-10T23:59:17.001 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-07-10T23:59:17.001 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-07-10T23:59:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000120209 s, 4.3 MB/s 2023-07-10T23:59:17.002 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-10T23:59:17.064 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2023-07-10T23:59:17.123 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-10T23:59:17.124 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-10T23:59:17.124 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 381670 Links: 1 2023-07-10T23:59:17.124 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-10T23:59:17.124 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2023-07-10T23:59:17.124 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-07-10 23:59:00.122198535 +0000 2023-07-10T23:59:17.125 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-07-10 23:53:30.984474876 +0000 2023-07-10T23:59:17.125 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-07-10 23:53:30.984474876 +0000 2023-07-10T23:59:17.125 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-07-10T23:59:17.125 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-10T23:59:17.191 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-07-10T23:59:17.192 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-07-10T23:59:17.192 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000111732 s, 4.6 MB/s 2023-07-10T23:59:17.193 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-10T23:59:17.252 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2023-07-10T23:59:17.311 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-10T23:59:17.311 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-10T23:59:17.312 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 384738 Links: 1 2023-07-10T23:59:17.312 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-10T23:59:17.312 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2023-07-10T23:59:17.312 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-07-10 23:59:00.122198535 +0000 2023-07-10T23:59:17.312 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-07-10 23:53:31.507459234 +0000 2023-07-10T23:59:17.312 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-07-10 23:53:31.507459234 +0000 2023-07-10T23:59:17.312 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-07-10T23:59:17.313 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-10T23:59:17.377 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-07-10T23:59:17.378 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-07-10T23:59:17.378 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.00012074 s, 4.2 MB/s 2023-07-10T23:59:17.379 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-10T23:59:17.438 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-10T23:59:17.438 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-10T23:59:17.438 INFO:tasks.ceph:Generating config... 2023-07-10T23:59:17.440 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-10T23:59:17.440 INFO:tasks.ceph:[client] debug client = 20 2023-07-10T23:59:17.441 INFO:tasks.ceph:[client] debug ms = 1 2023-07-10T23:59:17.441 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-10T23:59:17.441 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-10T23:59:17.441 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-07-10T23:59:17.441 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-10T23:59:17.442 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-10T23:59:17.442 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-10T23:59:17.442 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-10T23:59:17.442 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-10T23:59:17.443 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-10T23:59:17.443 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-10T23:59:17.443 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-10T23:59:17.443 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-10T23:59:17.443 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-10T23:59:17.444 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-10T23:59:17.444 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-10T23:59:17.444 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-10T23:59:17.444 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-10T23:59:17.444 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-10T23:59:17.445 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-10T23:59:17.445 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-10T23:59:17.445 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-10T23:59:17.445 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-10T23:59:17.445 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-10T23:59:17.445 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-10T23:59:17.446 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-10T23:59:17.446 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-10T23:59:17.446 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-10T23:59:17.446 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-10T23:59:17.446 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-10T23:59:17.447 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-10T23:59:17.447 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-10T23:59:17.447 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-10T23:59:17.447 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-10T23:59:17.447 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-10T23:59:17.448 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-10T23:59:17.448 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-10T23:59:17.448 INFO:tasks.ceph:Setting up mon.a... 2023-07-10T23:59:17.448 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-10T23:59:17.517 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.keyring 2023-07-10T23:59:17.520 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-10T23:59:17.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-10T23:59:17.601 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.38'), ('mon.b', '172.21.15.70'), ('mon.c', '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]')] 2023-07-10T23:59:17.602 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.38,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-10T23:59:17.603 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:17.603 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-10T23:59:17.661 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.38 --add b 172.21.15.70 --addv c '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:17.753 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:17.753 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: generated fsid 712aa6bd-5b82-40dc-8d7c-7e66131fef83 2023-07-10T23:59:17.753 INFO:teuthology.orchestra.run.smithi038.stdout:setting min_mon_release = pacific 2023-07-10T23:59:17.753 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 0 2023-07-10T23:59:17.753 INFO:teuthology.orchestra.run.smithi038.stdout:fsid 712aa6bd-5b82-40dc-8d7c-7e66131fef83 2023-07-10T23:59:17.753 INFO:teuthology.orchestra.run.smithi038.stdout:last_changed 2023-07-10T23:59:17.751926+0000 2023-07-10T23:59:17.754 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-07-10T23:59:17.751926+0000 2023-07-10T23:59:17.754 INFO:teuthology.orchestra.run.smithi038.stdout:min_mon_release 16 (pacific) 2023-07-10T23:59:17.754 INFO:teuthology.orchestra.run.smithi038.stdout:election_strategy: 1 2023-07-10T23:59:17.754 INFO:teuthology.orchestra.run.smithi038.stdout:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2023-07-10T23:59:17.754 INFO:teuthology.orchestra.run.smithi038.stdout:1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.b 2023-07-10T23:59:17.754 INFO:teuthology.orchestra.run.smithi038.stdout:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2023-07-10T23:59:17.754 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-10T23:59:17.755 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-10T23:59:17.774 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 712aa6bd-5b82-40dc-8d7c-7e66131fef83... 2023-07-10T23:59:17.775 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-10T23:59:17.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-10T23:59:17.819 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-10T23:59:17.861 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2023-07-10T23:59:17.861 INFO:teuthology.orchestra.run.smithi038.stdout: chdir = "" 2023-07-10T23:59:17.861 INFO:teuthology.orchestra.run.smithi038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-10T23:59:17.862 INFO:teuthology.orchestra.run.smithi038.stdout: auth supported = cephx 2023-07-10T23:59:17.862 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.862 INFO:teuthology.orchestra.run.smithi038.stdout: filestore xattr use omap = true 2023-07-10T23:59:17.862 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.862 INFO:teuthology.orchestra.run.smithi038.stdout: mon clock drift allowed = 1.000 2023-07-10T23:59:17.862 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.862 INFO:teuthology.orchestra.run.smithi038.stdout: osd crush chooseleaf type = 0 2023-07-10T23:59:17.863 INFO:teuthology.orchestra.run.smithi038.stdout: auth debug = true 2023-07-10T23:59:17.863 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.863 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on old message = true 2023-07-10T23:59:17.863 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on bug = true 2023-07-10T23:59:17.863 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.863 INFO:teuthology.orchestra.run.smithi038.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-10T23:59:17.863 INFO:teuthology.orchestra.run.smithi038.stdout: mon pg warn max object skew = 0 2023-07-10T23:59:17.863 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.864 INFO:teuthology.orchestra.run.smithi038.stdout: # disable pg_autoscaler by default for new pools 2023-07-10T23:59:17.864 INFO:teuthology.orchestra.run.smithi038.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-10T23:59:17.864 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.864 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default size = 2 2023-07-10T23:59:17.864 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.864 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow primary affinity = true 2023-07-10T23:59:17.865 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow pg remap = true 2023-07-10T23:59:17.865 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on legacy crush tunables = false 2023-07-10T23:59:17.865 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on crush straw calc version zero = false 2023-07-10T23:59:17.865 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on no sortbitwise = false 2023-07-10T23:59:17.865 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on osd down out interval zero = false 2023-07-10T23:59:17.865 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on too few osds = false 2023-07-10T23:59:17.865 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-10T23:59:17.865 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-10T23:59:17.866 INFO:teuthology.orchestra.run.smithi038.stdout: mon_allow_pool_size_one = true 2023-07-10T23:59:17.866 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.866 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-10T23:59:17.866 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.866 INFO:teuthology.orchestra.run.smithi038.stdout: osd default data pool replay window = 5 2023-07-10T23:59:17.866 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.866 INFO:teuthology.orchestra.run.smithi038.stdout: mon allow pool delete = true 2023-07-10T23:59:17.866 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.867 INFO:teuthology.orchestra.run.smithi038.stdout: mon cluster log file level = debug 2023-07-10T23:59:17.867 INFO:teuthology.orchestra.run.smithi038.stdout: debug asserts on shutdown = true 2023-07-10T23:59:17.867 INFO:teuthology.orchestra.run.smithi038.stdout: mon health detail to clog = false 2023-07-10T23:59:17.867 INFO:teuthology.orchestra.run.smithi038.stdout: mon host = "172.21.15.38,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]" 2023-07-10T23:59:17.867 INFO:teuthology.orchestra.run.smithi038.stdout: mon pg warn min per osd = 0 2023-07-10T23:59:17.867 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on skipped message = False 2023-07-10T23:59:17.867 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = 712aa6bd-5b82-40dc-8d7c-7e66131fef83 2023-07-10T23:59:17.867 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.868 INFO:teuthology.orchestra.run.smithi038.stdout:[osd] 2023-07-10T23:59:17.868 INFO:teuthology.orchestra.run.smithi038.stdout: osd journal size = 100 2023-07-10T23:59:17.868 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.868 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub load threshold = 5.0 2023-07-10T23:59:17.868 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub max interval = 600 2023-07-10T23:59:17.868 INFO:teuthology.orchestra.run.smithi038.stdout: osd mclock profile = high_recovery_ops 2023-07-10T23:59:17.868 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.869 INFO:teuthology.orchestra.run.smithi038.stdout: osd recover clone overlap = true 2023-07-10T23:59:17.869 INFO:teuthology.orchestra.run.smithi038.stdout: osd recovery max chunk = 1048576 2023-07-10T23:59:17.869 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.869 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug shutdown = true 2023-07-10T23:59:17.869 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug op order = true 2023-07-10T23:59:17.869 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug verify stray on activate = true 2023-07-10T23:59:17.870 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.870 INFO:teuthology.orchestra.run.smithi038.stdout: osd open classes on start = true 2023-07-10T23:59:17.870 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug pg log writeout = true 2023-07-10T23:59:17.870 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.870 INFO:teuthology.orchestra.run.smithi038.stdout: osd deep scrub update digest min age = 30 2023-07-10T23:59:17.870 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.870 INFO:teuthology.orchestra.run.smithi038.stdout: osd map max advance = 10 2023-07-10T23:59:17.871 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.871 INFO:teuthology.orchestra.run.smithi038.stdout: journal zero on create = true 2023-07-10T23:59:17.871 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.871 INFO:teuthology.orchestra.run.smithi038.stdout: filestore ondisk finisher threads = 3 2023-07-10T23:59:17.871 INFO:teuthology.orchestra.run.smithi038.stdout: filestore apply finisher threads = 3 2023-07-10T23:59:17.871 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.871 INFO:teuthology.orchestra.run.smithi038.stdout: bdev debug aio = true 2023-07-10T23:59:17.871 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug misdirected ops = true 2023-07-10T23:59:17.872 INFO:teuthology.orchestra.run.smithi038.stdout: bdev async discard = True 2023-07-10T23:59:17.872 INFO:teuthology.orchestra.run.smithi038.stdout: bdev enable discard = True 2023-07-10T23:59:17.872 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore allocator = bitmap 2023-07-10T23:59:17.872 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore block size = 96636764160 2023-07-10T23:59:17.872 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore fsck on mount = True 2023-07-10T23:59:17.872 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluefs = 1/20 2023-07-10T23:59:17.873 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluestore = 1/20 2023-07-10T23:59:17.873 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-07-10T23:59:17.873 INFO:teuthology.orchestra.run.smithi038.stdout: debug osd = 20 2023-07-10T23:59:17.873 INFO:teuthology.orchestra.run.smithi038.stdout: debug rocksdb = 4/10 2023-07-10T23:59:17.873 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd backfillfull_ratio = 0.85 2023-07-10T23:59:17.873 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd full ratio = 0.9 2023-07-10T23:59:17.873 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd nearfull ratio = 0.8 2023-07-10T23:59:17.873 INFO:teuthology.orchestra.run.smithi038.stdout: osd failsafe full ratio = 0.95 2023-07-10T23:59:17.874 INFO:teuthology.orchestra.run.smithi038.stdout: osd objectstore = bluestore 2023-07-10T23:59:17.874 INFO:teuthology.orchestra.run.smithi038.stdout: osd op complaint time = 180 2023-07-10T23:59:17.874 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.874 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr] 2023-07-10T23:59:17.874 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-07-10T23:59:17.874 INFO:teuthology.orchestra.run.smithi038.stdout: debug mgr = 20 2023-07-10T23:59:17.874 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2023-07-10T23:59:17.874 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2023-07-10T23:59:17.875 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2023-07-10T23:59:17.875 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2023-07-10T23:59:17.875 INFO:teuthology.orchestra.run.smithi038.stdout: mgr/telemetry/nag = false 2023-07-10T23:59:17.875 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.875 INFO:teuthology.orchestra.run.smithi038.stdout:[mon] 2023-07-10T23:59:17.875 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-07-10T23:59:17.875 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2023-07-10T23:59:17.875 INFO:teuthology.orchestra.run.smithi038.stdout: debug paxos = 20 2023-07-10T23:59:17.876 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2023-07-10T23:59:17.876 INFO:teuthology.orchestra.run.smithi038.stdout: mon data avail warn = 5 2023-07-10T23:59:17.876 INFO:teuthology.orchestra.run.smithi038.stdout: mon mgr mkfs grace = 240 2023-07-10T23:59:17.876 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2023-07-10T23:59:17.876 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd reporter subtree level = osd 2023-07-10T23:59:17.876 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd prime pg temp = true 2023-07-10T23:59:17.876 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2023-07-10T23:59:17.876 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.877 INFO:teuthology.orchestra.run.smithi038.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-10T23:59:17.877 INFO:teuthology.orchestra.run.smithi038.stdout: auth mon ticket ttl = 660 # 11m 2023-07-10T23:59:17.877 INFO:teuthology.orchestra.run.smithi038.stdout: auth service ticket ttl = 240 # 4m 2023-07-10T23:59:17.877 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.877 INFO:teuthology.orchestra.run.smithi038.stdout: # don't complain about insecure global_id in the test suite 2023-07-10T23:59:17.877 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-10T23:59:17.877 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-10T23:59:17.878 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.878 INFO:teuthology.orchestra.run.smithi038.stdout: # 1m isn't quite enough 2023-07-10T23:59:17.878 INFO:teuthology.orchestra.run.smithi038.stdout: mon_down_mkfs_grace = 2m 2023-07-10T23:59:17.878 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.878 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_filestore_osds = false 2023-07-10T23:59:17.878 INFO:teuthology.orchestra.run.smithi038.stdout: mon op complaint time = 120 2023-07-10T23:59:17.878 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-10T23:59:17.879 INFO:teuthology.orchestra.run.smithi038.stdout:[client] 2023-07-10T23:59:17.879 INFO:teuthology.orchestra.run.smithi038.stdout: rgw cache enabled = true 2023-07-10T23:59:17.879 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable ops log = true 2023-07-10T23:59:17.879 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable usage log = true 2023-07-10T23:59:17.879 INFO:teuthology.orchestra.run.smithi038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-10T23:59:17.879 INFO:teuthology.orchestra.run.smithi038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-10T23:59:17.879 INFO:teuthology.orchestra.run.smithi038.stdout: client mount timeout = 600 2023-07-10T23:59:17.879 INFO:teuthology.orchestra.run.smithi038.stdout: debug client = 20 2023-07-10T23:59:17.880 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-07-10T23:59:17.880 INFO:teuthology.orchestra.run.smithi038.stdout: rados mon op timeout = 900 2023-07-10T23:59:17.880 INFO:teuthology.orchestra.run.smithi038.stdout: rados osd op timeout = 900 2023-07-10T23:59:17.880 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.a] 2023-07-10T23:59:17.880 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.b] 2023-07-10T23:59:17.880 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.c] 2023-07-10T23:59:17.881 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2023-07-10T23:59:17.881 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.c] 2023-07-10T23:59:17.881 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b] 2023-07-10T23:59:17.881 INFO:teuthology.orchestra.run.smithi038.stdout:[mds] 2023-07-10T23:59:17.881 INFO:teuthology.orchestra.run.smithi038.stdout: debug mds = 20 2023-07-10T23:59:17.881 INFO:teuthology.orchestra.run.smithi038.stdout: debug mds balancer = 20 2023-07-10T23:59:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-07-10T23:59:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: mds debug frag = True 2023-07-10T23:59:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: mds debug scatterstat = True 2023-07-10T23:59:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: mds op complaint time = 180 2023-07-10T23:59:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: mds verify scatter = True 2023-07-10T23:59:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: osd op complaint time = 180 2023-07-10T23:59:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: rados mon op timeout = 900 2023-07-10T23:59:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: rados osd op timeout = 900 2023-07-10T23:59:17.884 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2023-07-10T23:59:17.884 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2023-07-10T23:59:17.884 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-10T23:59:17.884 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2023-07-10T23:59:17.884 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.884 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2023-07-10T23:59:17.885 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.885 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2023-07-10T23:59:17.885 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.885 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2023-07-10T23:59:17.885 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2023-07-10T23:59:17.885 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.885 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2023-07-10T23:59:17.885 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2023-07-10T23:59:17.886 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.886 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-10T23:59:17.886 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2023-07-10T23:59:17.886 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.886 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2023-07-10T23:59:17.886 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-10T23:59:17.886 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.887 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2023-07-10T23:59:17.887 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.887 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2023-07-10T23:59:17.887 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2023-07-10T23:59:17.888 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2023-07-10T23:59:17.888 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2023-07-10T23:59:17.888 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2023-07-10T23:59:17.888 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2023-07-10T23:59:17.888 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2023-07-10T23:59:17.888 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-10T23:59:17.888 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-10T23:59:17.889 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2023-07-10T23:59:17.889 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.889 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-10T23:59:17.889 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.889 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2023-07-10T23:59:17.889 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.889 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2023-07-10T23:59:17.889 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.890 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2023-07-10T23:59:17.890 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2023-07-10T23:59:17.890 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2023-07-10T23:59:17.890 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.38,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]" 2023-07-10T23:59:17.890 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn min per osd = 0 2023-07-10T23:59:17.891 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on skipped message = False 2023-07-10T23:59:17.891 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 712aa6bd-5b82-40dc-8d7c-7e66131fef83 2023-07-10T23:59:17.891 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.891 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2023-07-10T23:59:17.891 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2023-07-10T23:59:17.891 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.891 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2023-07-10T23:59:17.891 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2023-07-10T23:59:17.892 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2023-07-10T23:59:17.892 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.892 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2023-07-10T23:59:17.892 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2023-07-10T23:59:17.892 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.892 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2023-07-10T23:59:17.892 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2023-07-10T23:59:17.893 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2023-07-10T23:59:17.893 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.893 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2023-07-10T23:59:17.893 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2023-07-10T23:59:17.893 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.893 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2023-07-10T23:59:17.893 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.893 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2023-07-10T23:59:17.894 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.894 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2023-07-10T23:59:17.894 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.894 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2023-07-10T23:59:17.894 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2023-07-10T23:59:17.894 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.894 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2023-07-10T23:59:17.895 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2023-07-10T23:59:17.895 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2023-07-10T23:59:17.895 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2023-07-10T23:59:17.895 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore allocator = bitmap 2023-07-10T23:59:17.895 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2023-07-10T23:59:17.895 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2023-07-10T23:59:17.895 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2023-07-10T23:59:17.895 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2023-07-10T23:59:17.896 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-07-10T23:59:17.896 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2023-07-10T23:59:17.896 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2023-07-10T23:59:17.896 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2023-07-10T23:59:17.896 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2023-07-10T23:59:17.897 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2023-07-10T23:59:17.897 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2023-07-10T23:59:17.897 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2023-07-10T23:59:17.897 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2023-07-10T23:59:17.897 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.897 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2023-07-10T23:59:17.897 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-07-10T23:59:17.898 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2023-07-10T23:59:17.898 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2023-07-10T23:59:17.898 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2023-07-10T23:59:17.898 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2023-07-10T23:59:17.898 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2023-07-10T23:59:17.898 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2023-07-10T23:59:17.899 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.899 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2023-07-10T23:59:17.899 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-07-10T23:59:17.899 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2023-07-10T23:59:17.899 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2023-07-10T23:59:17.899 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2023-07-10T23:59:17.899 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2023-07-10T23:59:17.899 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2023-07-10T23:59:17.900 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2023-07-10T23:59:17.900 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2023-07-10T23:59:17.900 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2023-07-10T23:59:17.900 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2023-07-10T23:59:17.900 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.900 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-10T23:59:17.901 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2023-07-10T23:59:17.901 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2023-07-10T23:59:17.901 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.901 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2023-07-10T23:59:17.901 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-10T23:59:17.901 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-10T23:59:17.902 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.902 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2023-07-10T23:59:17.902 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2023-07-10T23:59:17.902 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.902 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2023-07-10T23:59:17.902 INFO:teuthology.orchestra.run.smithi070.stdout: mon op complaint time = 120 2023-07-10T23:59:17.902 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-10T23:59:17.903 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2023-07-10T23:59:17.903 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2023-07-10T23:59:17.903 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2023-07-10T23:59:17.903 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2023-07-10T23:59:17.903 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-10T23:59:17.903 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-10T23:59:17.903 INFO:teuthology.orchestra.run.smithi070.stdout: client mount timeout = 600 2023-07-10T23:59:17.904 INFO:teuthology.orchestra.run.smithi070.stdout: debug client = 20 2023-07-10T23:59:17.904 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-07-10T23:59:17.904 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2023-07-10T23:59:17.904 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2023-07-10T23:59:17.904 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2023-07-10T23:59:17.904 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2023-07-10T23:59:17.904 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2023-07-10T23:59:17.905 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2023-07-10T23:59:17.905 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c] 2023-07-10T23:59:17.905 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2023-07-10T23:59:17.905 INFO:teuthology.orchestra.run.smithi070.stdout:[mds] 2023-07-10T23:59:17.905 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds = 20 2023-07-10T23:59:17.905 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds balancer = 20 2023-07-10T23:59:17.905 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-07-10T23:59:17.906 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug frag = True 2023-07-10T23:59:17.906 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug scatterstat = True 2023-07-10T23:59:17.906 INFO:teuthology.orchestra.run.smithi070.stdout: mds op complaint time = 180 2023-07-10T23:59:17.906 INFO:teuthology.orchestra.run.smithi070.stdout: mds verify scatter = True 2023-07-10T23:59:17.906 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2023-07-10T23:59:17.906 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2023-07-10T23:59:17.906 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2023-07-10T23:59:17.937 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2023-07-10T23:59:17.937 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2023-07-10T23:59:17.937 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-10T23:59:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2023-07-10T23:59:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2023-07-10T23:59:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2023-07-10T23:59:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2023-07-10T23:59:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2023-07-10T23:59:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2023-07-10T23:59:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2023-07-10T23:59:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-10T23:59:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2023-07-10T23:59:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2023-07-10T23:59:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-10T23:59:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2023-07-10T23:59:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2023-07-10T23:59:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2023-07-10T23:59:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2023-07-10T23:59:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2023-07-10T23:59:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2023-07-10T23:59:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2023-07-10T23:59:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2023-07-10T23:59:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-10T23:59:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-10T23:59:17.942 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2023-07-10T23:59:17.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.942 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-10T23:59:17.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.943 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2023-07-10T23:59:17.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.943 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2023-07-10T23:59:17.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.944 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2023-07-10T23:59:17.944 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2023-07-10T23:59:17.945 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2023-07-10T23:59:17.945 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.38,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]" 2023-07-10T23:59:17.945 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn min per osd = 0 2023-07-10T23:59:17.946 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on skipped message = False 2023-07-10T23:59:17.946 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = 712aa6bd-5b82-40dc-8d7c-7e66131fef83 2023-07-10T23:59:17.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.946 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2023-07-10T23:59:17.947 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2023-07-10T23:59:17.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.947 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2023-07-10T23:59:17.948 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2023-07-10T23:59:17.948 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2023-07-10T23:59:17.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.948 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2023-07-10T23:59:17.949 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2023-07-10T23:59:17.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.949 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2023-07-10T23:59:17.949 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2023-07-10T23:59:17.949 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2023-07-10T23:59:17.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.950 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2023-07-10T23:59:17.950 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2023-07-10T23:59:17.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.951 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2023-07-10T23:59:17.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.951 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2023-07-10T23:59:17.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.952 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2023-07-10T23:59:17.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.952 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2023-07-10T23:59:17.952 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2023-07-10T23:59:17.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2023-07-10T23:59:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2023-07-10T23:59:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: bdev async discard = True 2023-07-10T23:59:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: bdev enable discard = True 2023-07-10T23:59:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore allocator = bitmap 2023-07-10T23:59:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2023-07-10T23:59:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2023-07-10T23:59:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 1/20 2023-07-10T23:59:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 1/20 2023-07-10T23:59:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-07-10T23:59:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2023-07-10T23:59:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 4/10 2023-07-10T23:59:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2023-07-10T23:59:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2023-07-10T23:59:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2023-07-10T23:59:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2023-07-10T23:59:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2023-07-10T23:59:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-07-10T23:59:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.955 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2023-07-10T23:59:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-07-10T23:59:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2023-07-10T23:59:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-07-10T23:59:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-07-10T23:59:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-07-10T23:59:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-07-10T23:59:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2023-07-10T23:59:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.956 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2023-07-10T23:59:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-07-10T23:59:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-07-10T23:59:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2023-07-10T23:59:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-07-10T23:59:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2023-07-10T23:59:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2023-07-10T23:59:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-07-10T23:59:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2023-07-10T23:59:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2023-07-10T23:59:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-07-10T23:59:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-10T23:59:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2023-07-10T23:59:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2023-07-10T23:59:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2023-07-10T23:59:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-10T23:59:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-10T23:59:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2023-07-10T23:59:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2023-07-10T23:59:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2023-07-10T23:59:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: mon op complaint time = 120 2023-07-10T23:59:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-10T23:59:17.960 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2023-07-10T23:59:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2023-07-10T23:59:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2023-07-10T23:59:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2023-07-10T23:59:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-10T23:59:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-10T23:59:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 600 2023-07-10T23:59:17.961 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2023-07-10T23:59:17.961 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-07-10T23:59:17.961 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-07-10T23:59:17.961 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-07-10T23:59:17.961 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2023-07-10T23:59:17.961 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2023-07-10T23:59:17.961 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2023-07-10T23:59:17.961 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2023-07-10T23:59:17.962 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2023-07-10T23:59:17.962 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2023-07-10T23:59:17.962 INFO:teuthology.orchestra.run.smithi131.stdout:[mds] 2023-07-10T23:59:17.962 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds = 20 2023-07-10T23:59:17.962 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds balancer = 20 2023-07-10T23:59:17.962 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-07-10T23:59:17.962 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug frag = True 2023-07-10T23:59:17.962 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug scatterstat = True 2023-07-10T23:59:17.963 INFO:teuthology.orchestra.run.smithi131.stdout: mds op complaint time = 180 2023-07-10T23:59:17.963 INFO:teuthology.orchestra.run.smithi131.stdout: mds verify scatter = True 2023-07-10T23:59:17.963 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-07-10T23:59:17.963 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-07-10T23:59:17.963 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-07-10T23:59:17.964 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-10T23:59:17.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-10T23:59:18.024 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-10T23:59:18.025 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:18.025 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-10T23:59:18.043 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:18.043 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-10T23:59:18.101 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi038.front.sepia.ceph.com 2023-07-10T23:59:18.101 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:18.101 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-10T23:59:18.102 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-10T23:59:18.177 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:18.178 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:18.235 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2023-07-10T23:59:18.235 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:18.236 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-10T23:59:18.236 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-10T23:59:18.273 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:18.274 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:18.330 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2023-07-10T23:59:18.331 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-10T23:59:18.331 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-10T23:59:18.331 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-10T23:59:18.431 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-10T23:59:18.431 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:18.516 INFO:tasks.ceph:Setting up mon nodes... 2023-07-10T23:59:18.516 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-10T23:59:18.517 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-10T23:59:18.573 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-10T23:59:18.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-10T23:59:18.644 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-10T23:59:18.700 INFO:tasks.ceph:Setting up mds nodes... 2023-07-10T23:59:18.701 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-10T23:59:18.757 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-10T23:59:18.759 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-10T23:59:18.786 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-10T23:59:18.881 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-10T23:59:18.884 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-10T23:59:18.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-10T23:59:18.965 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-10T23:59:18.967 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-10T23:59:18.994 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-10T23:59:18.995 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-10T23:59:19.099 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-10T23:59:19.131 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-10T23:59:19.131 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-10T23:59:19.132 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-10T23:59:19.160 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-10T23:59:19.161 INFO:tasks.ceph:role: osd.0 2023-07-10T23:59:19.161 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com 2023-07-10T23:59:19.161 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-10T23:59:19.256 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-10T23:59:19.256 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-10T23:59:19.256 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-10T23:59:19.256 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-10T23:59:19.257 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-10T23:59:19.257 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-07-10T23:59:19.257 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-10T23:59:19.257 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-10T23:59:19.257 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-10T23:59:19.258 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-10T23:59:20.558 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-07-10T23:59:20.560 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-07-10T23:59:20.561 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-10T23:59:20.612 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-10T23:59:20.648 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-10T23:59:20.718 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-10T23:59:20.719 INFO:tasks.ceph:role: osd.1 2023-07-10T23:59:20.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com 2023-07-10T23:59:20.719 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-10T23:59:20.816 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-10T23:59:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-10T23:59:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-10T23:59:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-10T23:59:20.816 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-10T23:59:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-07-10T23:59:20.817 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-10T23:59:20.817 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-10T23:59:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-10T23:59:20.817 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-10T23:59:22.099 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-07-10T23:59:22.101 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-07-10T23:59:22.102 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-10T23:59:22.153 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-10T23:59:22.188 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-10T23:59:22.259 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-10T23:59:22.259 INFO:tasks.ceph:role: osd.2 2023-07-10T23:59:22.260 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com 2023-07-10T23:59:22.260 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-10T23:59:22.357 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-10T23:59:22.357 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-10T23:59:22.358 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-10T23:59:22.358 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-10T23:59:22.358 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-10T23:59:22.358 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-07-10T23:59:22.358 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-10T23:59:22.358 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-10T23:59:22.358 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-10T23:59:22.358 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-10T23:59:23.639 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-07-10T23:59:23.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-07-10T23:59:23.642 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-10T23:59:23.691 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-10T23:59:23.726 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-10T23:59:23.797 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-10T23:59:23.797 INFO:tasks.ceph:role: osd.3 2023-07-10T23:59:23.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com 2023-07-10T23:59:23.797 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-10T23:59:23.894 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-10T23:59:23.894 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-10T23:59:23.894 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-10T23:59:23.894 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-10T23:59:23.894 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-10T23:59:23.895 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-07-10T23:59:23.895 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-10T23:59:23.895 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-10T23:59:23.895 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-10T23:59:23.895 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-10T23:59:25.176 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-07-10T23:59:25.178 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-07-10T23:59:25.178 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-10T23:59:25.229 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-10T23:59:25.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:25.355+0000 7fd12b736640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-10T23:59:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:25.355+0000 7fd12b736640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-10T23:59:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:25.355+0000 7fd12b736640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-10T23:59:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:25.355+0000 7fd12b736640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-10T23:59:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:25.355+0000 7fd12b736640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-10T23:59:25.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:25.356+0000 7fd12b736640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-10T23:59:28.230 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-10T23:59:28.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:28.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:28.357+0000 7fb4ef6bd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-10T23:59:28.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:28.357+0000 7fb4ef6bd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-10T23:59:28.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:28.357+0000 7fb4ef6bd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-10T23:59:28.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:28.357+0000 7fb4ef6bd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-10T23:59:28.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:28.357+0000 7fb4ef6bd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-10T23:59:28.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:28.358+0000 7fb4ef6bd640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-10T23:59:31.228 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-10T23:59:31.262 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:31.353+0000 7fc7493c0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-10T23:59:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:31.354+0000 7fc7493c0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-10T23:59:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:31.354+0000 7fc7493c0640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-10T23:59:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:31.354+0000 7fc7493c0640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-10T23:59:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:31.354+0000 7fc7493c0640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-10T23:59:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:31.355+0000 7fc7493c0640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-10T23:59:34.234 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-10T23:59:34.269 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:34.362+0000 7f19f4114640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-10T23:59:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:34.363+0000 7f19f4114640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-10T23:59:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:34.363+0000 7f19f4114640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-10T23:59:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:34.363+0000 7f19f4114640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-10T23:59:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:34.363+0000 7f19f4114640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-10T23:59:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:34.363+0000 7f19f4114640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-10T23:59:37.224 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-10T23:59:37.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-10T23:59:37.291 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-10T23:59:37.292 INFO:tasks.ceph:role: osd.4 2023-07-10T23:59:37.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2023-07-10T23:59:37.292 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-10T23:59:37.363 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-10T23:59:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-10T23:59:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-10T23:59:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-10T23:59:37.363 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-10T23:59:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-07-10T23:59:37.364 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-10T23:59:37.364 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-10T23:59:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-10T23:59:37.364 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-10T23:59:37.386 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-07-10T23:59:37.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-07-10T23:59:37.391 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-10T23:59:37.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-10T23:59:37.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-10T23:59:37.615 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-10T23:59:37.616 INFO:tasks.ceph:role: osd.5 2023-07-10T23:59:37.616 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2023-07-10T23:59:37.617 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-10T23:59:37.683 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-10T23:59:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-10T23:59:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-10T23:59:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-10T23:59:37.684 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-10T23:59:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-07-10T23:59:37.684 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-10T23:59:37.684 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-10T23:59:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-10T23:59:37.685 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-10T23:59:37.706 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-07-10T23:59:37.707 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-07-10T23:59:37.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-10T23:59:37.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-10T23:59:37.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-10T23:59:37.926 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-10T23:59:37.927 INFO:tasks.ceph:role: osd.6 2023-07-10T23:59:37.927 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2023-07-10T23:59:37.928 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-10T23:59:37.993 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-10T23:59:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-10T23:59:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-10T23:59:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-10T23:59:37.994 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-10T23:59:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-07-10T23:59:37.995 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-10T23:59:37.995 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-10T23:59:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-10T23:59:37.996 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-10T23:59:38.016 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-07-10T23:59:38.018 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-07-10T23:59:38.018 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-10T23:59:38.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-10T23:59:38.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-10T23:59:38.234 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-10T23:59:38.234 INFO:tasks.ceph:role: osd.7 2023-07-10T23:59:38.234 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2023-07-10T23:59:38.235 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-10T23:59:38.300 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-10T23:59:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-10T23:59:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-10T23:59:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-10T23:59:38.301 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-10T23:59:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-07-10T23:59:38.301 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-10T23:59:38.302 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-10T23:59:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-10T23:59:38.302 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-10T23:59:38.323 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-07-10T23:59:38.324 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-07-10T23:59:38.325 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-10T23:59:38.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-10T23:59:38.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:38.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:38.560+0000 7f2d042fa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-10T23:59:38.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:38.560+0000 7f2d042fa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-10T23:59:38.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:38.560+0000 7f2d042fa640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-10T23:59:38.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:38.560+0000 7f2d042fa640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-10T23:59:38.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:38.560+0000 7f2d042fa640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-10T23:59:38.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:38.560+0000 7f2d042fa640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-10T23:59:41.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-10T23:59:41.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:41.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:41.524+0000 7f9066c43640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-10T23:59:41.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:41.524+0000 7f9066c43640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-10T23:59:41.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:41.524+0000 7f9066c43640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-10T23:59:41.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:41.524+0000 7f9066c43640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-10T23:59:41.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:41.524+0000 7f9066c43640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-10T23:59:41.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:41.525+0000 7f9066c43640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-10T23:59:44.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-10T23:59:44.406 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:44.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:44.496+0000 7fbd35265640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-10T23:59:44.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:44.496+0000 7fbd35265640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-10T23:59:44.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:44.496+0000 7fbd35265640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-10T23:59:44.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:44.496+0000 7fbd35265640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-10T23:59:44.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:44.496+0000 7fbd35265640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-10T23:59:44.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:44.496+0000 7fbd35265640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-10T23:59:45.711 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-10T23:59:45.713 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-10T23:59:45.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-10T23:59:47.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-10T23:59:47.384 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:47.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:47.472+0000 7f3c24683640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-10T23:59:47.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:47.473+0000 7f3c24683640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-10T23:59:47.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:47.473+0000 7f3c24683640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-10T23:59:47.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:47.473+0000 7f3c24683640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-10T23:59:47.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:47.473+0000 7f3c24683640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-10T23:59:47.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:47.473+0000 7f3c24683640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-10T23:59:50.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-10T23:59:50.352 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-10T23:59:50.353 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:50.353 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-10T23:59:50.387 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:50.388 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-10T23:59:50.458 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:50.459 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-10T23:59:50.528 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:50.529 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-10T23:59:50.599 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:50.599 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-10T23:59:50.668 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:50.669 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-10T23:59:50.737 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:50.738 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-10T23:59:50.806 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:50.807 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-10T23:59:50.839 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:50.840 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-10T23:59:50.911 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:50.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-10T23:59:50.981 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:50.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-10T23:59:51.050 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:51.050 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-10T23:59:51.118 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:51.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-10T23:59:51.187 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-10T23:59:51.187 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-10T23:59:51.237 INFO:tasks.ceph:Adding keys to all mons... 2023-07-10T23:59:51.237 DEBUG:teuthology.orchestra.run.smithi038:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-10T23:59:51.240 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-10T23:59:51.266 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2023-07-10T23:59:51.266 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBWm6xk5dYbIhAAQUtVeI5z3hKzqjyrdkKBGg== 2023-07-10T23:59:51.266 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2023-07-10T23:59:51.266 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBWm6xkbB8QLRAA+IQjo9ZNyYp9OGIs2tnqag== 2023-07-10T23:59:51.266 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c] 2023-07-10T23:59:51.267 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBWm6xkYD99NBAAx5BeEt4Aiz3YzqO1xA7K0Q== 2023-07-10T23:59:51.267 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2023-07-10T23:59:51.267 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBdm6xkkEk1FRAAvhNW50CDb2JTxTYd9UYxfg== 2023-07-10T23:59:51.267 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2023-07-10T23:59:51.267 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBgm6xknYRWFRAAiPrNBYnp4QYUeeaYQd1ccA== 2023-07-10T23:59:51.267 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2023-07-10T23:59:51.267 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBjm6xkltMgFRAAZCnjPeWhPMuVtpE9Dg5oqg== 2023-07-10T23:59:51.267 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2023-07-10T23:59:51.268 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBmm6xkMAqqFRAA93MscOA23FCPHGQVO+uFWA== 2023-07-10T23:59:51.268 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2023-07-10T23:59:51.268 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBWm6xkP0BeJhAAIC3BuVWuqfhP42wHBPXdjw== 2023-07-10T23:59:51.268 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2023-07-10T23:59:51.268 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBWm6xkJ3F+ORAAWiFR4khi2jq+tsviZacfAg== 2023-07-10T23:59:51.268 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2023-07-10T23:59:51.268 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBqm6xkHTZpIRAA1Ym+ij8qSYuqBpPDKH5dAg== 2023-07-10T23:59:51.269 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2023-07-10T23:59:51.269 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBtm6xkRs1VHxAAFc+RXZsL0wfXu9sOjpoEIA== 2023-07-10T23:59:51.269 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2023-07-10T23:59:51.269 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBwm6xkSLymHRAAEhCG8B5mMyral0VLsnXaPw== 2023-07-10T23:59:51.269 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2023-07-10T23:59:51.269 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBzm6xkqg5AHBAAyCqCl7EPuYidSwdtZK2brg== 2023-07-10T23:59:51.269 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2023-07-10T23:59:51.269 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBXm6xks53eBRAAIEobJD+VB3RoJP54ghJ6rw== 2023-07-10T23:59:51.271 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.y] 2023-07-10T23:59:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBWm6xk5dYbIhAAQUtVeI5z3hKzqjyrdkKBGg== 2023-07-10T23:59:51.271 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2023-07-10T23:59:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBWm6xkbB8QLRAA+IQjo9ZNyYp9OGIs2tnqag== 2023-07-10T23:59:51.271 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.c] 2023-07-10T23:59:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBWm6xkYD99NBAAx5BeEt4Aiz3YzqO1xA7K0Q== 2023-07-10T23:59:51.271 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.0] 2023-07-10T23:59:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBdm6xkkEk1FRAAvhNW50CDb2JTxTYd9UYxfg== 2023-07-10T23:59:51.272 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.1] 2023-07-10T23:59:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBgm6xknYRWFRAAiPrNBYnp4QYUeeaYQd1ccA== 2023-07-10T23:59:51.272 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.2] 2023-07-10T23:59:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBjm6xkltMgFRAAZCnjPeWhPMuVtpE9Dg5oqg== 2023-07-10T23:59:51.272 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.3] 2023-07-10T23:59:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBmm6xkMAqqFRAA93MscOA23FCPHGQVO+uFWA== 2023-07-10T23:59:51.273 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.x] 2023-07-10T23:59:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBWm6xkP0BeJhAAIC3BuVWuqfhP42wHBPXdjw== 2023-07-10T23:59:51.273 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b] 2023-07-10T23:59:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBWm6xkJ3F+ORAAWiFR4khi2jq+tsviZacfAg== 2023-07-10T23:59:51.273 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.4] 2023-07-10T23:59:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBqm6xkHTZpIRAA1Ym+ij8qSYuqBpPDKH5dAg== 2023-07-10T23:59:51.273 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.5] 2023-07-10T23:59:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBtm6xkRs1VHxAAFc+RXZsL0wfXu9sOjpoEIA== 2023-07-10T23:59:51.274 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.6] 2023-07-10T23:59:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBwm6xkSLymHRAAEhCG8B5mMyral0VLsnXaPw== 2023-07-10T23:59:51.274 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.7] 2023-07-10T23:59:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBzm6xkqg5AHBAAyCqCl7EPuYidSwdtZK2brg== 2023-07-10T23:59:51.274 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2023-07-10T23:59:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBXm6xks53eBRAAIEobJD+VB3RoJP54ghJ6rw== 2023-07-10T23:59:51.274 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-10T23:59:51.312 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-10T23:59:51.371 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-10T23:59:51.373 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-10T23:59:51.431 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-10T23:59:51.434 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-10T23:59:51.490 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.546 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.602 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.657 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.712 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-10T23:59:51.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-10T23:59:51.767 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-10T23:59:51.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-10T23:59:51.826 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.828 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.881 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.883 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.936 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.992 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:51.994 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-10T23:59:52.047 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-10T23:59:52.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-10T23:59:52.106 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-10T23:59:52.106 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-10T23:59:52.134 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-10T23:59:52.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-10T23:59:52.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-10T23:59:52.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-10T23:59:52.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-10T23:59:52.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-10T23:59:52.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-10T23:59:52.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-10T23:59:52.638 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:52.640 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-10T23:59:52.695 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-10T23:59:52.696 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-10T23:59:52.697 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-10T23:59:52.699 INFO:tasks.ceph.mon.a:Started 2023-07-10T23:59:52.699 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-10T23:59:52.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-10T23:59:52.738 INFO:tasks.ceph.mon.b:Started 2023-07-10T23:59:52.738 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-10T23:59:52.739 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-10T23:59:52.741 INFO:tasks.ceph.mon.c:Started 2023-07-10T23:59:52.741 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-10T23:59:52.742 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-10T23:59:52.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-10T23:59:52.744 INFO:tasks.ceph.mgr.y:Started 2023-07-10T23:59:52.744 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-10T23:59:52.745 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-10T23:59:52.747 INFO:tasks.ceph.mgr.x:Started 2023-07-10T23:59:52.747 INFO:tasks.ceph:Setting crush tunables to default 2023-07-10T23:59:52.748 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd crush tunables default 2023-07-10T23:59:52.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.873+0000 7fcfadb40700 1 Processor -- start 2023-07-10T23:59:52.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.873+0000 7fcfadb40700 1 -- start start 2023-07-10T23:59:52.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.873+0000 7fcfadb40700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:52.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.873+0000 7fcfadb40700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:52.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.873+0000 7fcfadb40700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa80b8620 con 0x7fcfa81449d0 2023-07-10T23:59:52.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.873+0000 7fcfadb40700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa80b97a0 con 0x7fcfa80bc810 2023-07-10T23:59:52.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.873+0000 7fcfadb40700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8144da0 con 0x7fcfa80b8d90 2023-07-10T23:59:52.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa6ffd700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:52.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa7fff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:52.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa6ffd700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:44430/0 (socket says 172.21.15.38:44430) 2023-07-10T23:59:52.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 learned_addr learned my addr 172.21.15.38:0/718042756 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-10T23:59:52.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa77fe700 1 --1- 172.21.15.38:0/718042756 >> v1:172.21.15.70:6789/0 conn(0x7fcfa81449d0 0x7fcfa814db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:51882/0 (socket says 172.21.15.38:51882) 2023-07-10T23:59:52.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 msgr2=0x7fcfa80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-10T23:59:52.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 msgr2=0x7fcfa80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa7fff700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 msgr2=0x7fcfa806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-10T23:59:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-10T23:59:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa7fff700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 msgr2=0x7fcfa806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:52.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:52.874+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-10T23:59:53.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.075+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:53.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.075+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:53.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.075+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 msgr2=0x7fcfa80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-10T23:59:53.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.075+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 msgr2=0x7fcfa80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:53.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.075+0000 7fcfa7fff700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 msgr2=0x7fcfa806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-10T23:59:53.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.075+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:53.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.075+0000 7fcfa7fff700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 msgr2=0x7fcfa806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.075+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.075+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-10T23:59:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.075+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-10T23:59:53.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.476+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:53.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.476+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:53.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.476+0000 7fcfa7fff700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 msgr2=0x7fcfa806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-10T23:59:53.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.476+0000 7fcfa7fff700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 msgr2=0x7fcfa806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:53.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.476+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.476+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 msgr2=0x7fcfa80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-10T23:59:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.476+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 msgr2=0x7fcfa80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.476+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.476+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-10T23:59:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:53.476+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-10T23:59:54.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:54.278+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:54.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:54.278+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:54.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:54.278+0000 7fcfa7fff700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 msgr2=0x7fcfa806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-10T23:59:54.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:54.278+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 msgr2=0x7fcfa80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-10T23:59:54.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:54.278+0000 7fcfa7fff700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 msgr2=0x7fcfa806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:54.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:54.278+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 msgr2=0x7fcfa80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:54.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:54.278+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:54.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:54.278+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:54.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:54.278+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-10T23:59:54.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:54.278+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-10T23:59:55.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa57fa700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 msgr2=0x7fcfa806ade0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-10T23:59:55.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa57fa700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcfa80b8d90 0x7fcfa806ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:55.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa57fa700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 msgr2=0x7fcfa80ba530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-10T23:59:55.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa57fa700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.70:3300/0 conn(0x7fcfa80bc810 0x7fcfa80ba530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:55.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa57fa700 1 -- 172.21.15.38:0/718042756 >> v1:172.21.15.70:6789/0 conn(0x7fcfa81449d0 legacy=0x7fcfa814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:55.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa57fa700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:55.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa57fa700 1 -- 172.21.15.38:0/718042756 --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa80b8900 con 0x7fcf94003770 2023-07-10T23:59:55.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa57fa700 1 -- 172.21.15.38:0/718042756 --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa80b97a0 con 0x7fcf94007480 2023-07-10T23:59:55.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:55.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 msgr2=0x7fcf94009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-10T23:59:55.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 msgr2=0x7fcf94009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:55.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:55.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:55.874+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-10T23:59:56.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:56.075+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:56.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:56.075+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 msgr2=0x7fcf94009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-10T23:59:56.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:56.075+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 msgr2=0x7fcf94009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:56.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:56.075+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:56.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:56.075+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-10T23:59:56.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:56.476+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:56.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:56.476+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 msgr2=0x7fcf94009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-10T23:59:56.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:56.476+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 msgr2=0x7fcf94009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:56.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:56.476+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:56.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:56.476+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-10T23:59:57.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:57.278+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:57.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:57.278+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 msgr2=0x7fcf94009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-10T23:59:57.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:57.278+0000 7fcfa6ffd700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 msgr2=0x7fcf94009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-10T23:59:57.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:57.278+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-10T23:59:57.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:57.278+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-10T23:59:58.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.064+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723332569 0 0) 0x7fcfa80b8900 con 0x7fcf94003770 2023-07-10T23:59:58.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.064+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf900035b0 con 0x7fcf94003770 2023-07-10T23:59:58.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4148555063 0 0) 0x7fcf900035b0 con 0x7fcf94003770 2023-07-10T23:59:58.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 msgr2=0x7fcf94009910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-10T23:59:58.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 --2- 172.21.15.38:0/718042756 >> v2:172.21.15.38:3300/0 conn(0x7fcf94007480 0x7fcf94009910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9400b010 con 0x7fcf94003770 2023-07-10T23:59:58.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7fcf9c0016f0 con 0x7fcf94003770 2023-07-10T23:59:58.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 >> v1:172.21.15.38:6789/0 conn(0x7fcf94003770 legacy=0x7fcf94005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:58.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa7fff700 1 -- 172.21.15.38:0/718042756 reap_dead start 2023-07-10T23:59:58.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf90003a50 0x7fcf90003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:58.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90004850 0x7fcf90004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:58.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90005400 0x7fcf9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:58.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80b97a0 con 0x7fcf90004850 2023-07-10T23:59:58.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9000c2a0 con 0x7fcf90003a50 2023-07-10T23:59:58.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9000c460 con 0x7fcf90005400 2023-07-10T23:59:58.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa77fe700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf90003a50 0x7fcf90003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:58.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.065+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90004850 0x7fcf90004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:58.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.066+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90005400 0x7fcf9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:58.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.066+0000 7fcfa77fe700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90005400 msgr2=0x7fcf9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-10T23:59:58.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.066+0000 7fcfa77fe700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90005400 0x7fcf9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.066+0000 7fcfa77fe700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90004850 msgr2=0x7fcf90004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-10T23:59:58.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.066+0000 7fcfa77fe700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90004850 0x7fcf90004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.066+0000 7fcfa77fe700 1 -- 172.21.15.38:0/718042756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900035b0 con 0x7fcf90003a50 2023-07-10T23:59:58.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.066+0000 7fcfa6ffd700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90004850 0x7fcf90004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-10T23:59:58.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.066+0000 7fcfa77fe700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf90003a50 0x7fcf90003e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c190 tx=0x7fcf90005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64f9ca6982ca2ed1 server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:58.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.066+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c007ab0 con 0x7fcf90003a50 2023-07-10T23:59:58.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.067+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c00ccf0 con 0x7fcf90003a50 2023-07-10T23:59:58.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.067+0000 7fcfa67fc700 1 -- 172.21.15.38:0/718042756 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c005ae0 con 0x7fcf90003a50 2023-07-10T23:59:58.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.068+0000 7fcfadb40700 1 -- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf90003a50 msgr2=0x7fcf90003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:58.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.068+0000 7fcfadb40700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf90003a50 0x7fcf90003e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c190 tx=0x7fcf90005880 comp rx=0 tx=0).stop 2023-07-10T23:59:58.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.068+0000 7fcfadb40700 1 -- 172.21.15.38:0/718042756 shutdown_connections 2023-07-10T23:59:58.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.068+0000 7fcfadb40700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90005400 0x7fcf9000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.068+0000 7fcfadb40700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90004850 0x7fcf90004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.068+0000 7fcfadb40700 1 --2- 172.21.15.38:0/718042756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf90003a50 0x7fcf90003e40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.068+0000 7fcfadb40700 1 -- 172.21.15.38:0/718042756 >> 172.21.15.38:0/718042756 conn(0x7fcfa80c0860 msgr2=0x7fcfa80c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:58.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.068+0000 7fcfadb40700 1 -- 172.21.15.38:0/718042756 shutdown_connections 2023-07-10T23:59:58.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.068+0000 7fcfadb40700 1 -- 172.21.15.38:0/718042756 wait complete. 2023-07-10T23:59:58.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.069+0000 7fcfadb40700 1 Processor -- start 2023-07-10T23:59:58.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.070+0000 7fcfadb40700 1 -- start start 2023-07-10T23:59:58.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfadb40700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90003a50 0x7fcfa81d5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:58.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfadb40700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf90004850 0x7fcfa81df450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:58.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfadb40700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90005400 0x7fcfa80a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:58.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfadb40700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81d5760 con 0x7fcf90005400 2023-07-10T23:59:58.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfadb40700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa814a350 con 0x7fcf90004850 2023-07-10T23:59:58.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfadb40700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa814b280 con 0x7fcf90003a50 2023-07-10T23:59:58.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90003a50 0x7fcfa81d5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:58.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfa7fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90005400 0x7fcfa80a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:58.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90003a50 0x7fcfa81d5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:55020/0 (socket says 172.21.15.38:55020) 2023-07-10T23:59:58.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfa77fe700 1 -- 172.21.15.38:0/1043631933 learned_addr learned my addr 172.21.15.38:0/1043631933 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-10T23:59:58.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfa6ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf90004850 0x7fcfa81df450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:58.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfa77fe700 1 -- 172.21.15.38:0/1043631933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf90004850 msgr2=0x7fcfa81df450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:58.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfa77fe700 1 --2- 172.21.15.38:0/1043631933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf90004850 0x7fcfa81df450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfa77fe700 1 -- 172.21.15.38:0/1043631933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90005400 msgr2=0x7fcfa80a6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:58.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfa77fe700 1 --2- 172.21.15.38:0/1043631933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90005400 0x7fcfa80a6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfa77fe700 1 -- 172.21.15.38:0/1043631933 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa814cca0 con 0x7fcf90003a50 2023-07-10T23:59:58.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.071+0000 7fcfa7fff700 1 --2- 172.21.15.38:0/1043631933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90005400 0x7fcfa80a6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-10T23:59:58.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.072+0000 7fcfa77fe700 1 --2- 172.21.15.38:0/1043631933 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90003a50 0x7fcfa81d5220 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c011000 tx=0x7fcf9c001910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:58.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.072+0000 7fcf8ffff700 1 -- 172.21.15.38:0/1043631933 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00ce60 con 0x7fcf90003a50 2023-07-10T23:59:58.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.072+0000 7fcfadb40700 1 -- 172.21.15.38:0/1043631933 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa814cf80 con 0x7fcf90003a50 2023-07-10T23:59:58.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.072+0000 7fcf8ffff700 1 -- 172.21.15.38:0/1043631933 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c00caf0 con 0x7fcf90003a50 2023-07-10T23:59:58.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.072+0000 7fcf8ffff700 1 -- 172.21.15.38:0/1043631933 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0072f0 con 0x7fcf90003a50 2023-07-10T23:59:58.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.072+0000 7fcfadb40700 1 -- 172.21.15.38:0/1043631933 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa814d780 con 0x7fcf90003a50 2023-07-10T23:59:58.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.073+0000 7fcf8ffff700 1 -- 172.21.15.38:0/1043631933 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcf9c01d420 con 0x7fcf90003a50 2023-07-10T23:59:58.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.073+0000 7fcf8ffff700 1 -- 172.21.15.38:0/1043631933 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcf9c026410 con 0x7fcf90003a50 2023-07-10T23:59:58.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.073+0000 7fcfadb40700 1 -- 172.21.15.38:0/1043631933 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa814d4a0 con 0x7fcf90003a50 2023-07-10T23:59:58.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.076+0000 7fcf8ffff700 1 -- 172.21.15.38:0/1043631933 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fcfa814d4a0 con 0x7fcf90003a50 2023-07-10T23:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.156+0000 7fcfadb40700 1 -- 172.21.15.38:0/1043631933 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcfa8074360 con 0x7fcf90003a50 2023-07-10T23:59:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.161+0000 7fcf8ffff700 1 -- 172.21.15.38:0/1043631933 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcf9c02b060 con 0x7fcf90003a50 2023-07-10T23:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.162+0000 7fcfadb40700 1 -- 172.21.15.38:0/1043631933 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90003a50 msgr2=0x7fcfa81d5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.162+0000 7fcfadb40700 1 --2- 172.21.15.38:0/1043631933 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90003a50 0x7fcfa81d5220 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c011000 tx=0x7fcf9c001910 comp rx=0 tx=0).stop 2023-07-10T23:59:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.162+0000 7fcfadb40700 1 -- 172.21.15.38:0/1043631933 shutdown_connections 2023-07-10T23:59:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.162+0000 7fcfadb40700 1 --2- 172.21.15.38:0/1043631933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf90005400 0x7fcfa80a6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.162+0000 7fcfadb40700 1 --2- 172.21.15.38:0/1043631933 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf90003a50 0x7fcfa81d5220 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.162+0000 7fcfadb40700 1 --2- 172.21.15.38:0/1043631933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf90004850 0x7fcfa81df450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.162+0000 7fcfadb40700 1 -- 172.21.15.38:0/1043631933 >> 172.21.15.38:0/1043631933 conn(0x7fcfa80c0860 msgr2=0x7fcfa80bfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.162+0000 7fcfadb40700 1 -- 172.21.15.38:0/1043631933 shutdown_connections 2023-07-10T23:59:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-10T23:59:58.162+0000 7fcfadb40700 1 -- 172.21.15.38:0/1043631933 wait complete. 2023-07-10T23:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2023-07-10T23:59:58.178 INFO:tasks.ceph:check_enable_crimson: False 2023-07-10T23:59:58.178 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-10T23:59:58.178 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:58.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-10T23:59:58.197 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-10T23:59:58.195+0000 7fef764e2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-10T23:59:58.207 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-10T23:59:58.204+0000 7f9338cc5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-10T23:59:58.208 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:58.208 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-10T23:59:58.276 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:58.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-10T23:59:58.368 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-10T23:59:58.366+0000 7fef764e2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-10T23:59:58.381 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-07-10T23:59:58.381 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-10T23:59:58.396 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-10T23:59:58.393+0000 7f9338cc5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-10T23:59:58.424 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:58.425 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-10T23:59:58.453 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:58.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-10T23:59:58.519 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:58.520 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-10T23:59:58.586 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-10T23:59:58.587 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-10T23:59:58.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 7a365f14-620e-4c76-9c26-d6f7631dee8d 0 2023-07-10T23:59:58.768 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-10T23:59:58.765+0000 7f9338cc5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-10T23:59:58.769 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-10T23:59:58.767+0000 7fef764e2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-10T23:59:58.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.817+0000 7f8a7c112700 1 Processor -- start 2023-07-10T23:59:58.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.817+0000 7f8a7c112700 1 -- start start 2023-07-10T23:59:58.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a7c112700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8a74071910 0x7f8a74070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:58.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a7c112700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8a7406bce0 0x7f8a74155260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:58.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a7c112700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a740701a0 con 0x7f8a7414b510 2023-07-10T23:59:58.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a7c112700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7414b970 con 0x7f8a7406bce0 2023-07-10T23:59:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a7c112700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a740713d0 con 0x7f8a74071910 2023-07-10T23:59:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a79eae700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8a74071910 0x7f8a74070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a796ad700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f8a7414b510 0x7f8a7406c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34240/0 (socket says 172.21.15.70:34240) 2023-07-10T23:59:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a79eae700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8a74071910 0x7f8a74070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35930/0 (socket says 172.21.15.70:35930) 2023-07-10T23:59:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a796ad700 1 -- 172.21.15.70:0/2243317066 learned_addr learned my addr 172.21.15.70:0/2243317066 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-07-10T23:59:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a7a6af700 1 --2- 172.21.15.70:0/2243317066 >> v2:172.21.15.38:3300/0 conn(0x7f8a7406bce0 0x7f8a74155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a79eae700 1 -- 172.21.15.70:0/2243317066 >> v2:172.21.15.38:3300/0 conn(0x7f8a7406bce0 msgr2=0x7f8a74155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-10T23:59:58.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a79eae700 1 --2- 172.21.15.70:0/2243317066 >> v2:172.21.15.38:3300/0 conn(0x7f8a7406bce0 0x7f8a74155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a79eae700 1 -- 172.21.15.70:0/2243317066 >> v1:172.21.15.70:6789/0 conn(0x7f8a7414b510 legacy=0x7f8a7406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:58.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a79eae700 1 -- 172.21.15.70:0/2243317066 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7414aa30 con 0x7f8a74071910 2023-07-10T23:59:58.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.818+0000 7f8a78eac700 1 -- 172.21.15.70:0/2243317066 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549814761 0 0) 0x7f8a740701a0 con 0x7f8a7414b510 2023-07-10T23:59:58.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a79eae700 1 --2- 172.21.15.70:0/2243317066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a74071910 0x7f8a74070d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8a740674f0 tx=0x7f8a70009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc7d9878e1576039 server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:58.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a78eac700 1 -- 172.21.15.70:0/2243317066 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70011830 con 0x7f8a74071910 2023-07-10T23:59:58.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a78eac700 1 -- 172.21.15.70:0/2243317066 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a70011990 con 0x7f8a74071910 2023-07-10T23:59:58.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a78eac700 1 -- 172.21.15.70:0/2243317066 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70011d20 con 0x7f8a74071910 2023-07-10T23:59:58.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a7c112700 1 -- 172.21.15.70:0/2243317066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a74071910 msgr2=0x7f8a74070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a7c112700 1 --2- 172.21.15.70:0/2243317066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a74071910 0x7f8a74070d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8a740674f0 tx=0x7f8a70009b20 comp rx=0 tx=0).stop 2023-07-10T23:59:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a7c112700 1 -- 172.21.15.70:0/2243317066 shutdown_connections 2023-07-10T23:59:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a7c112700 1 --2- 172.21.15.70:0/2243317066 >> v2:172.21.15.38:3300/0 conn(0x7f8a7406bce0 0x7f8a74155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a7c112700 1 --2- 172.21.15.70:0/2243317066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a74071910 0x7f8a74070d80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a7c112700 1 -- 172.21.15.70:0/2243317066 >> 172.21.15.70:0/2243317066 conn(0x7f8a740be670 msgr2=0x7f8a740bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a7c112700 1 -- 172.21.15.70:0/2243317066 shutdown_connections 2023-07-10T23:59:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.819+0000 7f8a7c112700 1 -- 172.21.15.70:0/2243317066 wait complete. 2023-07-10T23:59:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.820+0000 7f8a7c112700 1 Processor -- start 2023-07-10T23:59:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a7c112700 1 -- start start 2023-07-10T23:59:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a7c112700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a7406bce0 0x7f8a740b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a7c112700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8a74071910 0x7f8a740b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a7c112700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7414b510 0x7f8a740acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a7c112700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740b2f80 con 0x7f8a7406bce0 2023-07-10T23:59:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a7c112700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740b3260 con 0x7f8a7414b510 2023-07-10T23:59:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a7c112700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740b5180 con 0x7f8a74071910 2023-07-10T23:59:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a796ad700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8a74071910 0x7f8a740b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a7a6af700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7414b510 0x7f8a740acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a7a6af700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7414b510 0x7f8a740acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35934/0 (socket says 172.21.15.70:35934) 2023-07-10T23:59:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a796ad700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8a74071910 0x7f8a740b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:40408/0 (socket says 172.21.15.70:40408) 2023-07-10T23:59:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a7a6af700 1 -- 172.21.15.70:0/1899435116 learned_addr learned my addr 172.21.15.70:0/1899435116 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-10T23:59:58.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.821+0000 7f8a79eae700 1 --2- 172.21.15.70:0/1899435116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a7406bce0 0x7f8a740b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:58.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a7a6af700 1 -- 172.21.15.70:0/1899435116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8a74071910 msgr2=0x7f8a740b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:58.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a7a6af700 1 --2- 172.21.15.70:0/1899435116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8a74071910 0x7f8a740b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a7a6af700 1 -- 172.21.15.70:0/1899435116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a7406bce0 msgr2=0x7f8a740b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:58.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a7a6af700 1 --2- 172.21.15.70:0/1899435116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a7406bce0 0x7f8a740b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a7a6af700 1 -- 172.21.15.70:0/1899435116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700094a0 con 0x7f8a7414b510 2023-07-10T23:59:58.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a79eae700 1 --2- 172.21.15.70:0/1899435116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a7406bce0 0x7f8a740b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-10T23:59:58.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a7a6af700 1 --2- 172.21.15.70:0/1899435116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7414b510 0x7f8a740acb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00efc0 tx=0x7f8a6c00c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:58.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a6a7fc700 1 -- 172.21.15.70:0/1899435116 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00cad0 con 0x7f8a7414b510 2023-07-10T23:59:58.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a6a7fc700 1 -- 172.21.15.70:0/1899435116 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c00f040 con 0x7f8a7414b510 2023-07-10T23:59:58.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a6a7fc700 1 -- 172.21.15.70:0/1899435116 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00ce70 con 0x7f8a7414b510 2023-07-10T23:59:58.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a7c112700 1 -- 172.21.15.70:0/1899435116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a740b21a0 con 0x7f8a7414b510 2023-07-10T23:59:58.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.822+0000 7f8a7c112700 1 -- 172.21.15.70:0/1899435116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a740b1730 con 0x7f8a7414b510 2023-07-10T23:59:58.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.823+0000 7f8a6a7fc700 1 -- 172.21.15.70:0/1899435116 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8a6c014780 con 0x7f8a7414b510 2023-07-10T23:59:58.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.823+0000 7f8a6a7fc700 1 -- 172.21.15.70:0/1899435116 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8a6c01d9c0 con 0x7f8a7414b510 2023-07-10T23:59:58.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.823+0000 7f8a7c112700 1 -- 172.21.15.70:0/1899435116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a740672b0 con 0x7f8a7414b510 2023-07-10T23:59:58.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.825+0000 7f8a6a7fc700 1 -- 172.21.15.70:0/1899435116 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f8a6c018020 con 0x7f8a7414b510 2023-07-10T23:59:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.908+0000 7f8a7c112700 1 -- 172.21.15.70:0/1899435116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a365f14-620e-4c76-9c26-d6f7631dee8d", "id": 0} v 0) v1 -- 0x7f8a740b3480 con 0x7f8a7414b510 2023-07-10T23:59:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.911+0000 7f8a6a7fc700 1 -- 172.21.15.70:0/1899435116 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a365f14-620e-4c76-9c26-d6f7631dee8d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8a6c014c60 con 0x7f8a7414b510 2023-07-10T23:59:58.913 INFO:teuthology.orchestra.run.smithi070.stdout:0 2023-07-10T23:59:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.912+0000 7f8a7c112700 1 -- 172.21.15.70:0/1899435116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7414b510 msgr2=0x7f8a740acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.912+0000 7f8a7c112700 1 --2- 172.21.15.70:0/1899435116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7414b510 0x7f8a740acb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00efc0 tx=0x7f8a6c00c0c0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.912+0000 7f8a7c112700 1 -- 172.21.15.70:0/1899435116 shutdown_connections 2023-07-10T23:59:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.912+0000 7f8a7c112700 1 --2- 172.21.15.70:0/1899435116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7414b510 0x7f8a740acb10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.912+0000 7f8a7c112700 1 --2- 172.21.15.70:0/1899435116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a7406bce0 0x7f8a740b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.912+0000 7f8a7c112700 1 --2- 172.21.15.70:0/1899435116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8a74071910 0x7f8a740b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.912+0000 7f8a7c112700 1 -- 172.21.15.70:0/1899435116 >> 172.21.15.70:0/1899435116 conn(0x7f8a740be670 msgr2=0x7f8a740bb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.912+0000 7f8a7c112700 1 -- 172.21.15.70:0/1899435116 shutdown_connections 2023-07-10T23:59:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:58.912+0000 7f8a7c112700 1 -- 172.21.15.70:0/1899435116 wait complete. 2023-07-10T23:59:58.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 7ce8d1a9-b7de-4180-a0d9-798243fda1c2 1 2023-07-10T23:59:59.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.047+0000 7f1073ee0700 1 Processor -- start 2023-07-10T23:59:59.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.047+0000 7f1073ee0700 1 -- start start 2023-07-10T23:59:59.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.047+0000 7f1073ee0700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f106c0715b0 0x7f106c070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.047+0000 7f1073ee0700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.047+0000 7f1073ee0700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c1483e0 con 0x7f106c1422f0 2023-07-10T23:59:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.047+0000 7f1073ee0700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106c070a80 con 0x7f106c0715b0 2023-07-10T23:59:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.047+0000 7f1073ee0700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c1486c0 con 0x7f106c071980 2023-07-10T23:59:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f107147b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f1071c7c700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f106c0715b0 0x7f106c070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f107147b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0b8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:40422/0 (socket says 172.21.15.70:40422) 2023-07-10T23:59:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f107147b700 1 -- 172.21.15.70:0/2201077171 learned_addr learned my addr 172.21.15.70:0/2201077171 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-10T23:59:59.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f107147b700 1 -- 172.21.15.70:0/2201077171 >> v2:172.21.15.70:3300/0 conn(0x7f106c0715b0 msgr2=0x7f106c070540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-10T23:59:59.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f107147b700 1 --2- 172.21.15.70:0/2201077171 >> v2:172.21.15.70:3300/0 conn(0x7f106c0715b0 0x7f106c070540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f107147b700 1 -- 172.21.15.70:0/2201077171 >> v1:172.21.15.38:6789/0 conn(0x7f106c1422f0 legacy=0x7f106c14b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f107147b700 1 -- 172.21.15.70:0/2201077171 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c1489a0 con 0x7f106c071980 2023-07-10T23:59:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f1071c7c700 1 --2- 172.21.15.70:0/2201077171 >> v2:172.21.15.70:3300/0 conn(0x7f106c0715b0 0x7f106c070540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-10T23:59:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f107147b700 1 --2- 172.21.15.70:0/2201077171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0b8f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f105c0098f0 tx=0x7f105c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a9e6d4ca3bb10c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f1070c7a700 1 -- 172.21.15.70:0/2201077171 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c011830 con 0x7f106c071980 2023-07-10T23:59:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f1070c7a700 1 -- 172.21.15.70:0/2201077171 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c011990 con 0x7f106c071980 2023-07-10T23:59:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.048+0000 7f1070c7a700 1 -- 172.21.15.70:0/2201077171 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c011d20 con 0x7f106c071980 2023-07-10T23:59:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.049+0000 7f1073ee0700 1 -- 172.21.15.70:0/2201077171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 msgr2=0x7f106c0b8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.049+0000 7f1073ee0700 1 --2- 172.21.15.70:0/2201077171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0b8f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f105c0098f0 tx=0x7f105c009c00 comp rx=0 tx=0).stop 2023-07-10T23:59:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.049+0000 7f1073ee0700 1 -- 172.21.15.70:0/2201077171 shutdown_connections 2023-07-10T23:59:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.049+0000 7f1073ee0700 1 --2- 172.21.15.70:0/2201077171 >> v2:172.21.15.70:3300/0 conn(0x7f106c0715b0 0x7f106c070540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.049+0000 7f1073ee0700 1 --2- 172.21.15.70:0/2201077171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0b8f20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.049+0000 7f1073ee0700 1 -- 172.21.15.70:0/2201077171 >> 172.21.15.70:0/2201077171 conn(0x7f106c069f30 msgr2=0x7f106c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.049+0000 7f1073ee0700 1 -- 172.21.15.70:0/2201077171 shutdown_connections 2023-07-10T23:59:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.049+0000 7f1073ee0700 1 -- 172.21.15.70:0/2201077171 wait complete. 2023-07-10T23:59:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.050+0000 7f1073ee0700 1 Processor -- start 2023-07-10T23:59:59.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.050+0000 7f1073ee0700 1 -- start start 2023-07-10T23:59:59.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f1073ee0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f106c0715b0 0x7f106c0bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f1073ee0700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0bee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f1073ee0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106c1422f0 0x7f106c0bc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f1073ee0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0b8400 con 0x7f106c1422f0 2023-07-10T23:59:59.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f1073ee0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0be480 con 0x7f106c0715b0 2023-07-10T23:59:59.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f1073ee0700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0bf350 con 0x7f106c071980 2023-07-10T23:59:59.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f107147b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f107147b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0bee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:40438/0 (socket says 172.21.15.70:40438) 2023-07-10T23:59:59.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f107147b700 1 -- 172.21.15.70:0/4284857229 learned_addr learned my addr 172.21.15.70:0/4284857229 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-10T23:59:59.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f1071c7c700 1 --2- 172.21.15.70:0/4284857229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f106c0715b0 0x7f106c0bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f107247d700 1 --2- 172.21.15.70:0/4284857229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106c1422f0 0x7f106c0bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f107147b700 1 -- 172.21.15.70:0/4284857229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f106c0715b0 msgr2=0x7f106c0bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f107147b700 1 --2- 172.21.15.70:0/4284857229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f106c0715b0 0x7f106c0bdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f107147b700 1 -- 172.21.15.70:0/4284857229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106c1422f0 msgr2=0x7f106c0bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f107147b700 1 --2- 172.21.15.70:0/4284857229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106c1422f0 0x7f106c0bc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f107147b700 1 -- 172.21.15.70:0/4284857229 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10680094a0 con 0x7f106c071980 2023-07-10T23:59:59.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f107147b700 1 --2- 172.21.15.70:0/4284857229 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0bee10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f106c070bc0 tx=0x7f105c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:59.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f10627fc700 1 -- 172.21.15.70:0/4284857229 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c004550 con 0x7f106c071980 2023-07-10T23:59:59.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f10627fc700 1 -- 172.21.15.70:0/4284857229 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c01f070 con 0x7f106c071980 2023-07-10T23:59:59.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f1073ee0700 1 -- 172.21.15.70:0/4284857229 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c009550 con 0x7f106c071980 2023-07-10T23:59:59.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f10627fc700 1 -- 172.21.15.70:0/4284857229 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0038e0 con 0x7f106c071980 2023-07-10T23:59:59.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f1073ee0700 1 -- 172.21.15.70:0/4284857229 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c0b7ef0 con 0x7f106c071980 2023-07-10T23:59:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.051+0000 7f10627fc700 1 -- 172.21.15.70:0/4284857229 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f105c003d40 con 0x7f106c071980 2023-07-10T23:59:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.052+0000 7f10627fc700 1 -- 172.21.15.70:0/4284857229 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f105c021070 con 0x7f106c071980 2023-07-10T23:59:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.052+0000 7f1073ee0700 1 -- 172.21.15.70:0/4284857229 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c0b7d00 con 0x7f106c071980 2023-07-10T23:59:59.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.054+0000 7f10627fc700 1 -- 172.21.15.70:0/4284857229 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f106c0b7d00 con 0x7f106c071980 2023-07-10T23:59:59.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.139+0000 7f1073ee0700 1 -- 172.21.15.70:0/4284857229 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7ce8d1a9-b7de-4180-a0d9-798243fda1c2", "id": 1} v 0) v1 -- 0x7f106c0bc460 con 0x7f106c071980 2023-07-10T23:59:59.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.144+0000 7f10627fc700 1 -- 172.21.15.70:0/4284857229 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ce8d1a9-b7de-4180-a0d9-798243fda1c2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f105c015020 con 0x7f106c071980 2023-07-10T23:59:59.146 INFO:teuthology.orchestra.run.smithi070.stdout:1 2023-07-10T23:59:59.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.145+0000 7f1073ee0700 1 -- 172.21.15.70:0/4284857229 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 msgr2=0x7f106c0bee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.145+0000 7f1073ee0700 1 --2- 172.21.15.70:0/4284857229 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0bee10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f106c070bc0 tx=0x7f105c004750 comp rx=0 tx=0).stop 2023-07-10T23:59:59.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.145+0000 7f1073ee0700 1 -- 172.21.15.70:0/4284857229 shutdown_connections 2023-07-10T23:59:59.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.145+0000 7f1073ee0700 1 --2- 172.21.15.70:0/4284857229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106c1422f0 0x7f106c0bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.145+0000 7f1073ee0700 1 --2- 172.21.15.70:0/4284857229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f106c0715b0 0x7f106c0bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.145+0000 7f1073ee0700 1 --2- 172.21.15.70:0/4284857229 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f106c071980 0x7f106c0bee10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.145+0000 7f1073ee0700 1 -- 172.21.15.70:0/4284857229 >> 172.21.15.70:0/4284857229 conn(0x7f106c069f30 msgr2=0x7f106c140b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:59.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.145+0000 7f1073ee0700 1 -- 172.21.15.70:0/4284857229 shutdown_connections 2023-07-10T23:59:59.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.145+0000 7f1073ee0700 1 -- 172.21.15.70:0/4284857229 wait complete. 2023-07-10T23:59:59.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 603586a2-533a-4cc4-ab25-29e107607861 2 2023-07-10T23:59:59.268 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-10T23:59:59.266+0000 7f9338cc5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-10T23:59:59.273 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-10T23:59:59.271+0000 7fef764e2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-10T23:59:59.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.278+0000 7f2790f3a700 1 Processor -- start 2023-07-10T23:59:59.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.278+0000 7f2790f3a700 1 -- start start 2023-07-10T23:59:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.279+0000 7f2790f3a700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f278c071bc0 0x7f278c0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.279+0000 7f2790f3a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c0ba010 con 0x7f278c0ba3e0 2023-07-10T23:59:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.279+0000 7f2790f3a700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c0ba820 con 0x7f278c0717f0 2023-07-10T23:59:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.279+0000 7f2790f3a700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278c0b9570 con 0x7f278c071bc0 2023-07-10T23:59:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.279+0000 7f2789d9b700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f278c071bc0 0x7f278c0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.279+0000 7f278a59c700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f278c0717f0 0x7f278c0b8e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34248/0 (socket says 172.21.15.70:34248) 2023-07-10T23:59:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.279+0000 7f278a59c700 1 -- 172.21.15.70:0/2626068145 learned_addr learned my addr 172.21.15.70:0/2626068145 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-07-10T23:59:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.280+0000 7f2789d9b700 1 -- 172.21.15.70:0/2626068145 >> v1:172.21.15.70:6789/0 conn(0x7f278c0717f0 legacy=0x7f278c0b8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.280+0000 7f2789d9b700 1 -- 172.21.15.70:0/2626068145 >> v1:172.21.15.38:6789/0 conn(0x7f278c0ba3e0 legacy=0x7f278c142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.280+0000 7f2789d9b700 1 -- 172.21.15.70:0/2626068145 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c0b85a0 con 0x7f278c071bc0 2023-07-10T23:59:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.280+0000 7f2789d9b700 1 --2- 172.21.15.70:0/2626068145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f278c071bc0 0x7f278c0b7f80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2780009840 tx=0x7f2780009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94dec8a9891721be server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.280+0000 7f278959a700 1 -- 172.21.15.70:0/2626068145 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780011830 con 0x7f278c071bc0 2023-07-10T23:59:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.280+0000 7f278959a700 1 -- 172.21.15.70:0/2626068145 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2780011990 con 0x7f278c071bc0 2023-07-10T23:59:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.280+0000 7f278959a700 1 -- 172.21.15.70:0/2626068145 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780011d20 con 0x7f278c071bc0 2023-07-10T23:59:59.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.280+0000 7f2790f3a700 1 -- 172.21.15.70:0/2626068145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f278c071bc0 msgr2=0x7f278c0b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.280+0000 7f2790f3a700 1 --2- 172.21.15.70:0/2626068145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f278c071bc0 0x7f278c0b7f80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2780009840 tx=0x7f2780009b50 comp rx=0 tx=0).stop 2023-07-10T23:59:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.281+0000 7f2790f3a700 1 -- 172.21.15.70:0/2626068145 shutdown_connections 2023-07-10T23:59:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.281+0000 7f2790f3a700 1 --2- 172.21.15.70:0/2626068145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f278c071bc0 0x7f278c0b7f80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.281+0000 7f2790f3a700 1 -- 172.21.15.70:0/2626068145 >> 172.21.15.70:0/2626068145 conn(0x7f278c06d0e0 msgr2=0x7f278c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.281+0000 7f2790f3a700 1 -- 172.21.15.70:0/2626068145 shutdown_connections 2023-07-10T23:59:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.281+0000 7f2790f3a700 1 -- 172.21.15.70:0/2626068145 wait complete. 2023-07-10T23:59:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.282+0000 7f2790f3a700 1 Processor -- start 2023-07-10T23:59:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.282+0000 7f2790f3a700 1 -- start start 2023-07-10T23:59:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.282+0000 7f2790f3a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c0717f0 0x7f278c140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.282+0000 7f2790f3a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f278c071bc0 0x7f278c140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.282+0000 7f2790f3a700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f278c0ba3e0 0x7f278c06f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.282+0000 7f2790f3a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c140d80 con 0x7f278c0717f0 2023-07-10T23:59:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.282+0000 7f2790f3a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0b41c0 con 0x7f278c071bc0 2023-07-10T23:59:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.282+0000 7f2790f3a700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0b3b70 con 0x7f278c0ba3e0 2023-07-10T23:59:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f2789d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f278c071bc0 0x7f278c140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f2789d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f278c071bc0 0x7f278c140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35984/0 (socket says 172.21.15.70:35984) 2023-07-10T23:59:59.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f2789d9b700 1 -- 172.21.15.70:0/2690335343 learned_addr learned my addr 172.21.15.70:0/2690335343 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-10T23:59:59.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f278ad9d700 1 --2- 172.21.15.70:0/2690335343 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f278c0ba3e0 0x7f278c06f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f278a59c700 1 --2- 172.21.15.70:0/2690335343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c0717f0 0x7f278c140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f2789d9b700 1 -- 172.21.15.70:0/2690335343 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f278c0ba3e0 msgr2=0x7f278c06f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f2789d9b700 1 --2- 172.21.15.70:0/2690335343 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f278c0ba3e0 0x7f278c06f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f2789d9b700 1 -- 172.21.15.70:0/2690335343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c0717f0 msgr2=0x7f278c140840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f2789d9b700 1 --2- 172.21.15.70:0/2690335343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c0717f0 0x7f278c140840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f2789d9b700 1 -- 172.21.15.70:0/2690335343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27800094a0 con 0x7f278c071bc0 2023-07-10T23:59:59.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f2789d9b700 1 --2- 172.21.15.70:0/2690335343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f278c071bc0 0x7f278c140fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f27800090b0 tx=0x7f2780004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:59.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f277affd700 1 -- 172.21.15.70:0/2690335343 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27800036a0 con 0x7f278c071bc0 2023-07-10T23:59:59.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f277affd700 1 -- 172.21.15.70:0/2690335343 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278001f070 con 0x7f278c071bc0 2023-07-10T23:59:59.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f2790f3a700 1 -- 172.21.15.70:0/2690335343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c0b3e50 con 0x7f278c071bc0 2023-07-10T23:59:59.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f277affd700 1 -- 172.21.15.70:0/2690335343 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780003a60 con 0x7f278c071bc0 2023-07-10T23:59:59.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f2790f3a700 1 -- 172.21.15.70:0/2690335343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c142eb0 con 0x7f278c071bc0 2023-07-10T23:59:59.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f277affd700 1 -- 172.21.15.70:0/2690335343 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2780026480 con 0x7f278c071bc0 2023-07-10T23:59:59.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.283+0000 7f277affd700 1 -- 172.21.15.70:0/2690335343 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2780021070 con 0x7f278c071bc0 2023-07-10T23:59:59.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.284+0000 7f2790f3a700 1 -- 172.21.15.70:0/2690335343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c074360 con 0x7f278c071bc0 2023-07-10T23:59:59.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.286+0000 7f277affd700 1 -- 172.21.15.70:0/2690335343 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f278002b020 con 0x7f278c071bc0 2023-07-10T23:59:59.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.369+0000 7f2790f3a700 1 -- 172.21.15.70:0/2690335343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "603586a2-533a-4cc4-ab25-29e107607861", "id": 2} v 0) v1 -- 0x7f278c0b4300 con 0x7f278c071bc0 2023-07-10T23:59:59.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.375+0000 7f277affd700 1 -- 172.21.15.70:0/2690335343 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "603586a2-533a-4cc4-ab25-29e107607861", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2780015020 con 0x7f278c071bc0 2023-07-10T23:59:59.377 INFO:teuthology.orchestra.run.smithi070.stdout:2 2023-07-10T23:59:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.376+0000 7f2790f3a700 1 -- 172.21.15.70:0/2690335343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f278c071bc0 msgr2=0x7f278c140fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.376+0000 7f2790f3a700 1 --2- 172.21.15.70:0/2690335343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f278c071bc0 0x7f278c140fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f27800090b0 tx=0x7f2780004750 comp rx=0 tx=0).stop 2023-07-10T23:59:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.376+0000 7f2790f3a700 1 -- 172.21.15.70:0/2690335343 shutdown_connections 2023-07-10T23:59:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.376+0000 7f2790f3a700 1 --2- 172.21.15.70:0/2690335343 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f278c0ba3e0 0x7f278c06f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.376+0000 7f2790f3a700 1 --2- 172.21.15.70:0/2690335343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f278c0717f0 0x7f278c140840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.376+0000 7f2790f3a700 1 --2- 172.21.15.70:0/2690335343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f278c071bc0 0x7f278c140fd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.376+0000 7f2790f3a700 1 -- 172.21.15.70:0/2690335343 >> 172.21.15.70:0/2690335343 conn(0x7f278c06d0e0 msgr2=0x7f278c148480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.376+0000 7f2790f3a700 1 -- 172.21.15.70:0/2690335343 shutdown_connections 2023-07-10T23:59:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.376+0000 7f2790f3a700 1 -- 172.21.15.70:0/2690335343 wait complete. 2023-07-10T23:59:59.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new b9d1944b-4c68-4c76-9486-538f18296624 3 2023-07-10T23:59:59.470 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-10T23:59:59.467+0000 7f9338cc5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-10T23:59:59.477 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-10T23:59:59.475+0000 7fef764e2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-10T23:59:59.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6cea347700 1 Processor -- start 2023-07-10T23:59:59.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6cea347700 1 -- start start 2023-07-10T23:59:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6cea347700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 0x7f6ce414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6cea347700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6ce40bc810 0x7f6ce40ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6cea347700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ce40b8d90 0x7f6ce406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6cea347700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce40b97a0 con 0x7f6ce40b8d90 2023-07-10T23:59:59.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6cea347700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce4144da0 con 0x7f6ce40bc810 2023-07-10T23:59:59.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6cea347700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40b8620 con 0x7f6ce41449d0 2023-07-10T23:59:59.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6ce37fe700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6ce40bc810 0x7f6ce40ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6ce3fff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 0x7f6ce414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6ce37fe700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6ce40bc810 0x7f6ce40ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35990/0 (socket says 172.21.15.70:35990) 2023-07-10T23:59:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6ce37fe700 1 -- 172.21.15.70:0/452943510 learned_addr learned my addr 172.21.15.70:0/452943510 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-10T23:59:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.511+0000 7f6ce3fff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 0x7f6ce414db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:40450/0 (socket says 172.21.15.70:40450) 2023-07-10T23:59:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.512+0000 7f6ce88e4700 1 --2- 172.21.15.70:0/452943510 >> v2:172.21.15.38:3300/0 conn(0x7f6ce40b8d90 0x7f6ce406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.512+0000 7f6ce37fe700 1 -- 172.21.15.70:0/452943510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 msgr2=0x7f6ce414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-10T23:59:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.512+0000 7f6ce37fe700 1 --2- 172.21.15.70:0/452943510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 0x7f6ce414db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.512+0000 7f6ce37fe700 1 -- 172.21.15.70:0/452943510 >> v2:172.21.15.38:3300/0 conn(0x7f6ce40b8d90 msgr2=0x7f6ce406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-10T23:59:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.512+0000 7f6ce37fe700 1 --2- 172.21.15.70:0/452943510 >> v2:172.21.15.38:3300/0 conn(0x7f6ce40b8d90 0x7f6ce406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.512+0000 7f6ce37fe700 1 -- 172.21.15.70:0/452943510 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40b8900 con 0x7f6ce40bc810 2023-07-10T23:59:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.512+0000 7f6ce3fff700 1 --2- 172.21.15.70:0/452943510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 0x7f6ce414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-10T23:59:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.512+0000 7f6ce37fe700 1 --2- 172.21.15.70:0/452943510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ce40bc810 0x7f6ce40ba530 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ce406cc10 tx=0x7f6cd8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c020065deca16ee server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.512+0000 7f6ce2ffd700 1 -- 172.21.15.70:0/452943510 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8011830 con 0x7f6ce40bc810 2023-07-10T23:59:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.512+0000 7f6ce2ffd700 1 -- 172.21.15.70:0/452943510 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd8011990 con 0x7f6ce40bc810 2023-07-10T23:59:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.512+0000 7f6ce2ffd700 1 -- 172.21.15.70:0/452943510 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8011d20 con 0x7f6ce40bc810 2023-07-10T23:59:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.513+0000 7f6cea347700 1 -- 172.21.15.70:0/452943510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ce40bc810 msgr2=0x7f6ce40ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.513+0000 7f6cea347700 1 --2- 172.21.15.70:0/452943510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ce40bc810 0x7f6ce40ba530 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ce406cc10 tx=0x7f6cd8009bd0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.513+0000 7f6cea347700 1 -- 172.21.15.70:0/452943510 shutdown_connections 2023-07-10T23:59:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.513+0000 7f6cea347700 1 --2- 172.21.15.70:0/452943510 >> v2:172.21.15.38:3300/0 conn(0x7f6ce40b8d90 0x7f6ce406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.513+0000 7f6cea347700 1 --2- 172.21.15.70:0/452943510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 0x7f6ce414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.513+0000 7f6cea347700 1 --2- 172.21.15.70:0/452943510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ce40bc810 0x7f6ce40ba530 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.513+0000 7f6cea347700 1 -- 172.21.15.70:0/452943510 >> 172.21.15.70:0/452943510 conn(0x7f6ce40c0860 msgr2=0x7f6ce40c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.513+0000 7f6cea347700 1 -- 172.21.15.70:0/452943510 shutdown_connections 2023-07-10T23:59:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.513+0000 7f6cea347700 1 -- 172.21.15.70:0/452943510 wait complete. 2023-07-10T23:59:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.514+0000 7f6cea347700 1 Processor -- start 2023-07-10T23:59:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.514+0000 7f6cea347700 1 -- start start 2023-07-10T23:59:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6cea347700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce40b8d90 0x7f6ce40b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6cea347700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ce40bc810 0x7f6ce40b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6cea347700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 0x7f6ce41e0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6cea347700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40b0d00 con 0x7f6ce40b8d90 2023-07-10T23:59:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6cea347700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40b2b30 con 0x7f6ce40bc810 2023-07-10T23:59:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6cea347700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40b1f20 con 0x7f6ce41449d0 2023-07-10T23:59:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ce40bc810 0x7f6ce40b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce88e4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 0x7f6ce41e0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ce40bc810 0x7f6ce40b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35996/0 (socket says 172.21.15.70:35996) 2023-07-10T23:59:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce37fe700 1 -- 172.21.15.70:0/2644035009 learned_addr learned my addr 172.21.15.70:0/2644035009 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-10T23:59:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce3fff700 1 --2- 172.21.15.70:0/2644035009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce40b8d90 0x7f6ce40b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce37fe700 1 -- 172.21.15.70:0/2644035009 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 msgr2=0x7f6ce41e0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce37fe700 1 --2- 172.21.15.70:0/2644035009 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 0x7f6ce41e0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce37fe700 1 -- 172.21.15.70:0/2644035009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce40b8d90 msgr2=0x7f6ce40b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce37fe700 1 --2- 172.21.15.70:0/2644035009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce40b8d90 0x7f6ce40b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce37fe700 1 -- 172.21.15.70:0/2644035009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd8009550 con 0x7f6ce40bc810 2023-07-10T23:59:59.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce88e4700 1 --2- 172.21.15.70:0/2644035009 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 0x7f6ce41e0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-10T23:59:59.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce3fff700 1 --2- 172.21.15.70:0/2644035009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce40b8d90 0x7f6ce40b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-10T23:59:59.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce37fe700 1 --2- 172.21.15.70:0/2644035009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ce40bc810 0x7f6ce40b15e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8000c00 tx=0x7f6cd8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:59.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce0ff9700 1 -- 172.21.15.70:0/2644035009 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8004240 con 0x7f6ce40bc810 2023-07-10T23:59:59.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce0ff9700 1 -- 172.21.15.70:0/2644035009 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd801f070 con 0x7f6ce40bc810 2023-07-10T23:59:59.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6cea347700 1 -- 172.21.15.70:0/2644035009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce41422d0 con 0x7f6ce40bc810 2023-07-10T23:59:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6ce0ff9700 1 -- 172.21.15.70:0/2644035009 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80036a0 con 0x7f6ce40bc810 2023-07-10T23:59:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.515+0000 7f6cea347700 1 -- 172.21.15.70:0/2644035009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce40b27c0 con 0x7f6ce40bc810 2023-07-10T23:59:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.516+0000 7f6ce0ff9700 1 -- 172.21.15.70:0/2644035009 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6cd8021030 con 0x7f6ce40bc810 2023-07-10T23:59:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.516+0000 7f6ce0ff9700 1 -- 172.21.15.70:0/2644035009 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6cd801ac80 con 0x7f6ce40bc810 2023-07-10T23:59:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.516+0000 7f6cca7fc700 1 -- 172.21.15.70:0/2644035009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce40b2340 con 0x7f6ce40bc810 2023-07-10T23:59:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.518+0000 7f6ce0ff9700 1 -- 172.21.15.70:0/2644035009 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f6ce40b2340 con 0x7f6ce40bc810 2023-07-10T23:59:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.602+0000 7f6cca7fc700 1 -- 172.21.15.70:0/2644035009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b9d1944b-4c68-4c76-9486-538f18296624", "id": 3} v 0) v1 -- 0x7f6ce40b2950 con 0x7f6ce40bc810 2023-07-10T23:59:59.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.606+0000 7f6ce0ff9700 1 -- 172.21.15.70:0/2644035009 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9d1944b-4c68-4c76-9486-538f18296624", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6cd8015020 con 0x7f6ce40bc810 2023-07-10T23:59:59.608 INFO:teuthology.orchestra.run.smithi070.stdout:3 2023-07-10T23:59:59.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.607+0000 7f6cca7fc700 1 -- 172.21.15.70:0/2644035009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ce40bc810 msgr2=0x7f6ce40b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.607+0000 7f6cca7fc700 1 --2- 172.21.15.70:0/2644035009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ce40bc810 0x7f6ce40b15e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8000c00 tx=0x7f6cd8004750 comp rx=0 tx=0).stop 2023-07-10T23:59:59.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.607+0000 7f6cca7fc700 1 -- 172.21.15.70:0/2644035009 shutdown_connections 2023-07-10T23:59:59.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.607+0000 7f6cca7fc700 1 --2- 172.21.15.70:0/2644035009 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ce41449d0 0x7f6ce41e0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.607+0000 7f6cca7fc700 1 --2- 172.21.15.70:0/2644035009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce40b8d90 0x7f6ce40b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.607+0000 7f6cca7fc700 1 --2- 172.21.15.70:0/2644035009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ce40bc810 0x7f6ce40b15e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.607+0000 7f6cca7fc700 1 -- 172.21.15.70:0/2644035009 >> 172.21.15.70:0/2644035009 conn(0x7f6ce40c0860 msgr2=0x7f6ce41433e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:59.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.607+0000 7f6cca7fc700 1 -- 172.21.15.70:0/2644035009 shutdown_connections 2023-07-10T23:59:59.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.607+0000 7f6cca7fc700 1 -- 172.21.15.70:0/2644035009 wait complete. 2023-07-10T23:59:59.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new a61888ae-c332-4628-844e-3620e072e6bc 4 2023-07-10T23:59:59.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.740+0000 7f64edea5700 1 Processor -- start 2023-07-10T23:59:59.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.740+0000 7f64edea5700 1 -- start start 2023-07-10T23:59:59.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.740+0000 7f64edea5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f64e8071910 0x7f64e814b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64edea5700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f64e8070da0 0x7f64e806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64edea5700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e806cd00 0x7f64e814de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64edea5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e8070130 con 0x7f64e8071910 2023-07-10T23:59:59.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64edea5700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e8071540 con 0x7f64e8070da0 2023-07-10T23:59:59.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64edea5700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e8071260 con 0x7f64e806cd00 2023-07-10T23:59:59.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e6ffd700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f64e8070da0 0x7f64e806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e7fff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e806cd00 0x7f64e814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e6ffd700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f64e8070da0 0x7f64e806c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36000/0 (socket says 172.21.15.70:36000) 2023-07-10T23:59:59.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e7fff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e806cd00 0x7f64e814de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:40480/0 (socket says 172.21.15.70:40480) 2023-07-10T23:59:59.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e6ffd700 1 -- 172.21.15.70:0/3128131163 learned_addr learned my addr 172.21.15.70:0/3128131163 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-10T23:59:59.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e77fe700 1 --2- 172.21.15.70:0/3128131163 >> v2:172.21.15.38:3300/0 conn(0x7f64e8071910 0x7f64e814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e6ffd700 1 -- 172.21.15.70:0/3128131163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e806cd00 msgr2=0x7f64e814de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-10T23:59:59.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e6ffd700 1 --2- 172.21.15.70:0/3128131163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e806cd00 0x7f64e814de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e6ffd700 1 -- 172.21.15.70:0/3128131163 >> v2:172.21.15.38:3300/0 conn(0x7f64e8071910 msgr2=0x7f64e814b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-10T23:59:59.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e6ffd700 1 --2- 172.21.15.70:0/3128131163 >> v2:172.21.15.38:3300/0 conn(0x7f64e8071910 0x7f64e814b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e6ffd700 1 -- 172.21.15.70:0/3128131163 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e814aa60 con 0x7f64e8070da0 2023-07-10T23:59:59.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e7fff700 1 --2- 172.21.15.70:0/3128131163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e806cd00 0x7f64e814de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-10T23:59:59.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e6ffd700 1 --2- 172.21.15.70:0/3128131163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64e8070da0 0x7f64e806c7c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f64e8066800 tx=0x7f64d0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca317021beafb31 server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:59.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e67fc700 1 -- 172.21.15.70:0/3128131163 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0011830 con 0x7f64e8070da0 2023-07-10T23:59:59.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e67fc700 1 -- 172.21.15.70:0/3128131163 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d0011990 con 0x7f64e8070da0 2023-07-10T23:59:59.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.741+0000 7f64e67fc700 1 -- 172.21.15.70:0/3128131163 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0011d20 con 0x7f64e8070da0 2023-07-10T23:59:59.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.742+0000 7f64edea5700 1 -- 172.21.15.70:0/3128131163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64e8070da0 msgr2=0x7f64e806c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.742+0000 7f64edea5700 1 --2- 172.21.15.70:0/3128131163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64e8070da0 0x7f64e806c7c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f64e8066800 tx=0x7f64d0009bd0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.742+0000 7f64edea5700 1 -- 172.21.15.70:0/3128131163 shutdown_connections 2023-07-10T23:59:59.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.742+0000 7f64edea5700 1 --2- 172.21.15.70:0/3128131163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e806cd00 0x7f64e814de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.742+0000 7f64edea5700 1 --2- 172.21.15.70:0/3128131163 >> v2:172.21.15.38:3300/0 conn(0x7f64e8071910 0x7f64e814b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.742+0000 7f64edea5700 1 --2- 172.21.15.70:0/3128131163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64e8070da0 0x7f64e806c7c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.742+0000 7f64edea5700 1 -- 172.21.15.70:0/3128131163 >> 172.21.15.70:0/3128131163 conn(0x7f64e80be670 msgr2=0x7f64e80bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:59.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.742+0000 7f64edea5700 1 -- 172.21.15.70:0/3128131163 shutdown_connections 2023-07-10T23:59:59.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.742+0000 7f64edea5700 1 -- 172.21.15.70:0/3128131163 wait complete. 2023-07-10T23:59:59.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.743+0000 7f64edea5700 1 Processor -- start 2023-07-10T23:59:59.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.743+0000 7f64edea5700 1 -- start start 2023-07-10T23:59:59.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64edea5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e806cd00 0x7f64e814df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64edea5700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e8070da0 0x7f64e80b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64edea5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64e8071910 0x7f64e80b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64edea5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80b60d0 con 0x7f64e806cd00 2023-07-10T23:59:59.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64edea5700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80b6f50 con 0x7f64e8071910 2023-07-10T23:59:59.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64edea5700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80b71c0 con 0x7f64e8070da0 2023-07-10T23:59:59.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64e8071910 0x7f64e80b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e6ffd700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e8070da0 0x7f64e80b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64e8071910 0x7f64e80b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36016/0 (socket says 172.21.15.70:36016) 2023-07-10T23:59:59.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e7fff700 1 -- 172.21.15.70:0/1521415919 learned_addr learned my addr 172.21.15.70:0/1521415919 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-10T23:59:59.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e77fe700 1 --2- 172.21.15.70:0/1521415919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e806cd00 0x7f64e814df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e6ffd700 1 -- 172.21.15.70:0/1521415919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64e8071910 msgr2=0x7f64e80b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e6ffd700 1 --2- 172.21.15.70:0/1521415919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64e8071910 0x7f64e80b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e6ffd700 1 -- 172.21.15.70:0/1521415919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e806cd00 msgr2=0x7f64e814df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e6ffd700 1 --2- 172.21.15.70:0/1521415919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e806cd00 0x7f64e814df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e6ffd700 1 -- 172.21.15.70:0/1521415919 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0009550 con 0x7f64e8070da0 2023-07-10T23:59:59.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e77fe700 1 --2- 172.21.15.70:0/1521415919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e806cd00 0x7f64e814df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-10T23:59:59.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.744+0000 7f64e7fff700 1 --2- 172.21.15.70:0/1521415919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64e8071910 0x7f64e80b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-10T23:59:59.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.745+0000 7f64e6ffd700 1 --2- 172.21.15.70:0/1521415919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e8070da0 0x7f64e80b5b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f64e80bf400 tx=0x7f64d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:59.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.745+0000 7f64dffff700 1 -- 172.21.15.70:0/1521415919 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0004300 con 0x7f64e8070da0 2023-07-10T23:59:59.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.745+0000 7f64dffff700 1 -- 172.21.15.70:0/1521415919 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d001f070 con 0x7f64e8070da0 2023-07-10T23:59:59.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.745+0000 7f64dffff700 1 -- 172.21.15.70:0/1521415919 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d00036a0 con 0x7f64e8070da0 2023-07-10T23:59:59.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.745+0000 7f64edea5700 1 -- 172.21.15.70:0/1521415919 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e814d530 con 0x7f64e8070da0 2023-07-10T23:59:59.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.745+0000 7f64edea5700 1 -- 172.21.15.70:0/1521415919 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e814daf0 con 0x7f64e8070da0 2023-07-10T23:59:59.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.745+0000 7f64dffff700 1 -- 172.21.15.70:0/1521415919 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f64d0021030 con 0x7f64e8070da0 2023-07-10T23:59:59.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.745+0000 7f64dffff700 1 -- 172.21.15.70:0/1521415919 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f64d001ac80 con 0x7f64e8070da0 2023-07-10T23:59:59.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.746+0000 7f64edea5700 1 -- 172.21.15.70:0/1521415919 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e8074360 con 0x7f64e8070da0 2023-07-10T23:59:59.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.748+0000 7f64dffff700 1 -- 172.21.15.70:0/1521415919 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f64d0015020 con 0x7f64e8070da0 2023-07-10T23:59:59.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.830+0000 7f64edea5700 1 -- 172.21.15.70:0/1521415919 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a61888ae-c332-4628-844e-3620e072e6bc", "id": 4} v 0) v1 -- 0x7f64e8149f50 con 0x7f64e8070da0 2023-07-10T23:59:59.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.833+0000 7f64dffff700 1 -- 172.21.15.70:0/1521415919 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a61888ae-c332-4628-844e-3620e072e6bc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f64d0003ce0 con 0x7f64e8070da0 2023-07-10T23:59:59.836 INFO:teuthology.orchestra.run.smithi070.stdout:4 2023-07-10T23:59:59.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.834+0000 7f64edea5700 1 -- 172.21.15.70:0/1521415919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e8070da0 msgr2=0x7f64e80b5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.834+0000 7f64edea5700 1 --2- 172.21.15.70:0/1521415919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e8070da0 0x7f64e80b5b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f64e80bf400 tx=0x7f64d0004750 comp rx=0 tx=0).stop 2023-07-10T23:59:59.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.834+0000 7f64edea5700 1 -- 172.21.15.70:0/1521415919 shutdown_connections 2023-07-10T23:59:59.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.834+0000 7f64edea5700 1 --2- 172.21.15.70:0/1521415919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64e8071910 0x7f64e80b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.834+0000 7f64edea5700 1 --2- 172.21.15.70:0/1521415919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64e806cd00 0x7f64e814df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.834+0000 7f64edea5700 1 --2- 172.21.15.70:0/1521415919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64e8070da0 0x7f64e80b5b90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.834+0000 7f64edea5700 1 -- 172.21.15.70:0/1521415919 >> 172.21.15.70:0/1521415919 conn(0x7f64e80be670 msgr2=0x7f64e80bcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:59.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.834+0000 7f64edea5700 1 -- 172.21.15.70:0/1521415919 shutdown_connections 2023-07-10T23:59:59.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.834+0000 7f64edea5700 1 -- 172.21.15.70:0/1521415919 wait complete. 2023-07-10T23:59:59.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new d39f3259-d2e0-4890-abd2-2c8cfc646fa3 5 2023-07-10T23:59:59.850 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-10T23:59:59.848+0000 7f9338cc5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-10T23:59:59.866 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-10T23:59:59.864+0000 7fef764e2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-10T23:59:59.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.968+0000 7f51e6a2c700 1 Processor -- start 2023-07-10T23:59:59.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.968+0000 7f51e6a2c700 1 -- start start 2023-07-10T23:59:59.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.968+0000 7f51e6a2c700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f51e0141780 0x7f51e00ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51e6a2c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f51e00b96b0 0x7f51e0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51e6a2c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e0070e70 con 0x7f51e0071a30 2023-07-10T23:59:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51e6a2c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e0071ea0 con 0x7f51e00b96b0 2023-07-10T23:59:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51e6a2c700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e00b9b40 con 0x7f51e0141780 2023-07-10T23:59:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51dffff700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f51e0141780 0x7f51e00ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51dffff700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f51e0141780 0x7f51e00ba010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36022/0 (socket says 172.21.15.70:36022) 2023-07-10T23:59:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51dffff700 1 -- 172.21.15.70:0/4053228842 learned_addr learned my addr 172.21.15.70:0/4053228842 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-10T23:59:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51e4fc9700 1 --2- 172.21.15.70:0/4053228842 >> v2:172.21.15.38:3300/0 conn(0x7f51e00b96b0 0x7f51e0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51dffff700 1 -- 172.21.15.70:0/4053228842 >> v2:172.21.15.38:3300/0 conn(0x7f51e00b96b0 msgr2=0x7f51e0151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-10T23:59:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51dffff700 1 --2- 172.21.15.70:0/4053228842 >> v2:172.21.15.38:3300/0 conn(0x7f51e00b96b0 0x7f51e0151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51dffff700 1 -- 172.21.15.70:0/4053228842 >> v1:172.21.15.38:6789/0 conn(0x7f51e0071a30 legacy=0x7f51e014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51dffff700 1 -- 172.21.15.70:0/4053228842 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e0070670 con 0x7f51e0141780 2023-07-10T23:59:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51e4fc9700 1 --2- 172.21.15.70:0/4053228842 >> v2:172.21.15.38:3300/0 conn(0x7f51e00b96b0 0x7f51e0151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-10T23:59:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51dffff700 1 --2- 172.21.15.70:0/4053228842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0141780 0x7f51e00ba010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f51e00b9400 tx=0x7f51d0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8006fbc694dda9bf server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51deffd700 1 -- 172.21.15.70:0/4053228842 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000b870 con 0x7f51e0141780 2023-07-10T23:59:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51deffd700 1 -- 172.21.15.70:0/4053228842 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d000b9d0 con 0x7f51e0141780 2023-07-10T23:59:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.969+0000 7f51deffd700 1 -- 172.21.15.70:0/4053228842 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000bd60 con 0x7f51e0141780 2023-07-10T23:59:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.970+0000 7f51e6a2c700 1 -- 172.21.15.70:0/4053228842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0141780 msgr2=0x7f51e00ba010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.970+0000 7f51e6a2c700 1 --2- 172.21.15.70:0/4053228842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0141780 0x7f51e00ba010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f51e00b9400 tx=0x7f51d0009bd0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.970+0000 7f51e6a2c700 1 -- 172.21.15.70:0/4053228842 shutdown_connections 2023-07-10T23:59:59.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.970+0000 7f51e6a2c700 1 --2- 172.21.15.70:0/4053228842 >> v2:172.21.15.38:3300/0 conn(0x7f51e00b96b0 0x7f51e0151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.970+0000 7f51e6a2c700 1 --2- 172.21.15.70:0/4053228842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0141780 0x7f51e00ba010 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.970+0000 7f51e6a2c700 1 -- 172.21.15.70:0/4053228842 >> 172.21.15.70:0/4053228842 conn(0x7f51e006d0e0 msgr2=0x7f51e006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-10T23:59:59.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.970+0000 7f51e6a2c700 1 -- 172.21.15.70:0/4053228842 shutdown_connections 2023-07-10T23:59:59.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.970+0000 7f51e6a2c700 1 -- 172.21.15.70:0/4053228842 wait complete. 2023-07-10T23:59:59.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.972+0000 7f51e6a2c700 1 Processor -- start 2023-07-10T23:59:59.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.972+0000 7f51e6a2c700 1 -- start start 2023-07-10T23:59:59.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51e6a2c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51e0071a30 0x7f51e00bcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51e6a2c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f51e00b96b0 0x7f51e0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51e6a2c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0141780 0x7f51e01e13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-10T23:59:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51e6a2c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00bd220 con 0x7f51e0071a30 2023-07-10T23:59:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51e6a2c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e01e0f20 con 0x7f51e0141780 2023-07-10T23:59:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51e6a2c700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00b77e0 con 0x7f51e00b96b0 2023-07-10T23:59:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51df7fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f51e00b96b0 0x7f51e0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51e4fc9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0141780 0x7f51e01e13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51e4fc9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0141780 0x7f51e01e13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36034/0 (socket says 172.21.15.70:36034) 2023-07-10T23:59:59.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51dffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51e0071a30 0x7f51e00bcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-10T23:59:59.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51e4fc9700 1 -- 172.21.15.70:0/3818124746 learned_addr learned my addr 172.21.15.70:0/3818124746 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-10T23:59:59.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51df7fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f51e00b96b0 0x7f51e0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:40484/0 (socket says 172.21.15.70:40484) 2023-07-10T23:59:59.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51df7fe700 1 -- 172.21.15.70:0/3818124746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0141780 msgr2=0x7f51e01e13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51df7fe700 1 --2- 172.21.15.70:0/3818124746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0141780 0x7f51e01e13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51df7fe700 1 -- 172.21.15.70:0/3818124746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51e0071a30 msgr2=0x7f51e00bcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-10T23:59:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51df7fe700 1 --2- 172.21.15.70:0/3818124746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51e0071a30 0x7f51e00bcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-10T23:59:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51df7fe700 1 -- 172.21.15.70:0/3818124746 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d0009550 con 0x7f51e00b96b0 2023-07-10T23:59:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51e4fc9700 1 --2- 172.21.15.70:0/3818124746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0141780 0x7f51e01e13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-10T23:59:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.973+0000 7f51df7fe700 1 --2- 172.21.15.70:0/3818124746 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f51e00b96b0 0x7f51e0133a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f51e006f590 tx=0x7f51d400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-10T23:59:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.974+0000 7f51dcff9700 1 -- 172.21.15.70:0/3818124746 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40052d0 con 0x7f51e00b96b0 2023-07-10T23:59:59.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.974+0000 7f51dcff9700 1 -- 172.21.15.70:0/3818124746 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d4005430 con 0x7f51e00b96b0 2023-07-10T23:59:59.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.974+0000 7f51e6a2c700 1 -- 172.21.15.70:0/3818124746 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e01d3940 con 0x7f51e00b96b0 2023-07-10T23:59:59.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.974+0000 7f51dcff9700 1 -- 172.21.15.70:0/3818124746 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40038c0 con 0x7f51e00b96b0 2023-07-10T23:59:59.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.974+0000 7f51e6a2c700 1 -- 172.21.15.70:0/3818124746 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e00b7500 con 0x7f51e00b96b0 2023-07-10T23:59:59.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.974+0000 7f51dcff9700 1 -- 172.21.15.70:0/3818124746 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f51d4003d20 con 0x7f51e00b96b0 2023-07-10T23:59:59.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.974+0000 7f51dcff9700 1 -- 172.21.15.70:0/3818124746 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f51d40129a0 con 0x7f51e00b96b0 2023-07-10T23:59:59.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.975+0000 7f51e6a2c700 1 -- 172.21.15.70:0/3818124746 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e00b8590 con 0x7f51e00b96b0 2023-07-10T23:59:59.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-10T23:59:59.977+0000 7f51dcff9700 1 -- 172.21.15.70:0/3818124746 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f51d4017070 con 0x7f51e00b96b0 2023-07-11T00:00:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.061+0000 7f51e6a2c700 1 -- 172.21.15.70:0/3818124746 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d39f3259-d2e0-4890-abd2-2c8cfc646fa3", "id": 5} v 0) v1 -- 0x7f51e0074360 con 0x7f51e00b96b0 2023-07-11T00:00:00.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.065+0000 7f51dcff9700 1 -- 172.21.15.70:0/3818124746 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d39f3259-d2e0-4890-abd2-2c8cfc646fa3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f51d4012420 con 0x7f51e00b96b0 2023-07-11T00:00:00.068 INFO:teuthology.orchestra.run.smithi070.stdout:5 2023-07-11T00:00:00.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.066+0000 7f51e6a2c700 1 -- 172.21.15.70:0/3818124746 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f51e00b96b0 msgr2=0x7f51e0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.066+0000 7f51e6a2c700 1 --2- 172.21.15.70:0/3818124746 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f51e00b96b0 0x7f51e0133a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f51e006f590 tx=0x7f51d400c730 comp rx=0 tx=0).stop 2023-07-11T00:00:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.066+0000 7f51e6a2c700 1 -- 172.21.15.70:0/3818124746 shutdown_connections 2023-07-11T00:00:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.066+0000 7f51e6a2c700 1 --2- 172.21.15.70:0/3818124746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0141780 0x7f51e01e13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.066+0000 7f51e6a2c700 1 --2- 172.21.15.70:0/3818124746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51e0071a30 0x7f51e00bcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.066+0000 7f51e6a2c700 1 --2- 172.21.15.70:0/3818124746 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f51e00b96b0 0x7f51e0133a30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.066+0000 7f51e6a2c700 1 -- 172.21.15.70:0/3818124746 >> 172.21.15.70:0/3818124746 conn(0x7f51e006d0e0 msgr2=0x7f51e00b7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:00.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.066+0000 7f51e6a2c700 1 -- 172.21.15.70:0/3818124746 shutdown_connections 2023-07-11T00:00:00.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.066+0000 7f51e6a2c700 1 -- 172.21.15.70:0/3818124746 wait complete. 2023-07-11T00:00:00.081 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new eac42388-4a57-46df-b091-1cbd559dd9b0 6 2023-07-11T00:00:00.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.241+0000 7febd106f700 1 Processor -- start 2023-07-11T00:00:00.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.242+0000 7febd106f700 1 -- start start 2023-07-11T00:00:00.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.242+0000 7febd106f700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7febcc147940 0x7febcc0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.242+0000 7febd106f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc1474b0 con 0x7febcc140a70 2023-07-11T00:00:00.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.242+0000 7febd106f700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc146bc0 con 0x7febcc0b4d40 2023-07-11T00:00:00.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.242+0000 7febd106f700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc0b5b90 con 0x7febcc147940 2023-07-11T00:00:00.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.243+0000 7febca59c700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7febcc147940 0x7febcc0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.243+0000 7febcad9d700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7febcc0b4d40 0x7febcc0b6e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34260/0 (socket says 172.21.15.70:34260) 2023-07-11T00:00:00.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.243+0000 7febcad9d700 1 -- 172.21.15.70:0/3029263895 learned_addr learned my addr 172.21.15.70:0/3029263895 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-07-11T00:00:00.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.243+0000 7febca59c700 1 -- 172.21.15.70:0/3029263895 >> v1:172.21.15.70:6789/0 conn(0x7febcc0b4d40 legacy=0x7febcc0b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.243+0000 7febca59c700 1 -- 172.21.15.70:0/3029263895 >> v1:172.21.15.38:6789/0 conn(0x7febcc140a70 legacy=0x7febcc151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.243+0000 7febca59c700 1 -- 172.21.15.70:0/3029263895 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc146e60 con 0x7febcc147940 2023-07-11T00:00:00.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.243+0000 7febc9d9b700 1 -- 172.21.15.70:0/3029263895 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334615924 0 0) 0x7febcc146bc0 con 0x7febcc0b4d40 2023-07-11T00:00:00.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.243+0000 7febca59c700 1 --2- 172.21.15.70:0/3029263895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febcc147940 0x7febcc0b5110 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7febc0009840 tx=0x7febc0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abd0e4910f5b0258 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:00.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.243+0000 7febc9d9b700 1 -- 172.21.15.70:0/3029263895 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0011830 con 0x7febcc147940 2023-07-11T00:00:00.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.243+0000 7febc9d9b700 1 -- 172.21.15.70:0/3029263895 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc0011990 con 0x7febcc147940 2023-07-11T00:00:00.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.243+0000 7febc9d9b700 1 -- 172.21.15.70:0/3029263895 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0011d20 con 0x7febcc147940 2023-07-11T00:00:00.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.244+0000 7febd106f700 1 -- 172.21.15.70:0/3029263895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febcc147940 msgr2=0x7febcc0b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.244+0000 7febd106f700 1 --2- 172.21.15.70:0/3029263895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febcc147940 0x7febcc0b5110 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7febc0009840 tx=0x7febc0009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:00.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.244+0000 7febd106f700 1 -- 172.21.15.70:0/3029263895 shutdown_connections 2023-07-11T00:00:00.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.244+0000 7febd106f700 1 --2- 172.21.15.70:0/3029263895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febcc147940 0x7febcc0b5110 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.244+0000 7febd106f700 1 -- 172.21.15.70:0/3029263895 >> 172.21.15.70:0/3029263895 conn(0x7febcc069f30 msgr2=0x7febcc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:00.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.244+0000 7febd106f700 1 -- 172.21.15.70:0/3029263895 shutdown_connections 2023-07-11T00:00:00.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.244+0000 7febd106f700 1 -- 172.21.15.70:0/3029263895 wait complete. 2023-07-11T00:00:00.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.246+0000 7febd106f700 1 Processor -- start 2023-07-11T00:00:00.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.246+0000 7febd106f700 1 -- start start 2023-07-11T00:00:00.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.247+0000 7febd106f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7febcc0b4d40 0x7febcc154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.247+0000 7febd106f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febcc140a70 0x7febcc1e1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.247+0000 7febd106f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febcc147940 0x7febcc141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.247+0000 7febd106f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc155410 con 0x7febcc140a70 2023-07-11T00:00:00.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.247+0000 7febd106f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc1325d0 con 0x7febcc147940 2023-07-11T00:00:00.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.247+0000 7febd106f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc143360 con 0x7febcc0b4d40 2023-07-11T00:00:00.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.247+0000 7febcad9d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7febcc0b4d40 0x7febcc154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.247+0000 7febcad9d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7febcc0b4d40 0x7febcc154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:40490/0 (socket says 172.21.15.70:40490) 2023-07-11T00:00:00.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.247+0000 7febcad9d700 1 -- 172.21.15.70:0/3901509202 learned_addr learned my addr 172.21.15.70:0/3901509202 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-11T00:00:00.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.247+0000 7febca59c700 1 --2- 172.21.15.70:0/3901509202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febcc140a70 0x7febcc1e1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.247+0000 7febcb59e700 1 --2- 172.21.15.70:0/3901509202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febcc147940 0x7febcc141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febcad9d700 1 -- 172.21.15.70:0/3901509202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febcc147940 msgr2=0x7febcc141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febcad9d700 1 --2- 172.21.15.70:0/3901509202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febcc147940 0x7febcc141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febcad9d700 1 -- 172.21.15.70:0/3901509202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febcc140a70 msgr2=0x7febcc1e1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febcad9d700 1 --2- 172.21.15.70:0/3901509202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febcc140a70 0x7febcc1e1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febcad9d700 1 -- 172.21.15.70:0/3901509202 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00094a0 con 0x7febcc0b4d40 2023-07-11T00:00:00.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febca59c700 1 --2- 172.21.15.70:0/3901509202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febcc140a70 0x7febcc1e1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:00.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febcad9d700 1 --2- 172.21.15.70:0/3901509202 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7febcc0b4d40 0x7febcc154ed0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c520 tx=0x7febbc00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:00.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febb37fe700 1 -- 172.21.15.70:0/3901509202 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc004c80 con 0x7febcc0b4d40 2023-07-11T00:00:00.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febb37fe700 1 -- 172.21.15.70:0/3901509202 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc004e00 con 0x7febcc0b4d40 2023-07-11T00:00:00.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febd106f700 1 -- 172.21.15.70:0/3901509202 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc143640 con 0x7febcc0b4d40 2023-07-11T00:00:00.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febb37fe700 1 -- 172.21.15.70:0/3901509202 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc007310 con 0x7febcc0b4d40 2023-07-11T00:00:00.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.248+0000 7febd106f700 1 -- 172.21.15.70:0/3901509202 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc1e0f30 con 0x7febcc0b4d40 2023-07-11T00:00:00.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.249+0000 7febb37fe700 1 -- 172.21.15.70:0/3901509202 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7febbc0133c0 con 0x7febcc0b4d40 2023-07-11T00:00:00.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.249+0000 7febb37fe700 1 -- 172.21.15.70:0/3901509202 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7febbc013c60 con 0x7febcc0b4d40 2023-07-11T00:00:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.249+0000 7febd106f700 1 -- 172.21.15.70:0/3901509202 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc074360 con 0x7febcc0b4d40 2023-07-11T00:00:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.253+0000 7febb37fe700 1 -- 172.21.15.70:0/3901509202 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7febbc013670 con 0x7febcc0b4d40 2023-07-11T00:00:00.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.337+0000 7febd106f700 1 -- 172.21.15.70:0/3901509202 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "eac42388-4a57-46df-b091-1cbd559dd9b0", "id": 6} v 0) v1 -- 0x7febcc1445c0 con 0x7febcc0b4d40 2023-07-11T00:00:00.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.349+0000 7febb37fe700 1 -- 172.21.15.70:0/3901509202 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eac42388-4a57-46df-b091-1cbd559dd9b0", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7febbc013810 con 0x7febcc0b4d40 2023-07-11T00:00:00.352 INFO:teuthology.orchestra.run.smithi070.stdout:6 2023-07-11T00:00:00.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.350+0000 7febd106f700 1 -- 172.21.15.70:0/3901509202 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7febcc0b4d40 msgr2=0x7febcc154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.350+0000 7febd106f700 1 --2- 172.21.15.70:0/3901509202 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7febcc0b4d40 0x7febcc154ed0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c520 tx=0x7febbc00c830 comp rx=0 tx=0).stop 2023-07-11T00:00:00.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.350+0000 7febd106f700 1 -- 172.21.15.70:0/3901509202 shutdown_connections 2023-07-11T00:00:00.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.350+0000 7febd106f700 1 --2- 172.21.15.70:0/3901509202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febcc147940 0x7febcc141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.350+0000 7febd106f700 1 --2- 172.21.15.70:0/3901509202 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7febcc0b4d40 0x7febcc154ed0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.350+0000 7febd106f700 1 --2- 172.21.15.70:0/3901509202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febcc140a70 0x7febcc1e1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.350+0000 7febd106f700 1 -- 172.21.15.70:0/3901509202 >> 172.21.15.70:0/3901509202 conn(0x7febcc069f30 msgr2=0x7febcc145390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:00.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.350+0000 7febd106f700 1 -- 172.21.15.70:0/3901509202 shutdown_connections 2023-07-11T00:00:00.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.350+0000 7febd106f700 1 -- 172.21.15.70:0/3901509202 wait complete. 2023-07-11T00:00:00.365 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new e5433b75-e894-4f42-93c3-e7a15a0a2345 7 2023-07-11T00:00:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.491+0000 7f7484759700 1 Processor -- start 2023-07-11T00:00:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.491+0000 7f7484759700 1 -- start start 2023-07-11T00:00:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f7484759700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c0b8160 0x7f747c0b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f7484759700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f747c147460 0x7f747c141300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f7484759700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c1482e0 con 0x7f747c141840 2023-07-11T00:00:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f7484759700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c06e4f0 con 0x7f747c147460 2023-07-11T00:00:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f7484759700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c1479b0 con 0x7f747c0b8160 2023-07-11T00:00:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f74824f5700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c0b8160 0x7f747c0b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f7482cf6700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f747c141840 0x7f747c14ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34268/0 (socket says 172.21.15.70:34268) 2023-07-11T00:00:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f7482cf6700 1 -- 172.21.15.70:0/2709020577 learned_addr learned my addr 172.21.15.70:0/2709020577 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-07-11T00:00:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f7481cf4700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f747c147460 0x7f747c141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f74824f5700 1 -- 172.21.15.70:0/2709020577 >> v2:172.21.15.70:3300/0 conn(0x7f747c147460 msgr2=0x7f747c141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f74824f5700 1 --2- 172.21.15.70:0/2709020577 >> v2:172.21.15.70:3300/0 conn(0x7f747c147460 0x7f747c141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f74824f5700 1 -- 172.21.15.70:0/2709020577 >> v1:172.21.15.70:6789/0 conn(0x7f747c141840 legacy=0x7f747c14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f74824f5700 1 -- 172.21.15.70:0/2709020577 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c147c90 con 0x7f747c0b8160 2023-07-11T00:00:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f74814f3700 1 -- 172.21.15.70:0/2709020577 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835171170 0 0) 0x7f747c1482e0 con 0x7f747c141840 2023-07-11T00:00:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.492+0000 7f7481cf4700 1 --2- 172.21.15.70:0/2709020577 >> v2:172.21.15.70:3300/0 conn(0x7f747c147460 0x7f747c141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f74824f5700 1 --2- 172.21.15.70:0/2709020577 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c0b8160 0x7f747c0b5c20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7478009840 tx=0x7f7478009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f19151f5310a1c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f74814f3700 1 -- 172.21.15.70:0/2709020577 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7478011830 con 0x7f747c0b8160 2023-07-11T00:00:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f74814f3700 1 -- 172.21.15.70:0/2709020577 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7478011990 con 0x7f747c0b8160 2023-07-11T00:00:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f74814f3700 1 -- 172.21.15.70:0/2709020577 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7478011d20 con 0x7f747c0b8160 2023-07-11T00:00:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f7484759700 1 -- 172.21.15.70:0/2709020577 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c0b8160 msgr2=0x7f747c0b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f7484759700 1 --2- 172.21.15.70:0/2709020577 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c0b8160 0x7f747c0b5c20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7478009840 tx=0x7f7478009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f7484759700 1 -- 172.21.15.70:0/2709020577 shutdown_connections 2023-07-11T00:00:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f7484759700 1 --2- 172.21.15.70:0/2709020577 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c0b8160 0x7f747c0b5c20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f7484759700 1 --2- 172.21.15.70:0/2709020577 >> v2:172.21.15.70:3300/0 conn(0x7f747c147460 0x7f747c141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f7484759700 1 -- 172.21.15.70:0/2709020577 >> 172.21.15.70:0/2709020577 conn(0x7f747c069f30 msgr2=0x7f747c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f7484759700 1 -- 172.21.15.70:0/2709020577 shutdown_connections 2023-07-11T00:00:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.493+0000 7f7484759700 1 -- 172.21.15.70:0/2709020577 wait complete. 2023-07-11T00:00:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.494+0000 7f7484759700 1 Processor -- start 2023-07-11T00:00:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f7484759700 1 -- start start 2023-07-11T00:00:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f7484759700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c0b8160 0x7f747c0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f7484759700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747c141840 0x7f747c0bb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f7484759700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c147460 0x7f747c13e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f7484759700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0b4a50 con 0x7f747c0b8160 2023-07-11T00:00:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f7484759700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c143200 con 0x7f747c141840 2023-07-11T00:00:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f7484759700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c144e70 con 0x7f747c147460 2023-07-11T00:00:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f7482cf6700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c147460 0x7f747c13e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f7481cf4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747c141840 0x7f747c0bb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f7482cf6700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c147460 0x7f747c13e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:40516/0 (socket says 172.21.15.70:40516) 2023-07-11T00:00:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f7482cf6700 1 -- 172.21.15.70:0/3378718227 learned_addr learned my addr 172.21.15.70:0/3378718227 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-07-11T00:00:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.495+0000 7f74824f5700 1 --2- 172.21.15.70:0/3378718227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c0b8160 0x7f747c0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7482cf6700 1 -- 172.21.15.70:0/3378718227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747c141840 msgr2=0x7f747c0bb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7482cf6700 1 --2- 172.21.15.70:0/3378718227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747c141840 0x7f747c0bb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7482cf6700 1 -- 172.21.15.70:0/3378718227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c0b8160 msgr2=0x7f747c0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7482cf6700 1 --2- 172.21.15.70:0/3378718227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c0b8160 0x7f747c0b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7482cf6700 1 -- 172.21.15.70:0/3378718227 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0094a0 con 0x7f747c147460 2023-07-11T00:00:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7481cf4700 1 --2- 172.21.15.70:0/3378718227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747c141840 0x7f747c0bb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7482cf6700 1 --2- 172.21.15.70:0/3378718227 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c147460 0x7f747c13e950 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7474002230 tx=0x7f747400cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7472ffd700 1 -- 172.21.15.70:0/3378718227 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400aac0 con 0x7f747c147460 2023-07-11T00:00:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7472ffd700 1 -- 172.21.15.70:0/3378718227 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747400ac40 con 0x7f747c147460 2023-07-11T00:00:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7484759700 1 -- 172.21.15.70:0/3378718227 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74780094a0 con 0x7f747c147460 2023-07-11T00:00:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7472ffd700 1 -- 172.21.15.70:0/3378718227 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740070d0 con 0x7f747c147460 2023-07-11T00:00:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7484759700 1 -- 172.21.15.70:0/3378718227 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c142e90 con 0x7f747c147460 2023-07-11T00:00:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7472ffd700 1 -- 172.21.15.70:0/3378718227 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7474007550 con 0x7f747c147460 2023-07-11T00:00:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.496+0000 7f7472ffd700 1 -- 172.21.15.70:0/3378718227 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7474012a60 con 0x7f747c147460 2023-07-11T00:00:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.497+0000 7f7484759700 1 -- 172.21.15.70:0/3378718227 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c143370 con 0x7f747c147460 2023-07-11T00:00:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.499+0000 7f7472ffd700 1 -- 172.21.15.70:0/3378718227 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f7474018070 con 0x7f747c147460 2023-07-11T00:00:00.550 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:00.547+0000 7f9338cc5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-11T00:00:00.575 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:00.573+0000 7fef764e2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-11T00:00:00.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.583+0000 7f7484759700 1 -- 172.21.15.70:0/3378718227 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e5433b75-e894-4f42-93c3-e7a15a0a2345", "id": 7} v 0) v1 -- 0x7f747c074360 con 0x7f747c147460 2023-07-11T00:00:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.590+0000 7f7472ffd700 1 -- 172.21.15.70:0/3378718227 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5433b75-e894-4f42-93c3-e7a15a0a2345", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f747401d440 con 0x7f747c147460 2023-07-11T00:00:00.592 INFO:teuthology.orchestra.run.smithi070.stdout:7 2023-07-11T00:00:00.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.591+0000 7f7484759700 1 -- 172.21.15.70:0/3378718227 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c147460 msgr2=0x7f747c13e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.591+0000 7f7484759700 1 --2- 172.21.15.70:0/3378718227 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c147460 0x7f747c13e950 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7474002230 tx=0x7f747400cf50 comp rx=0 tx=0).stop 2023-07-11T00:00:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.591+0000 7f7484759700 1 -- 172.21.15.70:0/3378718227 shutdown_connections 2023-07-11T00:00:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.591+0000 7f7484759700 1 --2- 172.21.15.70:0/3378718227 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f747c147460 0x7f747c13e950 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.591+0000 7f7484759700 1 --2- 172.21.15.70:0/3378718227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c0b8160 0x7f747c0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.591+0000 7f7484759700 1 --2- 172.21.15.70:0/3378718227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f747c141840 0x7f747c0bb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.591+0000 7f7484759700 1 -- 172.21.15.70:0/3378718227 >> 172.21.15.70:0/3378718227 conn(0x7f747c069f30 msgr2=0x7f747c145f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.591+0000 7f7484759700 1 -- 172.21.15.70:0/3378718227 shutdown_connections 2023-07-11T00:00:00.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-11T00:00:00.591+0000 7f7484759700 1 -- 172.21.15.70:0/3378718227 wait complete. 2023-07-11T00:00:00.605 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-11T00:00:00.605 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-11T00:00:00.607 INFO:tasks.ceph.osd.0:Started 2023-07-11T00:00:00.608 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-11T00:00:00.608 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-11T00:00:00.610 INFO:tasks.ceph.osd.1:Started 2023-07-11T00:00:00.610 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-11T00:00:00.611 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-11T00:00:00.613 INFO:tasks.ceph.osd.2:Started 2023-07-11T00:00:00.613 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-11T00:00:00.614 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-11T00:00:00.615 INFO:tasks.ceph.osd.3:Started 2023-07-11T00:00:00.616 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-11T00:00:00.616 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-11T00:00:00.618 INFO:tasks.ceph.osd.4:Started 2023-07-11T00:00:00.618 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-11T00:00:00.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-11T00:00:00.620 INFO:tasks.ceph.osd.5:Started 2023-07-11T00:00:00.621 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-11T00:00:00.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-11T00:00:00.623 INFO:tasks.ceph.osd.6:Started 2023-07-11T00:00:00.623 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-11T00:00:00.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-11T00:00:00.625 INFO:tasks.ceph.osd.7:Started 2023-07-11T00:00:00.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:00.633 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:00.630+0000 7f9338cc5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-11T00:00:00.662 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:00.660+0000 7fef764e2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-11T00:00:00.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.800+0000 7fb669fc4700 1 Processor -- start 2023-07-11T00:00:00.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.800+0000 7fb669fc4700 1 -- start start 2023-07-11T00:00:00.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.801+0000 7fb669fc4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6641449d0 0x7fb66414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.801+0000 7fb669fc4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6640b8620 con 0x7fb6640bc810 2023-07-11T00:00:00.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.801+0000 7fb669fc4700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6640b8900 con 0x7fb6640b8d90 2023-07-11T00:00:00.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.801+0000 7fb669fc4700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6640b97a0 con 0x7fb6641449d0 2023-07-11T00:00:00.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.801+0000 7fb662ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb6640bc810 0x7fb6640ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47396/0 (socket says 172.21.15.38:47396) 2023-07-11T00:00:00.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.801+0000 7fb662ffd700 1 -- 172.21.15.38:0/761902277 learned_addr learned my addr 172.21.15.38:0/761902277 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:00.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.801+0000 7fb6637fe700 1 --2- 172.21.15.38:0/761902277 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6641449d0 0x7fb66414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.802+0000 7fb6627fc700 1 -- 172.21.15.38:0/761902277 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717426355 0 0) 0x7fb6640b8620 con 0x7fb6640bc810 2023-07-11T00:00:00.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.802+0000 7fb6627fc700 1 -- 172.21.15.38:0/761902277 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb64c0035b0 con 0x7fb6640bc810 2023-07-11T00:00:00.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.802+0000 7fb6627fc700 1 -- 172.21.15.38:0/761902277 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161953255 0 0) 0x7fb6640b8900 con 0x7fb6640b8d90 2023-07-11T00:00:00.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.802+0000 7fb6627fc700 1 -- 172.21.15.38:0/761902277 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6640b8620 con 0x7fb6640b8d90 2023-07-11T00:00:00.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.802+0000 7fb6637fe700 1 -- 172.21.15.38:0/761902277 >> v1:172.21.15.70:6789/0 conn(0x7fb6640b8d90 legacy=0x7fb66406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.802+0000 7fb6637fe700 1 -- 172.21.15.38:0/761902277 >> v1:172.21.15.38:6789/0 conn(0x7fb6640bc810 legacy=0x7fb6640ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.802+0000 7fb6637fe700 1 -- 172.21.15.38:0/761902277 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6640bac40 con 0x7fb6641449d0 2023-07-11T00:00:00.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.802+0000 7fb6637fe700 1 --2- 172.21.15.38:0/761902277 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6641449d0 0x7fb66414db50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb654009870 tx=0x7fb654009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4883f1fc7b21390 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:00.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.802+0000 7fb6627fc700 1 -- 172.21.15.38:0/761902277 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654011830 con 0x7fb6641449d0 2023-07-11T00:00:00.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.802+0000 7fb6627fc700 1 -- 172.21.15.38:0/761902277 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb654011990 con 0x7fb6641449d0 2023-07-11T00:00:00.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.802+0000 7fb6627fc700 1 -- 172.21.15.38:0/761902277 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654011d20 con 0x7fb6641449d0 2023-07-11T00:00:00.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.803+0000 7fb669fc4700 1 -- 172.21.15.38:0/761902277 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6641449d0 msgr2=0x7fb66414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.803+0000 7fb669fc4700 1 --2- 172.21.15.38:0/761902277 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6641449d0 0x7fb66414db50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb654009870 tx=0x7fb654009b80 comp rx=0 tx=0).stop 2023-07-11T00:00:00.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.803+0000 7fb669fc4700 1 -- 172.21.15.38:0/761902277 shutdown_connections 2023-07-11T00:00:00.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.803+0000 7fb669fc4700 1 --2- 172.21.15.38:0/761902277 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6641449d0 0x7fb66414db50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.803+0000 7fb669fc4700 1 -- 172.21.15.38:0/761902277 >> 172.21.15.38:0/761902277 conn(0x7fb6640c0860 msgr2=0x7fb6640c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:00.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.803+0000 7fb669fc4700 1 -- 172.21.15.38:0/761902277 shutdown_connections 2023-07-11T00:00:00.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.803+0000 7fb669fc4700 1 -- 172.21.15.38:0/761902277 wait complete. 2023-07-11T00:00:00.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.804+0000 7fb669fc4700 1 Processor -- start 2023-07-11T00:00:00.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.804+0000 7fb669fc4700 1 -- start start 2023-07-11T00:00:00.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb669fc4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6640b8d90 0x7fb6641d7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb669fc4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6640bc810 0x7fb664144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb669fc4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6641449d0 0x7fb6640b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:00.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb669fc4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6641d7990 con 0x7fb6640bc810 2023-07-11T00:00:00.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb669fc4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6641e3290 con 0x7fb6640b8d90 2023-07-11T00:00:00.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb669fc4700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6641e3b30 con 0x7fb6641449d0 2023-07-11T00:00:00.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb662ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6640bc810 0x7fb664144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb662ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6640bc810 0x7fb664144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52208/0 (socket says 172.21.15.38:52208) 2023-07-11T00:00:00.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb663fff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6641449d0 0x7fb6640b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb6637fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6640b8d90 0x7fb6641d7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:00.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb662ffd700 1 -- 172.21.15.38:0/1536927949 learned_addr learned my addr 172.21.15.38:0/1536927949 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:00.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb6637fe700 1 -- 172.21.15.38:0/1536927949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6641449d0 msgr2=0x7fb6640b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb6637fe700 1 --2- 172.21.15.38:0/1536927949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6641449d0 0x7fb6640b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb6637fe700 1 -- 172.21.15.38:0/1536927949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6640bc810 msgr2=0x7fb664144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.805+0000 7fb6637fe700 1 --2- 172.21.15.38:0/1536927949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6640bc810 0x7fb664144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.806+0000 7fb6637fe700 1 -- 172.21.15.38:0/1536927949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540094a0 con 0x7fb6640b8d90 2023-07-11T00:00:00.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.806+0000 7fb6637fe700 1 --2- 172.21.15.38:0/1536927949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6640b8d90 0x7fb6641d7450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb654016000 tx=0x7fb654004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:00.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.806+0000 7fb64bfff700 1 -- 172.21.15.38:0/1536927949 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65401a6e0 con 0x7fb6640b8d90 2023-07-11T00:00:00.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.806+0000 7fb64bfff700 1 -- 172.21.15.38:0/1536927949 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65401a860 con 0x7fb6640b8d90 2023-07-11T00:00:00.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.806+0000 7fb64bfff700 1 -- 172.21.15.38:0/1536927949 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65401ac10 con 0x7fb6640b8d90 2023-07-11T00:00:00.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.806+0000 7fb669fc4700 1 -- 172.21.15.38:0/1536927949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6640b72f0 con 0x7fb6640b8d90 2023-07-11T00:00:00.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.806+0000 7fb669fc4700 1 -- 172.21.15.38:0/1536927949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6641e34e0 con 0x7fb6640b8d90 2023-07-11T00:00:00.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.806+0000 7fb64bfff700 1 -- 172.21.15.38:0/1536927949 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb654022070 con 0x7fb6640b8d90 2023-07-11T00:00:00.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.807+0000 7fb669fc4700 1 -- 172.21.15.38:0/1536927949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb664074360 con 0x7fb6640b8d90 2023-07-11T00:00:00.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.809+0000 7fb64bfff700 1 -- 172.21.15.38:0/1536927949 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb65401ad70 con 0x7fb6640b8d90 2023-07-11T00:00:00.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.811+0000 7fb64bfff700 1 -- 172.21.15.38:0/1536927949 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fb654029070 con 0x7fb6640b8d90 2023-07-11T00:00:00.815 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:00.813+0000 7fef764e2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-11T00:00:00.819 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:00.817+0000 7f9338cc5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-11T00:00:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.882+0000 7fb669fc4700 1 -- 172.21.15.38:0/1536927949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6640bc330 con 0x7fb6640b8d90 2023-07-11T00:00:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.883+0000 7fb64bfff700 1 -- 172.21.15.38:0/1536927949 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb654015020 con 0x7fb6640b8d90 2023-07-11T00:00:00.885 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:00.886 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":10,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:00.584914+0000","last_up_change":"0.000000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:00.886 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:00.883+0000 7fef764e2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-11T00:00:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.883+0000 7fb669fc4700 1 -- 172.21.15.38:0/1536927949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6640b8d90 msgr2=0x7fb6641d7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.883+0000 7fb669fc4700 1 --2- 172.21.15.38:0/1536927949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6640b8d90 0x7fb6641d7450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb654016000 tx=0x7fb654004750 comp rx=0 tx=0).stop 2023-07-11T00:00:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.884+0000 7fb669fc4700 1 -- 172.21.15.38:0/1536927949 shutdown_connections 2023-07-11T00:00:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.884+0000 7fb669fc4700 1 --2- 172.21.15.38:0/1536927949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6641449d0 0x7fb6640b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.884+0000 7fb669fc4700 1 --2- 172.21.15.38:0/1536927949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6640b8d90 0x7fb6641d7450 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.884+0000 7fb669fc4700 1 --2- 172.21.15.38:0/1536927949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6640bc810 0x7fb664144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.884+0000 7fb669fc4700 1 -- 172.21.15.38:0/1536927949 >> 172.21.15.38:0/1536927949 conn(0x7fb6640c0860 msgr2=0x7fb6640baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.884+0000 7fb669fc4700 1 -- 172.21.15.38:0/1536927949 shutdown_connections 2023-07-11T00:00:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:00.884+0000 7fb669fc4700 1 -- 172.21.15.38:0/1536927949 wait complete. 2023-07-11T00:00:00.897 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:00.894+0000 7f9338cc5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-11T00:00:00.898 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-11T00:00:00.899 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-11T00:00:00.986 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-07-11T00:00:00.983+0000 7f85560cc640 -1 Falling back to public interface 2023-07-11T00:00:01.067 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:01.065+0000 7fef764e2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-11T00:00:01.086 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:01.083+0000 7f9338cc5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-11T00:00:01.147 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:01.145+0000 7fef764e2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-11T00:00:01.168 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:01.166+0000 7f9338cc5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-11T00:00:01.223 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-07-11T00:00:01.221+0000 7f1cad06b640 -1 Falling back to public interface 2023-07-11T00:00:01.225 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:01.223+0000 7fef764e2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-11T00:00:01.231 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-07-11T00:00:01.229+0000 7fc907344640 -1 Falling back to public interface 2023-07-11T00:00:01.246 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-07-11T00:00:01.244+0000 7f81826ac640 -1 Falling back to public interface 2023-07-11T00:00:01.249 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:01.247+0000 7f9338cc5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-11T00:00:01.257 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-07-11T00:00:01.255+0000 7f90ad9bd640 -1 Falling back to public interface 2023-07-11T00:00:01.275 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-07-11T00:00:01.272+0000 7f13e5ff8640 -1 Falling back to public interface 2023-07-11T00:00:01.282 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-07-11T00:00:01.280+0000 7efc718a9640 -1 Falling back to public interface 2023-07-11T00:00:01.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-07-11T00:00:01.288+0000 7f4049fac640 -1 Falling back to public interface 2023-07-11T00:00:01.323 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:01.321+0000 7fef764e2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-11T00:00:01.351 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:01.348+0000 7f9338cc5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-11T00:00:01.506 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:01.504+0000 7fef764e2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-11T00:00:01.540 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:01.537+0000 7f9338cc5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-11T00:00:01.589 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:01.587+0000 7fef764e2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-11T00:00:01.625 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:01.622+0000 7f9338cc5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-11T00:00:01.705 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:01.824 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.821+0000 7fee6241d700 1 Processor -- start 2023-07-11T00:00:01.824 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.821+0000 7fee6241d700 1 -- start start 2023-07-11T00:00:01.826 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee6241d700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fee5c147460 0x7fee5c0b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:01.826 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee6241d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c1482e0 con 0x7fee5c14ab60 2023-07-11T00:00:01.826 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee6241d700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c1479b0 con 0x7fee5c0b8160 2023-07-11T00:00:01.826 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee6241d700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5c06e4f0 con 0x7fee5c147460 2023-07-11T00:00:01.826 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee609ba700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fee5c14ab60 0x7fee5c14afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47408/0 (socket says 172.21.15.38:47408) 2023-07-11T00:00:01.827 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee609ba700 1 -- 172.21.15.38:0/2814779734 learned_addr learned my addr 172.21.15.38:0/2814779734 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:01.827 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee5b7fe700 1 --2- 172.21.15.38:0/2814779734 >> v2:172.21.15.70:3300/0 conn(0x7fee5c147460 0x7fee5c0b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:01.827 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee5affd700 1 -- 172.21.15.38:0/2814779734 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893133150 0 0) 0x7fee5c1482e0 con 0x7fee5c14ab60 2023-07-11T00:00:01.827 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee5affd700 1 -- 172.21.15.38:0/2814779734 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee440035b0 con 0x7fee5c14ab60 2023-07-11T00:00:01.827 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee5b7fe700 1 -- 172.21.15.38:0/2814779734 >> v1:172.21.15.70:6789/0 conn(0x7fee5c0b8160 legacy=0x7fee5c141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:01.827 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee5affd700 1 -- 172.21.15.38:0/2814779734 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023302912 0 0) 0x7fee5c1479b0 con 0x7fee5c0b8160 2023-07-11T00:00:01.828 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee5b7fe700 1 -- 172.21.15.38:0/2814779734 >> v1:172.21.15.38:6789/0 conn(0x7fee5c14ab60 legacy=0x7fee5c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:01.828 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.822+0000 7fee5b7fe700 1 -- 172.21.15.38:0/2814779734 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c147c90 con 0x7fee5c147460 2023-07-11T00:00:01.828 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.823+0000 7fee5b7fe700 1 --2- 172.21.15.38:0/2814779734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c147460 0x7fee5c0b5c20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee50009840 tx=0x7fee50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c35263999ecbafb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:01.828 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.823+0000 7fee5affd700 1 -- 172.21.15.38:0/2814779734 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50011830 con 0x7fee5c147460 2023-07-11T00:00:01.828 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.823+0000 7fee5affd700 1 -- 172.21.15.38:0/2814779734 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee50011990 con 0x7fee5c147460 2023-07-11T00:00:01.828 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.823+0000 7fee5affd700 1 -- 172.21.15.38:0/2814779734 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50011d20 con 0x7fee5c147460 2023-07-11T00:00:01.828 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.823+0000 7fee6241d700 1 -- 172.21.15.38:0/2814779734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c147460 msgr2=0x7fee5c0b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:01.829 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.823+0000 7fee6241d700 1 --2- 172.21.15.38:0/2814779734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c147460 0x7fee5c0b5c20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee50009840 tx=0x7fee50009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:01.829 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.823+0000 7fee6241d700 1 -- 172.21.15.38:0/2814779734 shutdown_connections 2023-07-11T00:00:01.829 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.823+0000 7fee6241d700 1 --2- 172.21.15.38:0/2814779734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c147460 0x7fee5c0b5c20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:01.829 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.823+0000 7fee6241d700 1 -- 172.21.15.38:0/2814779734 >> 172.21.15.38:0/2814779734 conn(0x7fee5c069f30 msgr2=0x7fee5c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:01.829 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.823+0000 7fee6241d700 1 -- 172.21.15.38:0/2814779734 shutdown_connections 2023-07-11T00:00:01.829 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.823+0000 7fee6241d700 1 -- 172.21.15.38:0/2814779734 wait complete. 2023-07-11T00:00:01.832 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.824+0000 7fee6241d700 1 Processor -- start 2023-07-11T00:00:01.832 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.825+0000 7fee6241d700 1 -- start start 2023-07-11T00:00:01.832 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.825+0000 7fee6241d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee5c0b8160 0x7fee5c0bbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:01.832 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.825+0000 7fee6241d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee5c147460 0x7fee5c149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:01.832 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.825+0000 7fee6241d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c14ab60 0x7fee5c13cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:01.833 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.825+0000 7fee6241d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0bc200 con 0x7fee5c147460 2023-07-11T00:00:01.833 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.825+0000 7fee6241d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1485a0 con 0x7fee5c14ab60 2023-07-11T00:00:01.833 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.825+0000 7fee6241d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c14a260 con 0x7fee5c0b8160 2023-07-11T00:00:01.833 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.825+0000 7fee5b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee5c147460 0x7fee5c149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:01.833 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.825+0000 7fee5b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee5c147460 0x7fee5c149d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52210/0 (socket says 172.21.15.38:52210) 2023-07-11T00:00:01.833 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.825+0000 7fee5b7fe700 1 -- 172.21.15.38:0/1658452981 learned_addr learned my addr 172.21.15.38:0/1658452981 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:01.834 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.825+0000 7fee5bfff700 1 --2- 172.21.15.38:0/1658452981 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee5c0b8160 0x7fee5c0bbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:01.834 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee609ba700 1 --2- 172.21.15.38:0/1658452981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c14ab60 0x7fee5c13cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:01.834 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee5b7fe700 1 -- 172.21.15.38:0/1658452981 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee5c0b8160 msgr2=0x7fee5c0bbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:01.834 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee5b7fe700 1 --2- 172.21.15.38:0/1658452981 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee5c0b8160 0x7fee5c0bbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:01.834 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee5b7fe700 1 -- 172.21.15.38:0/1658452981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c14ab60 msgr2=0x7fee5c13cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:01.834 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee5b7fe700 1 --2- 172.21.15.38:0/1658452981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c14ab60 0x7fee5c13cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:01.834 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee5b7fe700 1 -- 172.21.15.38:0/1658452981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500094a0 con 0x7fee5c147460 2023-07-11T00:00:01.835 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee609ba700 1 --2- 172.21.15.38:0/1658452981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c14ab60 0x7fee5c13cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:01.835 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee5b7fe700 1 --2- 172.21.15.38:0/1658452981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee5c147460 0x7fee5c149d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fee500090b0 tx=0x7fee50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:01.835 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee58ff9700 1 -- 172.21.15.38:0/1658452981 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5001a860 con 0x7fee5c147460 2023-07-11T00:00:01.835 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee58ff9700 1 -- 172.21.15.38:0/1658452981 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5001a9c0 con 0x7fee5c147460 2023-07-11T00:00:01.835 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee6241d700 1 -- 172.21.15.38:0/1658452981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c149450 con 0x7fee5c147460 2023-07-11T00:00:01.835 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee58ff9700 1 -- 172.21.15.38:0/1658452981 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5001ad30 con 0x7fee5c147460 2023-07-11T00:00:01.835 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee6241d700 1 -- 172.21.15.38:0/1658452981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c1499a0 con 0x7fee5c147460 2023-07-11T00:00:01.835 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.826+0000 7fee58ff9700 1 -- 172.21.15.38:0/1658452981 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fee50022070 con 0x7fee5c147460 2023-07-11T00:00:01.836 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.827+0000 7fee58ff9700 1 -- 172.21.15.38:0/1658452981 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fee50024af0 con 0x7fee5c147460 2023-07-11T00:00:01.836 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.827+0000 7fee6241d700 1 -- 172.21.15.38:0/1658452981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c148750 con 0x7fee5c147460 2023-07-11T00:00:01.836 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.829+0000 7fee58ff9700 1 -- 172.21.15.38:0/1658452981 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fee5c148750 con 0x7fee5c147460 2023-07-11T00:00:01.887 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:01.885+0000 7fef764e2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-11T00:00:01.903 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.900+0000 7fee6241d700 1 -- 172.21.15.38:0/1658452981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee5c074360 con 0x7fee5c147460 2023-07-11T00:00:01.904 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.901+0000 7fee58ff9700 1 -- 172.21.15.38:0/1658452981 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fee50029070 con 0x7fee5c147460 2023-07-11T00:00:01.904 INFO:teuthology.misc.health.smithi038.stdout: 2023-07-11T00:00:01.904 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":10,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:00.584914+0000","last_up_change":"0.000000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:01.906 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.901+0000 7fee6241d700 1 -- 172.21.15.38:0/1658452981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee5c147460 msgr2=0x7fee5c149d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:01.906 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.901+0000 7fee6241d700 1 --2- 172.21.15.38:0/1658452981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee5c147460 0x7fee5c149d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fee500090b0 tx=0x7fee50004750 comp rx=0 tx=0).stop 2023-07-11T00:00:01.906 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.901+0000 7fee6241d700 1 -- 172.21.15.38:0/1658452981 shutdown_connections 2023-07-11T00:00:01.906 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.901+0000 7fee6241d700 1 --2- 172.21.15.38:0/1658452981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c14ab60 0x7fee5c13cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:01.906 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.901+0000 7fee6241d700 1 --2- 172.21.15.38:0/1658452981 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee5c0b8160 0x7fee5c0bbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:01.906 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.902+0000 7fee6241d700 1 --2- 172.21.15.38:0/1658452981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee5c147460 0x7fee5c149d20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:01.907 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.902+0000 7fee6241d700 1 -- 172.21.15.38:0/1658452981 >> 172.21.15.38:0/1658452981 conn(0x7fee5c069f30 msgr2=0x7fee5c1396b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:01.907 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.902+0000 7fee6241d700 1 -- 172.21.15.38:0/1658452981 shutdown_connections 2023-07-11T00:00:01.907 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:01.902+0000 7fee6241d700 1 -- 172.21.15.38:0/1658452981 wait complete. 2023-07-11T00:00:01.915 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-11T00:00:01.930 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:01.927+0000 7f9338cc5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-11T00:00:01.958 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:01.956+0000 7fef764e2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-11T00:00:02.004 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:02.002+0000 7f9338cc5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-11T00:00:02.478 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:02.476+0000 7fef764e2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-11T00:00:02.548 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:02.546+0000 7f9338cc5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-11T00:00:02.798 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:02.796+0000 7fef764e2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-11T00:00:02.889 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:02.888+0000 7f9338cc5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-11T00:00:02.944 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:02.942+0000 7fef764e2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-11T00:00:03.040 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:03.037+0000 7f9338cc5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-11T00:00:03.305 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:03.303+0000 7fef764e2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-11T00:00:03.418 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:03.417+0000 7f9338cc5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-11T00:00:03.454 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:03.451+0000 7fef764e2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-11T00:00:03.573 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:03.572+0000 7f9338cc5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-11T00:00:03.607 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:03.605+0000 7fef764e2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-11T00:00:03.735 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:03.733+0000 7f9338cc5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-11T00:00:03.923 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:03.921+0000 7fef764e2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-11T00:00:04.102 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-07-11T00:00:04.100+0000 7f9338cc5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-11T00:00:04.502 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-07-11T00:00:04.500+0000 7f85560cc640 -1 osd.0 0 log_to_monitors true 2023-07-11T00:00:04.725 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-07-11T00:00:04.723+0000 7fc907344640 -1 osd.5 0 log_to_monitors true 2023-07-11T00:00:04.736 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-07-11T00:00:04.734+0000 7f1cad06b640 -1 osd.4 0 log_to_monitors true 2023-07-11T00:00:04.745 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-07-11T00:00:04.743+0000 7f81826ac640 -1 osd.7 0 log_to_monitors true 2023-07-11T00:00:04.760 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-07-11T00:00:04.758+0000 7f90ad9bd640 -1 osd.6 0 log_to_monitors true 2023-07-11T00:00:04.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-07-11T00:00:04.815+0000 7f4049fac640 -1 osd.1 0 log_to_monitors true 2023-07-11T00:00:04.821 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-07-11T00:00:04.819+0000 7f13e5ff8640 -1 osd.2 0 log_to_monitors true 2023-07-11T00:00:04.836 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-07-11T00:00:04.834+0000 7efc718a9640 -1 osd.3 0 log_to_monitors true 2023-07-11T00:00:04.956 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:04.953+0000 7fef378ff700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-11T00:00:04.956 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-11T00:00:04.954+0000 7fef378ff700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-11T00:00:07.227 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-07-11T00:00:07.225+0000 7f1ca0c0b700 -1 osd.4 0 waiting for initial osdmap 2023-07-11T00:00:07.239 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-07-11T00:00:07.237+0000 7f1c98fe6700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:00:07.288 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-07-11T00:00:07.286+0000 7f817624c700 -1 osd.7 0 waiting for initial osdmap 2023-07-11T00:00:07.303 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-07-11T00:00:07.301+0000 7f90a155d700 -1 osd.6 0 waiting for initial osdmap 2023-07-11T00:00:07.305 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-07-11T00:00:07.303+0000 7f816e627700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:00:07.322 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-07-11T00:00:07.320+0000 7f9099938700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:00:07.332 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-07-11T00:00:07.329+0000 7fc8faee4700 -1 osd.5 0 waiting for initial osdmap 2023-07-11T00:00:07.345 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-07-11T00:00:07.343+0000 7fc8f32bf700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:00:07.657 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-07-11T00:00:07.655+0000 7f8549c6c700 -1 osd.0 0 waiting for initial osdmap 2023-07-11T00:00:07.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-07-11T00:00:07.659+0000 7f403db4c700 -1 osd.1 0 waiting for initial osdmap 2023-07-11T00:00:07.670 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-07-11T00:00:07.669+0000 7f8542047700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:00:07.675 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-07-11T00:00:07.674+0000 7efc65449700 -1 osd.3 0 waiting for initial osdmap 2023-07-11T00:00:07.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-07-11T00:00:07.674+0000 7f4035f27700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:00:07.684 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-07-11T00:00:07.682+0000 7f13d9b98700 -1 osd.2 0 waiting for initial osdmap 2023-07-11T00:00:07.687 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-07-11T00:00:07.686+0000 7efc5d824700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:00:07.697 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-07-11T00:00:07.696+0000 7f13d1f73700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-11T00:00:08.722 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:08.851 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.850+0000 7ffa24d3b700 1 Processor -- start 2023-07-11T00:00:08.852 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.850+0000 7ffa24d3b700 1 -- start start 2023-07-11T00:00:08.853 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa24d3b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa201449d0 0x7ffa2014db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:08.853 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa24d3b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa200b8620 con 0x7ffa200bc810 2023-07-11T00:00:08.853 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa24d3b700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa200b8900 con 0x7ffa200b8d90 2023-07-11T00:00:08.854 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa24d3b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa200b97a0 con 0x7ffa201449d0 2023-07-11T00:00:08.854 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa1e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa201449d0 0x7ffa2014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:08.854 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa1dd9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ffa200bc810 0x7ffa200ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47422/0 (socket says 172.21.15.38:47422) 2023-07-11T00:00:08.854 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa1dd9b700 1 -- 172.21.15.38:0/2633215613 learned_addr learned my addr 172.21.15.38:0/2633215613 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:08.854 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa1e59c700 1 -- 172.21.15.38:0/2633215613 >> v1:172.21.15.70:6789/0 conn(0x7ffa200b8d90 legacy=0x7ffa2006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:08.854 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa1e59c700 1 -- 172.21.15.38:0/2633215613 >> v1:172.21.15.38:6789/0 conn(0x7ffa200bc810 legacy=0x7ffa200ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:08.854 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa1d59a700 1 -- 172.21.15.38:0/2633215613 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938451139 0 0) 0x7ffa200b8620 con 0x7ffa200bc810 2023-07-11T00:00:08.854 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa1e59c700 1 -- 172.21.15.38:0/2633215613 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa200bac40 con 0x7ffa201449d0 2023-07-11T00:00:08.855 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.851+0000 7ffa1e59c700 1 --2- 172.21.15.38:0/2633215613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa201449d0 0x7ffa2014db50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009840 tx=0x7ffa10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb9d00e972e42eb server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:08.855 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.852+0000 7ffa1d59a700 1 -- 172.21.15.38:0/2633215613 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10011830 con 0x7ffa201449d0 2023-07-11T00:00:08.855 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.852+0000 7ffa1d59a700 1 -- 172.21.15.38:0/2633215613 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa10011990 con 0x7ffa201449d0 2023-07-11T00:00:08.855 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.852+0000 7ffa1d59a700 1 -- 172.21.15.38:0/2633215613 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10011d20 con 0x7ffa201449d0 2023-07-11T00:00:08.857 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.852+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2633215613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa201449d0 msgr2=0x7ffa2014db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:08.857 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.852+0000 7ffa24d3b700 1 --2- 172.21.15.38:0/2633215613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa201449d0 0x7ffa2014db50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009840 tx=0x7ffa10009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:08.858 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.852+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2633215613 shutdown_connections 2023-07-11T00:00:08.858 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.852+0000 7ffa24d3b700 1 --2- 172.21.15.38:0/2633215613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa201449d0 0x7ffa2014db50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:08.858 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.852+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2633215613 >> 172.21.15.38:0/2633215613 conn(0x7ffa200c0860 msgr2=0x7ffa200c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:08.858 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.852+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2633215613 shutdown_connections 2023-07-11T00:00:08.858 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.852+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2633215613 wait complete. 2023-07-11T00:00:08.858 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.853+0000 7ffa24d3b700 1 Processor -- start 2023-07-11T00:00:08.858 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.854+0000 7ffa24d3b700 1 -- start start 2023-07-11T00:00:08.859 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.854+0000 7ffa24d3b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa200b8d90 0x7ffa200b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:08.859 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.854+0000 7ffa24d3b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa200bc810 0x7ffa20149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:08.859 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.854+0000 7ffa24d3b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa201449d0 0x7ffa2014ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:08.859 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.854+0000 7ffa24d3b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200b6820 con 0x7ffa201449d0 2023-07-11T00:00:08.859 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.854+0000 7ffa24d3b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa201483f0 con 0x7ffa200bc810 2023-07-11T00:00:08.859 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.854+0000 7ffa24d3b700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2014a050 con 0x7ffa200b8d90 2023-07-11T00:00:08.859 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.854+0000 7ffa1ed9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa201449d0 0x7ffa2014ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:08.859 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.854+0000 7ffa1ed9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa201449d0 0x7ffa2014ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52276/0 (socket says 172.21.15.38:52276) 2023-07-11T00:00:08.860 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.854+0000 7ffa1ed9d700 1 -- 172.21.15.38:0/2343725898 learned_addr learned my addr 172.21.15.38:0/2343725898 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:08.860 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.854+0000 7ffa1e59c700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa200b8d90 0x7ffa200b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:08.860 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa1dd9b700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa200bc810 0x7ffa20149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:08.860 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa1ed9d700 1 -- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa200b8d90 msgr2=0x7ffa200b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:08.860 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa1ed9d700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa200b8d90 0x7ffa200b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:08.860 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa1ed9d700 1 -- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa200bc810 msgr2=0x7ffa20149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:08.860 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa1ed9d700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa200bc810 0x7ffa20149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:08.861 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa1ed9d700 1 -- 172.21.15.38:0/2343725898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa100094a0 con 0x7ffa201449d0 2023-07-11T00:00:08.861 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa1ed9d700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa201449d0 0x7ffa2014ac40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800cc50 tx=0x7ffa1800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:08.861 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa0effd700 1 -- 172.21.15.38:0/2343725898 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18003c00 con 0x7ffa201449d0 2023-07-11T00:00:08.861 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa0effd700 1 -- 172.21.15.38:0/2343725898 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa18003d60 con 0x7ffa201449d0 2023-07-11T00:00:08.861 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2343725898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa20148600 con 0x7ffa201449d0 2023-07-11T00:00:08.861 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa0effd700 1 -- 172.21.15.38:0/2343725898 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800abb0 con 0x7ffa201449d0 2023-07-11T00:00:08.861 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.855+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2343725898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa20148bc0 con 0x7ffa201449d0 2023-07-11T00:00:08.862 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.856+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2343725898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa20074360 con 0x7ffa201449d0 2023-07-11T00:00:08.862 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.857+0000 7ffa0effd700 1 -- 172.21.15.38:0/2343725898 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7ffa1800ad10 con 0x7ffa201449d0 2023-07-11T00:00:08.862 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.857+0000 7ffa0effd700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffa0006ac50 0x7ffa0006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:08.863 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.857+0000 7ffa0effd700 1 -- 172.21.15.38:0/2343725898 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7ffa18088de0 con 0x7ffa201449d0 2023-07-11T00:00:08.863 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.857+0000 7ffa1e59c700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffa0006ac50 0x7ffa0006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:08.863 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.858+0000 7ffa1e59c700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffa0006ac50 0x7ffa0006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffa10000c00 tx=0x7ffa1001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:08.863 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:08.862+0000 7ffa0effd700 1 -- 172.21.15.38:0/2343725898 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ffa180545a0 con 0x7ffa201449d0 2023-07-11T00:00:09.062 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.061+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2343725898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa200bc330 con 0x7ffa201449d0 2023-07-11T00:00:09.063 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.061+0000 7ffa0effd700 1 -- 172.21.15.38:0/2343725898 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10848 (secure 0 0 0) 0x7ffa1806be60 con 0x7ffa201449d0 2023-07-11T00:00:09.063 INFO:teuthology.misc.health.smithi038.stdout: 2023-07-11T00:00:09.063 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":13,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:08.230033+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:09.065 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.063+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffa0006ac50 msgr2=0x7ffa0006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:09.065 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.063+0000 7ffa24d3b700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffa0006ac50 0x7ffa0006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffa10000c00 tx=0x7ffa1001c040 comp rx=0 tx=0).stop 2023-07-11T00:00:09.066 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.063+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2343725898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa201449d0 msgr2=0x7ffa2014ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:09.066 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.063+0000 7ffa24d3b700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa201449d0 0x7ffa2014ac40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800cc50 tx=0x7ffa1800a340 comp rx=0 tx=0).stop 2023-07-11T00:00:09.066 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.064+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2343725898 shutdown_connections 2023-07-11T00:00:09.066 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.064+0000 7ffa24d3b700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffa0006ac50 0x7ffa0006d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:09.066 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.064+0000 7ffa24d3b700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa201449d0 0x7ffa2014ac40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:09.066 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.064+0000 7ffa24d3b700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa200b8d90 0x7ffa200b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:09.066 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.064+0000 7ffa24d3b700 1 --2- 172.21.15.38:0/2343725898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa200bc810 0x7ffa20149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:09.067 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.064+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2343725898 >> 172.21.15.38:0/2343725898 conn(0x7ffa200c0860 msgr2=0x7ffa20143cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:09.067 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.064+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2343725898 shutdown_connections 2023-07-11T00:00:09.067 INFO:teuthology.misc.health.smithi038.stderr:2023-07-11T00:00:09.064+0000 7ffa24d3b700 1 -- 172.21.15.38:0/2343725898 wait complete. 2023-07-11T00:00:09.076 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-11T00:00:09.077 INFO:tasks.ceph:Creating RBD pool 2023-07-11T00:00:09.077 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-11T00:00:09.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.201+0000 7f26d1ed4700 1 Processor -- start 2023-07-11T00:00:09.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.201+0000 7f26d1ed4700 1 -- start start 2023-07-11T00:00:09.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.201+0000 7f26d1ed4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc1449d0 0x7f26cc14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:09.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.201+0000 7f26d1ed4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc0b8620 con 0x7f26cc0b8d90 2023-07-11T00:00:09.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.201+0000 7f26d1ed4700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc0b8900 con 0x7f26cc0bc810 2023-07-11T00:00:09.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.201+0000 7f26d1ed4700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0b97a0 con 0x7f26cc1449d0 2023-07-11T00:00:09.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.202+0000 7f26cbfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f26cc0b8d90 0x7f26cc06ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47436/0 (socket says 172.21.15.38:47436) 2023-07-11T00:00:09.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.202+0000 7f26cbfff700 1 -- 172.21.15.38:0/2147535332 learned_addr learned my addr 172.21.15.38:0/2147535332 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:09.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.202+0000 7f26cb7fe700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc1449d0 0x7f26cc14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:09.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.202+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677755622 0 0) 0x7f26cc0b8620 con 0x7f26cc0b8d90 2023-07-11T00:00:09.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.202+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b40035b0 con 0x7f26cc0b8d90 2023-07-11T00:00:09.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.202+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 804018926 0 0) 0x7f26b40035b0 con 0x7f26cc0b8d90 2023-07-11T00:00:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc1449d0 msgr2=0x7f26cc14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc1449d0 0x7f26cc14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 >> v1:172.21.15.70:6789/0 conn(0x7f26cc0bc810 legacy=0x7f26cc0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0bac40 con 0x7f26cc0b8d90 2023-07-11T00:00:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f26c40019f0 con 0x7f26cc0b8d90 2023-07-11T00:00:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 >> v1:172.21.15.38:6789/0 conn(0x7f26cc0b8d90 legacy=0x7f26cc06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b4003a30 0x7f26b4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b4004850 0x7f26b4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc1449d0 0x7f26b4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0b97a0 con 0x7f26b4004850 2023-07-11T00:00:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b400bb50 con 0x7f26b4003a30 2023-07-11T00:00:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b400bce0 con 0x7f26cc1449d0 2023-07-11T00:00:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26caffd700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b4004850 0x7f26b4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26cb7fe700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b4003a30 0x7f26b4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26cbfff700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc1449d0 0x7f26b4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:09.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26caffd700 1 -- 172.21.15.38:0/2147535332 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc1449d0 msgr2=0x7f26b4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:09.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26caffd700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc1449d0 0x7f26b4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:09.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26caffd700 1 -- 172.21.15.38:0/2147535332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b4003a30 msgr2=0x7f26b4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:09.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26caffd700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b4003a30 0x7f26b4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:09.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26caffd700 1 -- 172.21.15.38:0/2147535332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b40035b0 con 0x7f26b4004850 2023-07-11T00:00:09.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26caffd700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b4004850 0x7f26b4004cc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f26c0001800 tx=0x7f26b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb3ad2ef39187d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:09.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00012f0 con 0x7f26b4004850 2023-07-11T00:00:09.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c00052f0 con 0x7f26b4004850 2023-07-11T00:00:09.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.203+0000 7f26ca7fc700 1 -- 172.21.15.38:0/2147535332 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0006860 con 0x7f26b4004850 2023-07-11T00:00:09.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.204+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2147535332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b4004850 msgr2=0x7f26b4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:09.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.204+0000 7f26d1ed4700 1 --2- 172.21.15.38:0/2147535332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b4004850 0x7f26b4004cc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f26c0001800 tx=0x7f26b4005880 comp rx=0 tx=0).stop 2023-07-11T00:00:09.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.204+0000 7f26cbfff700 1 -- 172.21.15.38:0/2147535332 reap_dead start 2023-07-11T00:00:09.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.204+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2147535332 shutdown_connections 2023-07-11T00:00:09.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.204+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2147535332 >> 172.21.15.38:0/2147535332 conn(0x7f26cc0c0860 msgr2=0x7f26cc0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:09.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.204+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2147535332 shutdown_connections 2023-07-11T00:00:09.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.204+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2147535332 wait complete. 2023-07-11T00:00:09.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.205+0000 7f26d1ed4700 1 Processor -- start 2023-07-11T00:00:09.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.205+0000 7f26d1ed4700 1 -- start start 2023-07-11T00:00:09.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26d1ed4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b4004850 0x7f26cc0a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:09.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26d1ed4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26cc0a1590 0x7f26cc0a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:09.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26d1ed4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc0a32b0 0x7f26cc1e0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:09.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26d1ed4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc147840 con 0x7f26cc0a1590 2023-07-11T00:00:09.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26d1ed4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0a1a70 con 0x7f26b4004850 2023-07-11T00:00:09.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26d1ed4700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0a2850 con 0x7f26cc0a32b0 2023-07-11T00:00:09.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26caffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26cc0a1590 0x7f26cc0a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:09.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26caffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26cc0a1590 0x7f26cc0a2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52294/0 (socket says 172.21.15.38:52294) 2023-07-11T00:00:09.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26caffd700 1 -- 172.21.15.38:0/2039823876 learned_addr learned my addr 172.21.15.38:0/2039823876 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:09.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26cb7fe700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b4004850 0x7f26cc0a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:09.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26cbfff700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc0a32b0 0x7f26cc1e0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:09.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26caffd700 1 -- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc0a32b0 msgr2=0x7f26cc1e0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:09.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26caffd700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc0a32b0 0x7f26cc1e0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:09.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26caffd700 1 -- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b4004850 msgr2=0x7f26cc0a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:09.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26caffd700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b4004850 0x7f26cc0a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:09.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26caffd700 1 -- 172.21.15.38:0/2039823876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc1dfe20 con 0x7f26cc0a1590 2023-07-11T00:00:09.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.206+0000 7f26caffd700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26cc0a1590 0x7f26cc0a2d70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f26c0001df0 tx=0x7f26c0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:09.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.207+0000 7f26b3fff700 1 -- 172.21.15.38:0/2039823876 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0003880 con 0x7f26cc0a1590 2023-07-11T00:00:09.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.207+0000 7f26b3fff700 1 -- 172.21.15.38:0/2039823876 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c00039e0 con 0x7f26cc0a1590 2023-07-11T00:00:09.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.207+0000 7f26b3fff700 1 -- 172.21.15.38:0/2039823876 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0003d90 con 0x7f26cc0a1590 2023-07-11T00:00:09.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.207+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2039823876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc1474d0 con 0x7f26cc0a1590 2023-07-11T00:00:09.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.207+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2039823876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc0a6310 con 0x7f26cc0a1590 2023-07-11T00:00:09.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.208+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2039823876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc0a6500 con 0x7f26cc0a1590 2023-07-11T00:00:09.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.208+0000 7f26b3fff700 1 -- 172.21.15.38:0/2039823876 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f26c001e450 con 0x7f26cc0a1590 2023-07-11T00:00:09.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.209+0000 7f26b3fff700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f26b806ac50 0x7f26b806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:09.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.209+0000 7f26b3fff700 1 -- 172.21.15.38:0/2039823876 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f26c0089fa0 con 0x7f26cc0a1590 2023-07-11T00:00:09.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.209+0000 7f26cb7fe700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f26b806ac50 0x7f26b806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:09.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.209+0000 7f26cb7fe700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f26b806ac50 0x7f26b806d100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009be0 tx=0x7f26bc009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:09.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.213+0000 7f26b3fff700 1 -- 172.21.15.38:0/2039823876 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f26c0055770 con 0x7f26cc0a1590 2023-07-11T00:00:09.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:09.409+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2039823876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f26cc074360 con 0x7f26cc0a1590 2023-07-11T00:00:10.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.254+0000 7f26b3fff700 1 -- 172.21.15.38:0/2039823876 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f26c0058d90 con 0x7f26cc0a1590 2023-07-11T00:00:10.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f26b806ac50 msgr2=0x7f26b806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:10.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f26b806ac50 0x7f26b806d100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009be0 tx=0x7f26bc009210 comp rx=0 tx=0).stop 2023-07-11T00:00:10.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2039823876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26cc0a1590 msgr2=0x7f26cc0a2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:10.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26cc0a1590 0x7f26cc0a2d70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f26c0001df0 tx=0x7f26c0001120 comp rx=0 tx=0).stop 2023-07-11T00:00:10.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2039823876 shutdown_connections 2023-07-11T00:00:10.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f26b806ac50 0x7f26b806d100 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009be0 tx=0x7f26bc009210 comp rx=0 tx=0).stop 2023-07-11T00:00:10.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f26cc0a32b0 0x7f26cc1e0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:10.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26b4004850 0x7f26cc0a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:10.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 --2- 172.21.15.38:0/2039823876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26cc0a1590 0x7f26cc0a2d70 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f26c0001df0 tx=0x7f26c0001120 comp rx=0 tx=0).stop 2023-07-11T00:00:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2039823876 >> 172.21.15.38:0/2039823876 conn(0x7f26cc0c0860 msgr2=0x7f26cc0be640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2039823876 shutdown_connections 2023-07-11T00:00:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.257+0000 7f26d1ed4700 1 -- 172.21.15.38:0/2039823876 wait complete. 2023-07-11T00:00:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'rbd' created 2023-07-11T00:00:10.274 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-11T00:00:10.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.406+0000 7f5de59ac700 1 Processor -- start 2023-07-11T00:00:10.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.406+0000 7f5de59ac700 1 -- start start 2023-07-11T00:00:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.407+0000 7f5de59ac700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5de00717f0 0x7f5de00b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5de59ac700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5de00ba3e0 0x7f5de0142410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:10.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5de59ac700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de00ba010 con 0x7f5de0071bc0 2023-07-11T00:00:10.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5de59ac700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de00b9570 con 0x7f5de00717f0 2023-07-11T00:00:10.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5de59ac700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00ba860 con 0x7f5de00ba3e0 2023-07-11T00:00:10.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5ddeffd700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5de00717f0 0x7f5de00b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:10.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5ddf7fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5de00ba3e0 0x7f5de0142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:10.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5dde7fc700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5de0071bc0 0x7f5de00b8e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:55832/0 (socket says 172.21.15.38:55832) 2023-07-11T00:00:10.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5ddeffd700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5de00717f0 0x7f5de00b7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:54514/0 (socket says 172.21.15.38:54514) 2023-07-11T00:00:10.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5ddf7fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5de00ba3e0 0x7f5de0142410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:47456/0 (socket says 172.21.15.38:47456) 2023-07-11T00:00:10.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5dde7fc700 1 -- 172.21.15.38:0/24818620 learned_addr learned my addr 172.21.15.38:0/24818620 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:10.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5ddeffd700 1 -- 172.21.15.38:0/24818620 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5de00ba3e0 msgr2=0x7f5de0142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:10.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5ddeffd700 1 --2- 172.21.15.38:0/24818620 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5de00ba3e0 0x7f5de0142410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:10.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5ddeffd700 1 -- 172.21.15.38:0/24818620 >> v1:172.21.15.70:6789/0 conn(0x7f5de0071bc0 legacy=0x7f5de00b8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:10.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5ddeffd700 1 -- 172.21.15.38:0/24818620 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de00b85a0 con 0x7f5de00717f0 2023-07-11T00:00:10.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.408+0000 7f5ddeffd700 1 --2- 172.21.15.38:0/24818620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00717f0 0x7f5de00b7f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009870 tx=0x7f5dd4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=961e2a63d46bd26f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:10.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.409+0000 7f5dddffb700 1 -- 172.21.15.38:0/24818620 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4011830 con 0x7f5de00717f0 2023-07-11T00:00:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.409+0000 7f5dddffb700 1 -- 172.21.15.38:0/24818620 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd4011990 con 0x7f5de00717f0 2023-07-11T00:00:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.409+0000 7f5dddffb700 1 -- 172.21.15.38:0/24818620 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4011d20 con 0x7f5de00717f0 2023-07-11T00:00:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.409+0000 7f5de59ac700 1 -- 172.21.15.38:0/24818620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00717f0 msgr2=0x7f5de00b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.409+0000 7f5de59ac700 1 --2- 172.21.15.38:0/24818620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00717f0 0x7f5de00b7f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009870 tx=0x7f5dd4009b80 comp rx=0 tx=0).stop 2023-07-11T00:00:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.409+0000 7f5de59ac700 1 -- 172.21.15.38:0/24818620 shutdown_connections 2023-07-11T00:00:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.409+0000 7f5de59ac700 1 --2- 172.21.15.38:0/24818620 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5de00ba3e0 0x7f5de0142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.409+0000 7f5de59ac700 1 --2- 172.21.15.38:0/24818620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00717f0 0x7f5de00b7f80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.409+0000 7f5de59ac700 1 -- 172.21.15.38:0/24818620 >> 172.21.15.38:0/24818620 conn(0x7f5de006d0e0 msgr2=0x7f5de006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.409+0000 7f5de59ac700 1 -- 172.21.15.38:0/24818620 shutdown_connections 2023-07-11T00:00:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.409+0000 7f5de59ac700 1 -- 172.21.15.38:0/24818620 wait complete. 2023-07-11T00:00:10.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.410+0000 7f5de59ac700 1 Processor -- start 2023-07-11T00:00:10.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.411+0000 7f5de59ac700 1 -- start start 2023-07-11T00:00:10.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.411+0000 7f5de59ac700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00717f0 0x7f5de01d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:10.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.411+0000 7f5de59ac700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5de0071bc0 0x7f5de01cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:10.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.411+0000 7f5de59ac700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5de00ba3e0 0x7f5de01388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:10.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.411+0000 7f5de59ac700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de01d1420 con 0x7f5de0071bc0 2023-07-11T00:00:10.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.411+0000 7f5de59ac700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de01cf580 con 0x7f5de00717f0 2023-07-11T00:00:10.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.411+0000 7f5de59ac700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de01cff50 con 0x7f5de00ba3e0 2023-07-11T00:00:10.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.411+0000 7f5dde7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5de0071bc0 0x7f5de01cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:10.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.411+0000 7f5dde7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5de0071bc0 0x7f5de01cfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49138/0 (socket says 172.21.15.38:49138) 2023-07-11T00:00:10.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.411+0000 7f5dde7fc700 1 -- 172.21.15.38:0/1777910653 learned_addr learned my addr 172.21.15.38:0/1777910653 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:10.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5ddeffd700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00717f0 0x7f5de01d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:10.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5ddf7fe700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5de00ba3e0 0x7f5de01388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:10.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5dde7fc700 1 -- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5de00ba3e0 msgr2=0x7f5de01388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:10.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5dde7fc700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5de00ba3e0 0x7f5de01388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:10.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5dde7fc700 1 -- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00717f0 msgr2=0x7f5de01d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:10.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5dde7fc700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00717f0 0x7f5de01d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:10.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5dde7fc700 1 -- 172.21.15.38:0/1777910653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd40094a0 con 0x7f5de0071bc0 2023-07-11T00:00:10.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5ddeffd700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00717f0 0x7f5de01d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:10.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5dde7fc700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5de0071bc0 0x7f5de01cfa10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000c520 tx=0x7f5dd000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:10.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5dc7fff700 1 -- 172.21.15.38:0/1777910653 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0005d70 con 0x7f5de0071bc0 2023-07-11T00:00:10.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5dc7fff700 1 -- 172.21.15.38:0/1777910653 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd00070d0 con 0x7f5de0071bc0 2023-07-11T00:00:10.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5de59ac700 1 -- 172.21.15.38:0/1777910653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de01481f0 con 0x7f5de0071bc0 2023-07-11T00:00:10.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5dc7fff700 1 -- 172.21.15.38:0/1777910653 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0007440 con 0x7f5de0071bc0 2023-07-11T00:00:10.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.412+0000 7f5de59ac700 1 -- 172.21.15.38:0/1777910653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de0146630 con 0x7f5de0071bc0 2023-07-11T00:00:10.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.413+0000 7f5de59ac700 1 -- 172.21.15.38:0/1777910653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de0072440 con 0x7f5de0071bc0 2023-07-11T00:00:10.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.413+0000 7f5dc7fff700 1 -- 172.21.15.38:0/1777910653 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f5dd00075a0 con 0x7f5de0071bc0 2023-07-11T00:00:10.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.414+0000 7f5dc7fff700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5dcc06ac50 0x7f5dcc06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:10.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.414+0000 7f5dc7fff700 1 -- 172.21.15.38:0/1777910653 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f5dd0088460 con 0x7f5de0071bc0 2023-07-11T00:00:10.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.414+0000 7f5ddeffd700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5dcc06ac50 0x7f5dcc06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:10.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.414+0000 7f5ddeffd700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5dcc06ac50 0x7f5dcc06d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40090b0 tx=0x7f5dd4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:10.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.419+0000 7f5dc7fff700 1 -- 172.21.15.38:0/1777910653 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5dd0053970 con 0x7f5de0071bc0 2023-07-11T00:00:10.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:10.616+0000 7f5de59ac700 1 -- 172.21.15.38:0/1777910653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5de01cf6f0 con 0x7f5de0071bc0 2023-07-11T00:00:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.265+0000 7f5dc7fff700 1 -- 172.21.15.38:0/1777910653 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5dd0056f90 con 0x7f5de0071bc0 2023-07-11T00:00:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.269+0000 7f5de59ac700 1 -- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5dcc06ac50 msgr2=0x7f5dcc06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.269+0000 7f5de59ac700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5dcc06ac50 0x7f5dcc06d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40090b0 tx=0x7f5dd4008030 comp rx=0 tx=0).stop 2023-07-11T00:00:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.269+0000 7f5de59ac700 1 -- 172.21.15.38:0/1777910653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5de0071bc0 msgr2=0x7f5de01cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.269+0000 7f5de59ac700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5de0071bc0 0x7f5de01cfa10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000c520 tx=0x7f5dd000c8e0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.269+0000 7f5de59ac700 1 -- 172.21.15.38:0/1777910653 shutdown_connections 2023-07-11T00:00:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.269+0000 7f5de59ac700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5dcc06ac50 0x7f5dcc06d100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.269+0000 7f5de59ac700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5de00ba3e0 0x7f5de01388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.269+0000 7f5de59ac700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00717f0 0x7f5de01d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.269+0000 7f5de59ac700 1 --2- 172.21.15.38:0/1777910653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5de0071bc0 0x7f5de01cfa10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.269+0000 7f5de59ac700 1 -- 172.21.15.38:0/1777910653 >> 172.21.15.38:0/1777910653 conn(0x7f5de006d0e0 msgr2=0x7f5de006a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.269+0000 7f5de59ac700 1 -- 172.21.15.38:0/1777910653 shutdown_connections 2023-07-11T00:00:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.270+0000 7f5de59ac700 1 -- 172.21.15.38:0/1777910653 wait complete. 2023-07-11T00:00:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-11T00:00:11.286 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-11T00:00:11.286 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-11T00:00:11.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-11T00:00:11.288 INFO:tasks.ceph.mds.a:Started 2023-07-11T00:00:11.289 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-11T00:00:11.289 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-11T00:00:11.292 INFO:tasks.ceph.mds.c:Started 2023-07-11T00:00:11.292 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-11T00:00:11.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-11T00:00:11.296 INFO:tasks.ceph.mds.b:Started 2023-07-11T00:00:11.296 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-11T00:00:11.297 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:11.386 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-07-11T00:00:11.387 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-07-11T00:00:11.390 INFO:tasks.ceph.mds.b.smithi070.stdout:starting mds.b at 2023-07-11T00:00:11.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.443+0000 7fb9e95ae700 1 Processor -- start 2023-07-11T00:00:11.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.444+0000 7fb9e95ae700 1 -- start start 2023-07-11T00:00:11.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.445+0000 7fb9e95ae700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb9e41449d0 0x7fb9e414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.445+0000 7fb9e95ae700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb9e40bc810 0x7fb9e40ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.445+0000 7fb9e95ae700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40b8620 con 0x7fb9e40b8d90 2023-07-11T00:00:11.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.445+0000 7fb9e95ae700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e40b97a0 con 0x7fb9e41449d0 2023-07-11T00:00:11.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.445+0000 7fb9e95ae700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e4144da0 con 0x7fb9e40bc810 2023-07-11T00:00:11.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.445+0000 7fb9e2ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb9e41449d0 0x7fb9e414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.445+0000 7fb9e2ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb9e41449d0 0x7fb9e414db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49160/0 (socket says 172.21.15.38:49160) 2023-07-11T00:00:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.445+0000 7fb9e2ffd700 1 -- 172.21.15.38:0/2319715369 learned_addr learned my addr 172.21.15.38:0/2319715369 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.445+0000 7fb9e27fc700 1 --2- 172.21.15.38:0/2319715369 >> v2:172.21.15.70:3300/0 conn(0x7fb9e40bc810 0x7fb9e40ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.446+0000 7fb9e2ffd700 1 -- 172.21.15.38:0/2319715369 >> v2:172.21.15.70:3300/0 conn(0x7fb9e40bc810 msgr2=0x7fb9e40ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.446+0000 7fb9e2ffd700 1 --2- 172.21.15.38:0/2319715369 >> v2:172.21.15.70:3300/0 conn(0x7fb9e40bc810 0x7fb9e40ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.446+0000 7fb9e2ffd700 1 -- 172.21.15.38:0/2319715369 >> v1:172.21.15.70:6789/0 conn(0x7fb9e40b8d90 legacy=0x7fb9e406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.446+0000 7fb9e2ffd700 1 -- 172.21.15.38:0/2319715369 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40b8900 con 0x7fb9e41449d0 2023-07-11T00:00:11.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.446+0000 7fb9e2ffd700 1 --2- 172.21.15.38:0/2319715369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9e41449d0 0x7fb9e414db50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb9e406ce40 tx=0x7fb9d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230b9fb39415aba2 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:11.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.446+0000 7fb9e1ffb700 1 -- 172.21.15.38:0/2319715369 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400b870 con 0x7fb9e41449d0 2023-07-11T00:00:11.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.446+0000 7fb9e1ffb700 1 -- 172.21.15.38:0/2319715369 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d400b9d0 con 0x7fb9e41449d0 2023-07-11T00:00:11.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.446+0000 7fb9e1ffb700 1 -- 172.21.15.38:0/2319715369 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400bd60 con 0x7fb9e41449d0 2023-07-11T00:00:11.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.446+0000 7fb9e95ae700 1 -- 172.21.15.38:0/2319715369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9e41449d0 msgr2=0x7fb9e414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.446+0000 7fb9e95ae700 1 --2- 172.21.15.38:0/2319715369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9e41449d0 0x7fb9e414db50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb9e406ce40 tx=0x7fb9d4009bd0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.447+0000 7fb9e95ae700 1 -- 172.21.15.38:0/2319715369 shutdown_connections 2023-07-11T00:00:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.447+0000 7fb9e95ae700 1 --2- 172.21.15.38:0/2319715369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9e41449d0 0x7fb9e414db50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.447+0000 7fb9e95ae700 1 --2- 172.21.15.38:0/2319715369 >> v2:172.21.15.70:3300/0 conn(0x7fb9e40bc810 0x7fb9e40ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.447+0000 7fb9e95ae700 1 -- 172.21.15.38:0/2319715369 >> 172.21.15.38:0/2319715369 conn(0x7fb9e40c0860 msgr2=0x7fb9e40c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.447+0000 7fb9e95ae700 1 -- 172.21.15.38:0/2319715369 shutdown_connections 2023-07-11T00:00:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.447+0000 7fb9e95ae700 1 -- 172.21.15.38:0/2319715369 wait complete. 2023-07-11T00:00:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.448+0000 7fb9e95ae700 1 Processor -- start 2023-07-11T00:00:11.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.448+0000 7fb9e95ae700 1 -- start start 2023-07-11T00:00:11.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.449+0000 7fb9e95ae700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9e40b8d90 0x7fb9e40b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.449+0000 7fb9e95ae700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9e40bc810 0x7fb9e41e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.449+0000 7fb9e95ae700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9e41449d0 0x7fb9e41d4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.449+0000 7fb9e95ae700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40b6a30 con 0x7fb9e40b8d90 2023-07-11T00:00:11.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.449+0000 7fb9e95ae700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e41dfd10 con 0x7fb9e41449d0 2023-07-11T00:00:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.449+0000 7fb9e95ae700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e414b060 con 0x7fb9e40bc810 2023-07-11T00:00:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.449+0000 7fb9e2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9e40b8d90 0x7fb9e40b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.449+0000 7fb9e2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9e40b8d90 0x7fb9e40b64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49168/0 (socket says 172.21.15.38:49168) 2023-07-11T00:00:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.449+0000 7fb9e2ffd700 1 -- 172.21.15.38:0/607318586 learned_addr learned my addr 172.21.15.38:0/607318586 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.449+0000 7fb9e27fc700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9e40bc810 0x7fb9e41e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.449+0000 7fb9e37fe700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9e41449d0 0x7fb9e41d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.450+0000 7fb9e2ffd700 1 -- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9e40bc810 msgr2=0x7fb9e41e01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.450+0000 7fb9e2ffd700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9e40bc810 0x7fb9e41e01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.450+0000 7fb9e2ffd700 1 -- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9e41449d0 msgr2=0x7fb9e41d4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.450+0000 7fb9e2ffd700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9e41449d0 0x7fb9e41d4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.450+0000 7fb9e2ffd700 1 -- 172.21.15.38:0/607318586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d4009550 con 0x7fb9e40b8d90 2023-07-11T00:00:11.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.450+0000 7fb9e2ffd700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9e40b8d90 0x7fb9e40b64f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4000c00 tx=0x7fb9d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:11.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.450+0000 7fb9cb7fe700 1 -- 172.21.15.38:0/607318586 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4004310 con 0x7fb9e40b8d90 2023-07-11T00:00:11.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.450+0000 7fb9e95ae700 1 -- 172.21.15.38:0/607318586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e41df9a0 con 0x7fb9e40b8d90 2023-07-11T00:00:11.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.450+0000 7fb9cb7fe700 1 -- 172.21.15.38:0/607318586 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d401e070 con 0x7fb9e40b8d90 2023-07-11T00:00:11.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.450+0000 7fb9cb7fe700 1 -- 172.21.15.38:0/607318586 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40036a0 con 0x7fb9e40b8d90 2023-07-11T00:00:11.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.450+0000 7fb9e95ae700 1 -- 172.21.15.38:0/607318586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e414b340 con 0x7fb9e40b8d90 2023-07-11T00:00:11.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.451+0000 7fb9e95ae700 1 -- 172.21.15.38:0/607318586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e40bcf60 con 0x7fb9e40b8d90 2023-07-11T00:00:11.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.451+0000 7fb9cb7fe700 1 -- 172.21.15.38:0/607318586 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fb9d4020030 con 0x7fb9e40b8d90 2023-07-11T00:00:11.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.452+0000 7fb9cb7fe700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb9d006ac50 0x7fb9d006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.452+0000 7fb9cb7fe700 1 -- 172.21.15.38:0/607318586 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb9d4089f50 con 0x7fb9e40b8d90 2023-07-11T00:00:11.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.452+0000 7fb9e27fc700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb9d006ac50 0x7fb9d006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.452+0000 7fb9e27fc700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb9d006ac50 0x7fb9d006d100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb9e41da1d0 tx=0x7fb9d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:11.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.464+0000 7fb9cb7fe700 1 -- 172.21.15.38:0/607318586 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb9e40bcf60 con 0x7fb9e40b8d90 2023-07-11T00:00:11.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.672+0000 7fb9e95ae700 1 -- 172.21.15.38:0/607318586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9e40bcf60 con 0x7fb9e40b8d90 2023-07-11T00:00:11.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.673+0000 7fb9cb7fe700 1 -- 172.21.15.38:0/607318586 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14545 (secure 0 0 0) 0x7fb9e40bcf60 con 0x7fb9e40b8d90 2023-07-11T00:00:11.675 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:11.675 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:11.250977+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:11.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 -- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb9d006ac50 msgr2=0x7fb9d006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb9d006ac50 0x7fb9d006d100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb9e41da1d0 tx=0x7fb9d8008040 comp rx=0 tx=0).stop 2023-07-11T00:00:11.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 -- 172.21.15.38:0/607318586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9e40b8d90 msgr2=0x7fb9e40b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9e40b8d90 0x7fb9e40b64f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4000c00 tx=0x7fb9d4004750 comp rx=0 tx=0).stop 2023-07-11T00:00:11.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 -- 172.21.15.38:0/607318586 shutdown_connections 2023-07-11T00:00:11.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb9d006ac50 0x7fb9d006d100 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9e41449d0 0x7fb9e41d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9e40b8d90 0x7fb9e40b64f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 --2- 172.21.15.38:0/607318586 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9e40bc810 0x7fb9e41e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 -- 172.21.15.38:0/607318586 >> 172.21.15.38:0/607318586 conn(0x7fb9e40c0860 msgr2=0x7fb9e40be7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:11.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 -- 172.21.15.38:0/607318586 shutdown_connections 2023-07-11T00:00:11.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.675+0000 7fb9e95ae700 1 -- 172.21.15.38:0/607318586 wait complete. 2023-07-11T00:00:11.689 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:00:11.690 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:00:11.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.820+0000 7fe8fcfa1700 1 Processor -- start 2023-07-11T00:00:11.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.820+0000 7fe8fcfa1700 1 -- start start 2023-07-11T00:00:11.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.821+0000 7fe8fcfa1700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8f80bc810 0x7fe8f80ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.821+0000 7fe8fcfa1700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 0x7fe8f806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.821+0000 7fe8fcfa1700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f80b8620 con 0x7fe8f81449d0 2023-07-11T00:00:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.821+0000 7fe8fcfa1700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f80b97a0 con 0x7fe8f80bc810 2023-07-11T00:00:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.821+0000 7fe8fcfa1700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8144da0 con 0x7fe8f80b8d90 2023-07-11T00:00:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.821+0000 7fe8f5d9b700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8f80bc810 0x7fe8f80ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.821+0000 7fe8f6d9d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 0x7fe8f806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.821+0000 7fe8f6d9d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 0x7fe8f806ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:47508/0 (socket says 172.21.15.38:47508) 2023-07-11T00:00:11.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.821+0000 7fe8f659c700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe8f81449d0 0x7fe8f814db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:55874/0 (socket says 172.21.15.38:55874) 2023-07-11T00:00:11.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.821+0000 7fe8f6d9d700 1 -- 172.21.15.38:0/1151821407 learned_addr learned my addr 172.21.15.38:0/1151821407 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:11.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.821+0000 7fe8f5d9b700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8f80bc810 0x7fe8f80ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:54580/0 (socket says 172.21.15.38:54580) 2023-07-11T00:00:11.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8f6d9d700 1 -- 172.21.15.38:0/1151821407 >> v2:172.21.15.70:3300/0 conn(0x7fe8f80bc810 msgr2=0x7fe8f80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8f6d9d700 1 --2- 172.21.15.38:0/1151821407 >> v2:172.21.15.70:3300/0 conn(0x7fe8f80bc810 0x7fe8f80ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8f6d9d700 1 -- 172.21.15.38:0/1151821407 >> v1:172.21.15.70:6789/0 conn(0x7fe8f81449d0 legacy=0x7fe8f814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8f559a700 1 -- 172.21.15.38:0/1151821407 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602666100 0 0) 0x7fe8f80b8620 con 0x7fe8f81449d0 2023-07-11T00:00:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8f6d9d700 1 -- 172.21.15.38:0/1151821407 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f80b8900 con 0x7fe8f80b8d90 2023-07-11T00:00:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8f5d9b700 1 --2- 172.21.15.38:0/1151821407 >> v2:172.21.15.70:3300/0 conn(0x7fe8f80bc810 0x7fe8f80ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8f6d9d700 1 --2- 172.21.15.38:0/1151821407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 0x7fe8f806ade0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009e50 tx=0x7fe8f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd4eec195ba4bf5e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8f559a700 1 -- 172.21.15.38:0/1151821407 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f000e070 con 0x7fe8f80b8d90 2023-07-11T00:00:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8f559a700 1 -- 172.21.15.38:0/1151821407 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f000b910 con 0x7fe8f80b8d90 2023-07-11T00:00:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8f559a700 1 -- 172.21.15.38:0/1151821407 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f000bcc0 con 0x7fe8f80b8d90 2023-07-11T00:00:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1151821407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 msgr2=0x7fe8f806ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8fcfa1700 1 --2- 172.21.15.38:0/1151821407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 0x7fe8f806ade0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009e50 tx=0x7fe8f000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1151821407 shutdown_connections 2023-07-11T00:00:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8fcfa1700 1 --2- 172.21.15.38:0/1151821407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 0x7fe8f806ade0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8fcfa1700 1 --2- 172.21.15.38:0/1151821407 >> v2:172.21.15.70:3300/0 conn(0x7fe8f80bc810 0x7fe8f80ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.822+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1151821407 >> 172.21.15.38:0/1151821407 conn(0x7fe8f80c0860 msgr2=0x7fe8f80c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.823+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1151821407 shutdown_connections 2023-07-11T00:00:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.823+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1151821407 wait complete. 2023-07-11T00:00:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.824+0000 7fe8fcfa1700 1 Processor -- start 2023-07-11T00:00:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.824+0000 7fe8fcfa1700 1 -- start start 2023-07-11T00:00:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.824+0000 7fe8fcfa1700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 0x7fe8f8147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.824+0000 7fe8fcfa1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f80bc810 0x7fe8f8146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.824+0000 7fe8fcfa1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8f81449d0 0x7fe8f81df920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.824+0000 7fe8fcfa1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8146870 con 0x7fe8f81449d0 2023-07-11T00:00:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.824+0000 7fe8fcfa1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80b43e0 con 0x7fe8f80bc810 2023-07-11T00:00:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.824+0000 7fe8fcfa1700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80b3180 con 0x7fe8f80b8d90 2023-07-11T00:00:11.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.824+0000 7fe8f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8f81449d0 0x7fe8f81df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8f659c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 0x7fe8f8147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8f5d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f80bc810 0x7fe8f8146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8f81449d0 0x7fe8f81df920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49170/0 (socket says 172.21.15.38:49170) 2023-07-11T00:00:11.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8f6d9d700 1 -- 172.21.15.38:0/1126360139 learned_addr learned my addr 172.21.15.38:0/1126360139 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:11.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8f6d9d700 1 -- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 msgr2=0x7fe8f8147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8f6d9d700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 0x7fe8f8147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8f6d9d700 1 -- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f80bc810 msgr2=0x7fe8f8146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:11.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8f6d9d700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f80bc810 0x7fe8f8146330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:11.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8f6d9d700 1 -- 172.21.15.38:0/1126360139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80094a0 con 0x7fe8f81449d0 2023-07-11T00:00:11.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8f6d9d700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8f81449d0 0x7fe8f81df920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000b680 tx=0x7fe8f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:11.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8eeffd700 1 -- 172.21.15.38:0/1126360139 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0003ea0 con 0x7fe8f81449d0 2023-07-11T00:00:11.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1126360139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f0009b30 con 0x7fe8f81449d0 2023-07-11T00:00:11.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8eeffd700 1 -- 172.21.15.38:0/1126360139 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f0004910 con 0x7fe8f81449d0 2023-07-11T00:00:11.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8eeffd700 1 -- 172.21.15.38:0/1126360139 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f001c680 con 0x7fe8f81449d0 2023-07-11T00:00:11.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.825+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1126360139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f8147a00 con 0x7fe8f81449d0 2023-07-11T00:00:11.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.826+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1126360139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f80b2fe0 con 0x7fe8f81449d0 2023-07-11T00:00:11.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.827+0000 7fe8eeffd700 1 -- 172.21.15.38:0/1126360139 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fe8f001c7e0 con 0x7fe8f81449d0 2023-07-11T00:00:11.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.827+0000 7fe8eeffd700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe8d806ac50 0x7fe8d806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:11.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.827+0000 7fe8eeffd700 1 -- 172.21.15.38:0/1126360139 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe8f008a880 con 0x7fe8f81449d0 2023-07-11T00:00:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.831+0000 7fe8eeffd700 1 -- 172.21.15.38:0/1126360139 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe8f80b2fe0 con 0x7fe8f81449d0 2023-07-11T00:00:11.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.839+0000 7fe8f659c700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe8d806ac50 0x7fe8d806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:11.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:11.840+0000 7fe8f659c700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe8d806ac50 0x7fe8d806d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0000f60 tx=0x7fe8e0004a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.032+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1126360139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe8f81df640 con 0x7fe8f81449d0 2023-07-11T00:00:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.032+0000 7fe8eeffd700 1 -- 172.21.15.38:0/1126360139 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe8f81df640 con 0x7fe8f81449d0 2023-07-11T00:00:12.034 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:00:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe8d806ac50 msgr2=0x7fe8d806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe8d806ac50 0x7fe8d806d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0000f60 tx=0x7fe8e0004a50 comp rx=0 tx=0).stop 2023-07-11T00:00:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1126360139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8f81449d0 msgr2=0x7fe8f81df920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8f81449d0 0x7fe8f81df920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000b680 tx=0x7fe8f0004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1126360139 shutdown_connections 2023-07-11T00:00:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe8d806ac50 0x7fe8d806d100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8f81449d0 0x7fe8f81df920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8f80b8d90 0x7fe8f8147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 --2- 172.21.15.38:0/1126360139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8f80bc810 0x7fe8f8146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1126360139 >> 172.21.15.38:0/1126360139 conn(0x7fe8f80c0860 msgr2=0x7fe8f80bef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1126360139 shutdown_connections 2023-07-11T00:00:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.034+0000 7fe8fcfa1700 1 -- 172.21.15.38:0/1126360139 wait complete. 2023-07-11T00:00:12.048 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:00:12.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.176+0000 7fd0ee720700 1 Processor -- start 2023-07-11T00:00:12.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.176+0000 7fd0ee720700 1 -- start start 2023-07-11T00:00:12.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.177+0000 7fd0ee720700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd0e8071d20 0x7fd0e81458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.177+0000 7fd0ee720700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e80709c0 0x7fd0e8145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.177+0000 7fd0ee720700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e8070130 con 0x7fd0e814bf30 2023-07-11T00:00:12.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.177+0000 7fd0ee720700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e8146330 con 0x7fd0e8071d20 2023-07-11T00:00:12.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.177+0000 7fd0ee720700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e8070f80 con 0x7fd0e80709c0 2023-07-11T00:00:12.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.177+0000 7fd0e7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd0e814bf30 0x7fd0e80b8ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53696/0 (socket says 172.21.15.38:53696) 2023-07-11T00:00:12.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.177+0000 7fd0e7fff700 1 -- 172.21.15.38:0/595293051 learned_addr learned my addr 172.21.15.38:0/595293051 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:12.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.177+0000 7fd0eccbd700 1 --2- 172.21.15.38:0/595293051 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e80709c0 0x7fd0e8145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.177+0000 7fd0e77fe700 1 --2- 172.21.15.38:0/595293051 >> v2:172.21.15.70:3300/0 conn(0x7fd0e8071d20 0x7fd0e81458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.178+0000 7fd0eccbd700 1 -- 172.21.15.38:0/595293051 >> v2:172.21.15.70:3300/0 conn(0x7fd0e8071d20 msgr2=0x7fd0e81458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:12.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.178+0000 7fd0eccbd700 1 --2- 172.21.15.38:0/595293051 >> v2:172.21.15.70:3300/0 conn(0x7fd0e8071d20 0x7fd0e81458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.178+0000 7fd0eccbd700 1 -- 172.21.15.38:0/595293051 >> v1:172.21.15.38:6789/0 conn(0x7fd0e814bf30 legacy=0x7fd0e80b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.178+0000 7fd0eccbd700 1 -- 172.21.15.38:0/595293051 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e8071260 con 0x7fd0e80709c0 2023-07-11T00:00:12.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.178+0000 7fd0e77fe700 1 --2- 172.21.15.38:0/595293051 >> v2:172.21.15.70:3300/0 conn(0x7fd0e8071d20 0x7fd0e81458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:12.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.178+0000 7fd0eccbd700 1 --2- 172.21.15.38:0/595293051 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e80709c0 0x7fd0e8145df0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009d90 tx=0x7fd0e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c203b3ac7a068cdd server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:12.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.178+0000 7fd0e6ffd700 1 -- 172.21.15.38:0/595293051 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000e070 con 0x7fd0e80709c0 2023-07-11T00:00:12.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.178+0000 7fd0e6ffd700 1 -- 172.21.15.38:0/595293051 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e000bb20 con 0x7fd0e80709c0 2023-07-11T00:00:12.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.178+0000 7fd0e6ffd700 1 -- 172.21.15.38:0/595293051 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0012430 con 0x7fd0e80709c0 2023-07-11T00:00:12.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.179+0000 7fd0ee720700 1 -- 172.21.15.38:0/595293051 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e80709c0 msgr2=0x7fd0e8145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.179+0000 7fd0ee720700 1 --2- 172.21.15.38:0/595293051 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e80709c0 0x7fd0e8145df0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009d90 tx=0x7fd0e000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:12.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.179+0000 7fd0ee720700 1 -- 172.21.15.38:0/595293051 shutdown_connections 2023-07-11T00:00:12.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.179+0000 7fd0ee720700 1 --2- 172.21.15.38:0/595293051 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e80709c0 0x7fd0e8145df0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.179+0000 7fd0ee720700 1 --2- 172.21.15.38:0/595293051 >> v2:172.21.15.70:3300/0 conn(0x7fd0e8071d20 0x7fd0e81458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.179+0000 7fd0ee720700 1 -- 172.21.15.38:0/595293051 >> 172.21.15.38:0/595293051 conn(0x7fd0e80be670 msgr2=0x7fd0e80bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:12.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.179+0000 7fd0ee720700 1 -- 172.21.15.38:0/595293051 shutdown_connections 2023-07-11T00:00:12.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.179+0000 7fd0ee720700 1 -- 172.21.15.38:0/595293051 wait complete. 2023-07-11T00:00:12.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.180+0000 7fd0ee720700 1 Processor -- start 2023-07-11T00:00:12.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.180+0000 7fd0ee720700 1 -- start start 2023-07-11T00:00:12.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0ee720700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0e80709c0 0x7fd0e8148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0ee720700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e8071d20 0x7fd0e8146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0ee720700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0e814bf30 0x7fd0e80b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0ee720700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e8146e70 con 0x7fd0e814bf30 2023-07-11T00:00:12.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0ee720700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e8147d20 con 0x7fd0e80709c0 2023-07-11T00:00:12.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0ee720700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e8149880 con 0x7fd0e8071d20 2023-07-11T00:00:12.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0eccbd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0e814bf30 0x7fd0e80b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0eccbd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0e814bf30 0x7fd0e80b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49182/0 (socket says 172.21.15.38:49182) 2023-07-11T00:00:12.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0eccbd700 1 -- 172.21.15.38:0/1671708998 learned_addr learned my addr 172.21.15.38:0/1671708998 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:12.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0e7fff700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0e80709c0 0x7fd0e8148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0e77fe700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e8071d20 0x7fd0e8146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0e7fff700 1 -- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e8071d20 msgr2=0x7fd0e8146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0e7fff700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e8071d20 0x7fd0e8146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0e7fff700 1 -- 172.21.15.38:0/1671708998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0e814bf30 msgr2=0x7fd0e80b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0e7fff700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0e814bf30 0x7fd0e80b6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0e7fff700 1 -- 172.21.15.38:0/1671708998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc0094a0 con 0x7fd0e80709c0 2023-07-11T00:00:12.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0e7fff700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0e80709c0 0x7fd0e8148c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800c3f0 tx=0x7fd0d800c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:12.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0e4ff9700 1 -- 172.21.15.38:0/1671708998 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8005b40 con 0x7fd0e80709c0 2023-07-11T00:00:12.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0e4ff9700 1 -- 172.21.15.38:0/1671708998 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d8005ca0 con 0x7fd0e80709c0 2023-07-11T00:00:12.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0ee720700 1 -- 172.21.15.38:0/1671708998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e0009a70 con 0x7fd0e80709c0 2023-07-11T00:00:12.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.181+0000 7fd0e4ff9700 1 -- 172.21.15.38:0/1671708998 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80072f0 con 0x7fd0e80709c0 2023-07-11T00:00:12.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.182+0000 7fd0ee720700 1 -- 172.21.15.38:0/1671708998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e80ba5f0 con 0x7fd0e80709c0 2023-07-11T00:00:12.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.183+0000 7fd0ee720700 1 -- 172.21.15.38:0/1671708998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e8074360 con 0x7fd0e80709c0 2023-07-11T00:00:12.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.183+0000 7fd0e4ff9700 1 -- 172.21.15.38:0/1671708998 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fd0d8007450 con 0x7fd0e80709c0 2023-07-11T00:00:12.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.183+0000 7fd0e4ff9700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd0d406ac50 0x7fd0d406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.183+0000 7fd0e4ff9700 1 -- 172.21.15.38:0/1671708998 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd0d8088160 con 0x7fd0e80709c0 2023-07-11T00:00:12.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.183+0000 7fd0e77fe700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd0d406ac50 0x7fd0d406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.184+0000 7fd0e77fe700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd0d406ac50 0x7fd0d406d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd0e81d5920 tx=0x7fd0dc009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:12.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.188+0000 7fd0e4ff9700 1 -- 172.21.15.38:0/1671708998 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd0d8053630 con 0x7fd0e80709c0 2023-07-11T00:00:12.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.392+0000 7fd0ee720700 1 -- 172.21.15.38:0/1671708998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0e80ba5f0 con 0x7fd0e80709c0 2023-07-11T00:00:12.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.393+0000 7fd0e4ff9700 1 -- 172.21.15.38:0/1671708998 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0e80ba5f0 con 0x7fd0e80709c0 2023-07-11T00:00:12.394 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:00:12.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 -- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd0d406ac50 msgr2=0x7fd0d406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd0d406ac50 0x7fd0d406d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd0e81d5920 tx=0x7fd0dc009210 comp rx=0 tx=0).stop 2023-07-11T00:00:12.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 -- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0e80709c0 msgr2=0x7fd0e8148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0e80709c0 0x7fd0e8148c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800c3f0 tx=0x7fd0d800c700 comp rx=0 tx=0).stop 2023-07-11T00:00:12.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 -- 172.21.15.38:0/1671708998 shutdown_connections 2023-07-11T00:00:12.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd0d406ac50 0x7fd0d406d100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0e814bf30 0x7fd0e80b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0e80709c0 0x7fd0e8148c40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 --2- 172.21.15.38:0/1671708998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e8071d20 0x7fd0e8146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 -- 172.21.15.38:0/1671708998 >> 172.21.15.38:0/1671708998 conn(0x7fd0e80be670 msgr2=0x7fd0e8143e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:12.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 -- 172.21.15.38:0/1671708998 shutdown_connections 2023-07-11T00:00:12.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.395+0000 7fd0ee720700 1 -- 172.21.15.38:0/1671708998 wait complete. 2023-07-11T00:00:12.409 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:00:12.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.532+0000 7f1cba611700 1 Processor -- start 2023-07-11T00:00:12.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.532+0000 7f1cba611700 1 -- start start 2023-07-11T00:00:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cba611700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb41449d0 0x7f1cb414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cba611700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1cb40bc810 0x7f1cb40ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cba611700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb40b8620 con 0x7f1cb40b8d90 2023-07-11T00:00:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cba611700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb40b97a0 con 0x7f1cb40bc810 2023-07-11T00:00:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cba611700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb4144da0 con 0x7f1cb41449d0 2023-07-11T00:00:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cb37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1cb40bc810 0x7f1cb40ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cb37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1cb40bc810 0x7f1cb40ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49186/0 (socket says 172.21.15.38:49186) 2023-07-11T00:00:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cb37fe700 1 -- 172.21.15.38:0/897528610 learned_addr learned my addr 172.21.15.38:0/897528610 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cb3fff700 1 --2- 172.21.15.38:0/897528610 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb41449d0 0x7f1cb414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cb37fe700 1 -- 172.21.15.38:0/897528610 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb41449d0 msgr2=0x7f1cb414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cb37fe700 1 --2- 172.21.15.38:0/897528610 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb41449d0 0x7f1cb414db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cb37fe700 1 -- 172.21.15.38:0/897528610 >> v1:172.21.15.70:6789/0 conn(0x7f1cb40b8d90 legacy=0x7f1cb406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cb2ffd700 1 -- 172.21.15.38:0/897528610 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178999058 0 0) 0x7f1cb40b8620 con 0x7f1cb40b8d90 2023-07-11T00:00:12.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.533+0000 7f1cb37fe700 1 -- 172.21.15.38:0/897528610 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb40b8900 con 0x7f1cb40bc810 2023-07-11T00:00:12.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cb37fe700 1 --2- 172.21.15.38:0/897528610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cb40bc810 0x7f1cb40ba530 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0098f0 tx=0x7f1c9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fc036b269b745a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:12.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cb2ffd700 1 -- 172.21.15.38:0/897528610 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c011830 con 0x7f1cb40bc810 2023-07-11T00:00:12.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cb2ffd700 1 -- 172.21.15.38:0/897528610 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c011990 con 0x7f1cb40bc810 2023-07-11T00:00:12.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cb2ffd700 1 -- 172.21.15.38:0/897528610 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c011d20 con 0x7f1cb40bc810 2023-07-11T00:00:12.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cba611700 1 -- 172.21.15.38:0/897528610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cb40bc810 msgr2=0x7f1cb40ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cba611700 1 --2- 172.21.15.38:0/897528610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cb40bc810 0x7f1cb40ba530 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0098f0 tx=0x7f1c9c009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:12.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cba611700 1 -- 172.21.15.38:0/897528610 shutdown_connections 2023-07-11T00:00:12.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cba611700 1 --2- 172.21.15.38:0/897528610 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb41449d0 0x7f1cb414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cba611700 1 --2- 172.21.15.38:0/897528610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cb40bc810 0x7f1cb40ba530 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cba611700 1 -- 172.21.15.38:0/897528610 >> 172.21.15.38:0/897528610 conn(0x7f1cb40c0860 msgr2=0x7f1cb40c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:12.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cba611700 1 -- 172.21.15.38:0/897528610 shutdown_connections 2023-07-11T00:00:12.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.534+0000 7f1cba611700 1 -- 172.21.15.38:0/897528610 wait complete. 2023-07-11T00:00:12.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.535+0000 7f1cba611700 1 Processor -- start 2023-07-11T00:00:12.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.536+0000 7f1cba611700 1 -- start start 2023-07-11T00:00:12.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.536+0000 7f1cba611700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cb40b8d90 0x7f1cb40b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.536+0000 7f1cba611700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb40bc810 0x7f1cb40b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.536+0000 7f1cba611700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cb41449d0 0x7f1cb4146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.536+0000 7f1cba611700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb41439f0 con 0x7f1cb41449d0 2023-07-11T00:00:12.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.536+0000 7f1cba611700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb40b66a0 con 0x7f1cb40b8d90 2023-07-11T00:00:12.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.536+0000 7f1cba611700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb40b6050 con 0x7f1cb40bc810 2023-07-11T00:00:12.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.536+0000 7f1cb8bae700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cb41449d0 0x7f1cb4146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.536+0000 7f1cb8bae700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cb41449d0 0x7f1cb4146160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49190/0 (socket says 172.21.15.38:49190) 2023-07-11T00:00:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.536+0000 7f1cb8bae700 1 -- 172.21.15.38:0/4256864712 learned_addr learned my addr 172.21.15.38:0/4256864712 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb37fe700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb40bc810 0x7f1cb40b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb3fff700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cb40b8d90 0x7f1cb40b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb8bae700 1 -- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb40bc810 msgr2=0x7f1cb40b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb8bae700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb40bc810 0x7f1cb40b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb8bae700 1 -- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cb40b8d90 msgr2=0x7f1cb40b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb8bae700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cb40b8d90 0x7f1cb40b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb8bae700 1 -- 172.21.15.38:0/4256864712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c009550 con 0x7f1cb41449d0 2023-07-11T00:00:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb37fe700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb40bc810 0x7f1cb40b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb3fff700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cb40b8d90 0x7f1cb40b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb8bae700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cb41449d0 0x7f1cb4146160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00c870 tx=0x7f1cac00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb0ff9700 1 -- 172.21.15.38:0/4256864712 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac003e30 con 0x7f1cb41449d0 2023-07-11T00:00:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb0ff9700 1 -- 172.21.15.38:0/4256864712 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac00ce70 con 0x7f1cb41449d0 2023-07-11T00:00:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cba611700 1 -- 172.21.15.38:0/4256864712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb40b6330 con 0x7f1cb41449d0 2023-07-11T00:00:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cb0ff9700 1 -- 172.21.15.38:0/4256864712 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac005290 con 0x7f1cb41449d0 2023-07-11T00:00:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.537+0000 7f1cba611700 1 -- 172.21.15.38:0/4256864712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb40b7550 con 0x7f1cb41449d0 2023-07-11T00:00:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.538+0000 7f1cba611700 1 -- 172.21.15.38:0/4256864712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb40b6830 con 0x7f1cb41449d0 2023-07-11T00:00:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.539+0000 7f1cb0ff9700 1 -- 172.21.15.38:0/4256864712 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f1cac0053f0 con 0x7f1cb41449d0 2023-07-11T00:00:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.539+0000 7f1cb0ff9700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1c9406ac50 0x7f1c9406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.539+0000 7f1cb0ff9700 1 -- 172.21.15.38:0/4256864712 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1cac088790 con 0x7f1cb41449d0 2023-07-11T00:00:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.539+0000 7f1cb3fff700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1c9406ac50 0x7f1c9406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.540+0000 7f1cb3fff700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1c9406ac50 0x7f1c9406d100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009ac0 tx=0x7f1ca4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:12.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.544+0000 7f1cb0ff9700 1 -- 172.21.15.38:0/4256864712 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1cac053d00 con 0x7f1cb41449d0 2023-07-11T00:00:12.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.786+0000 7f1cba611700 1 -- 172.21.15.38:0/4256864712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cb4074360 con 0x7f1cb41449d0 2023-07-11T00:00:12.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.786+0000 7f1cb0ff9700 1 -- 172.21.15.38:0/4256864712 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2768 (secure 0 0 0) 0x7f1cac017090 con 0x7f1cb41449d0 2023-07-11T00:00:12.789 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:12.789 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3612343661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3612343661},{"type":"v1","addr":"172.21.15.38:6834","nonce":3612343661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3097729806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3097729806},{"type":"v1","addr":"172.21.15.70:6835","nonce":3097729806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3594015619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3594015619},{"type":"v1","addr":"172.21.15.38:6835","nonce":3594015619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-11T00:00:12.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 -- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1c9406ac50 msgr2=0x7f1c9406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1c9406ac50 0x7f1c9406d100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009ac0 tx=0x7f1ca4008040 comp rx=0 tx=0).stop 2023-07-11T00:00:12.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 -- 172.21.15.38:0/4256864712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cb41449d0 msgr2=0x7f1cb4146160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cb41449d0 0x7f1cb4146160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00c870 tx=0x7f1cac00cc30 comp rx=0 tx=0).stop 2023-07-11T00:00:12.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 -- 172.21.15.38:0/4256864712 shutdown_connections 2023-07-11T00:00:12.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1c9406ac50 0x7f1c9406d100 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cb41449d0 0x7f1cb4146160 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cb40b8d90 0x7f1cb40b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 --2- 172.21.15.38:0/4256864712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb40bc810 0x7f1cb40b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 -- 172.21.15.38:0/4256864712 >> 172.21.15.38:0/4256864712 conn(0x7f1cb40c0860 msgr2=0x7f1cb40be7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:12.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 -- 172.21.15.38:0/4256864712 shutdown_connections 2023-07-11T00:00:12.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.789+0000 7f1cba611700 1 -- 172.21.15.38:0/4256864712 wait complete. 2023-07-11T00:00:12.793 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 3 2023-07-11T00:00:12.803 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:12.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.929+0000 7f60e7cd4700 1 Processor -- start 2023-07-11T00:00:12.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.930+0000 7f60e7cd4700 1 -- start start 2023-07-11T00:00:12.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.930+0000 7f60e7cd4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60e006b120 0x7f60e0071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e7cd4700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f60e00ba160 0x7f60e01485e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e7cd4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f60e00b5fc0 0x7f60e00b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e7cd4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e00b90b0 con 0x7f60e00b5fc0 2023-07-11T00:00:12.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e7cd4700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e00b7180 con 0x7f60e00ba160 2023-07-11T00:00:12.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e7cd4700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0148b20 con 0x7f60e006b120 2023-07-11T00:00:12.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e6271700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f60e00b5fc0 0x7f60e00b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e6271700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f60e00b5fc0 0x7f60e00b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49200/0 (socket says 172.21.15.38:49200) 2023-07-11T00:00:12.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e6271700 1 -- 172.21.15.38:0/3939433614 learned_addr learned my addr 172.21.15.38:0/3939433614 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:12.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e5a70700 1 --2- 172.21.15.38:0/3939433614 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60e006b120 0x7f60e0071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e526f700 1 --2- 172.21.15.38:0/3939433614 >> v2:172.21.15.70:3300/0 conn(0x7f60e00ba160 0x7f60e01485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e6271700 1 -- 172.21.15.38:0/3939433614 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60e006b120 msgr2=0x7f60e0071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:12.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e6271700 1 --2- 172.21.15.38:0/3939433614 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60e006b120 0x7f60e0071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e6271700 1 -- 172.21.15.38:0/3939433614 >> v2:172.21.15.70:3300/0 conn(0x7f60e00ba160 msgr2=0x7f60e01485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:12.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e6271700 1 --2- 172.21.15.38:0/3939433614 >> v2:172.21.15.70:3300/0 conn(0x7f60e00ba160 0x7f60e01485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e6271700 1 -- 172.21.15.38:0/3939433614 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00b6980 con 0x7f60e00b5fc0 2023-07-11T00:00:12.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e6271700 1 --2- 172.21.15.38:0/3939433614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e00b5fc0 0x7f60e00b6440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60e0067200 tx=0x7f60d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d22f623d02268b server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:12.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e4a6e700 1 -- 172.21.15.38:0/3939433614 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d800e070 con 0x7f60e00b5fc0 2023-07-11T00:00:12.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e4a6e700 1 -- 172.21.15.38:0/3939433614 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d800b910 con 0x7f60e00b5fc0 2023-07-11T00:00:12.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.931+0000 7f60e4a6e700 1 -- 172.21.15.38:0/3939433614 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d800bcc0 con 0x7f60e00b5fc0 2023-07-11T00:00:12.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.932+0000 7f60e7cd4700 1 -- 172.21.15.38:0/3939433614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e00b5fc0 msgr2=0x7f60e00b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.932+0000 7f60e7cd4700 1 --2- 172.21.15.38:0/3939433614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e00b5fc0 0x7f60e00b6440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60e0067200 tx=0x7f60d800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:12.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.932+0000 7f60e7cd4700 1 -- 172.21.15.38:0/3939433614 shutdown_connections 2023-07-11T00:00:12.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.932+0000 7f60e7cd4700 1 --2- 172.21.15.38:0/3939433614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e00b5fc0 0x7f60e00b6440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.932+0000 7f60e7cd4700 1 --2- 172.21.15.38:0/3939433614 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60e006b120 0x7f60e0071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.932+0000 7f60e7cd4700 1 --2- 172.21.15.38:0/3939433614 >> v2:172.21.15.70:3300/0 conn(0x7f60e00ba160 0x7f60e01485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.932+0000 7f60e7cd4700 1 -- 172.21.15.38:0/3939433614 >> 172.21.15.38:0/3939433614 conn(0x7f60e00bd980 msgr2=0x7f60e00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:12.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.932+0000 7f60e7cd4700 1 -- 172.21.15.38:0/3939433614 shutdown_connections 2023-07-11T00:00:12.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.932+0000 7f60e7cd4700 1 -- 172.21.15.38:0/3939433614 wait complete. 2023-07-11T00:00:12.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.933+0000 7f60e7cd4700 1 Processor -- start 2023-07-11T00:00:12.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.933+0000 7f60e7cd4700 1 -- start start 2023-07-11T00:00:12.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e7cd4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60e006b120 0x7f60e006f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e7cd4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e00b5fc0 0x7f60e01d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e7cd4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60e00ba160 0x7f60e01d1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e7cd4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e006f570 con 0x7f60e00b5fc0 2023-07-11T00:00:12.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e7cd4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01487f0 con 0x7f60e006b120 2023-07-11T00:00:12.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e7cd4700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00708e0 con 0x7f60e00ba160 2023-07-11T00:00:12.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e526f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e00b5fc0 0x7f60e01d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e526f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e00b5fc0 0x7f60e01d0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49214/0 (socket says 172.21.15.38:49214) 2023-07-11T00:00:12.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e526f700 1 -- 172.21.15.38:0/322107249 learned_addr learned my addr 172.21.15.38:0/322107249 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:12.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e5a70700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60e006b120 0x7f60e006f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e6271700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60e00ba160 0x7f60e01d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e526f700 1 -- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60e00ba160 msgr2=0x7f60e01d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e526f700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60e00ba160 0x7f60e01d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e526f700 1 -- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60e006b120 msgr2=0x7f60e006f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:12.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e526f700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60e006b120 0x7f60e006f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:12.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e526f700 1 -- 172.21.15.38:0/322107249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d8009b30 con 0x7f60e00b5fc0 2023-07-11T00:00:12.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e6271700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60e00ba160 0x7f60e01d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:12.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e526f700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e00b5fc0 0x7f60e01d0e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60d000e870 tx=0x7f60d000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:12.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60d67fc700 1 -- 172.21.15.38:0/322107249 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0009590 con 0x7f60e00b5fc0 2023-07-11T00:00:12.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60d67fc700 1 -- 172.21.15.38:0/322107249 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0013680 con 0x7f60e00b5fc0 2023-07-11T00:00:12.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60e7cd4700 1 -- 172.21.15.38:0/322107249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e013e4f0 con 0x7f60e00b5fc0 2023-07-11T00:00:12.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.934+0000 7f60d67fc700 1 -- 172.21.15.38:0/322107249 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d00139f0 con 0x7f60e00b5fc0 2023-07-11T00:00:12.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.935+0000 7f60e7cd4700 1 -- 172.21.15.38:0/322107249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e006f7e0 con 0x7f60e00b5fc0 2023-07-11T00:00:12.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.935+0000 7f60e7cd4700 1 -- 172.21.15.38:0/322107249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e0074360 con 0x7f60e00b5fc0 2023-07-11T00:00:12.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.936+0000 7f60d67fc700 1 -- 172.21.15.38:0/322107249 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60d0013b50 con 0x7f60e00b5fc0 2023-07-11T00:00:12.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.936+0000 7f60d67fc700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f60c406ace0 0x7f60c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:12.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.936+0000 7f60d67fc700 1 -- 172.21.15.38:0/322107249 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f60d0088ff0 con 0x7f60e00b5fc0 2023-07-11T00:00:12.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.936+0000 7f60e5a70700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f60c406ace0 0x7f60c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:12.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.937+0000 7f60e5a70700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f60c406ace0 0x7f60c406d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009b60 tx=0x7f60dc009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:12.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:12.941+0000 7f60d67fc700 1 -- 172.21.15.38:0/322107249 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f60d0054440 con 0x7f60e00b5fc0 2023-07-11T00:00:13.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.137+0000 7f60e7cd4700 1 -- 172.21.15.38:0/322107249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60e013e6e0 con 0x7f60e00b5fc0 2023-07-11T00:00:13.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.138+0000 7f60d67fc700 1 -- 172.21.15.38:0/322107249 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14519 (secure 0 0 0) 0x7f60d0057a60 con 0x7f60e00b5fc0 2023-07-11T00:00:13.139 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:13.140 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:12.259585+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:13.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.139+0000 7f60e7cd4700 1 -- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f60c406ace0 msgr2=0x7f60c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.139+0000 7f60e7cd4700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f60c406ace0 0x7f60c406d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009b60 tx=0x7f60dc009210 comp rx=0 tx=0).stop 2023-07-11T00:00:13.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.140+0000 7f60e7cd4700 1 -- 172.21.15.38:0/322107249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e00b5fc0 msgr2=0x7f60e01d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.140+0000 7f60e7cd4700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e00b5fc0 0x7f60e01d0e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60d000e870 tx=0x7f60d000eb80 comp rx=0 tx=0).stop 2023-07-11T00:00:13.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.140+0000 7f60e7cd4700 1 -- 172.21.15.38:0/322107249 shutdown_connections 2023-07-11T00:00:13.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.140+0000 7f60e7cd4700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f60c406ace0 0x7f60c406d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.140+0000 7f60e7cd4700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60e00ba160 0x7f60e01d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.140+0000 7f60e7cd4700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60e006b120 0x7f60e006f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.140+0000 7f60e7cd4700 1 --2- 172.21.15.38:0/322107249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e00b5fc0 0x7f60e01d0e30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.140+0000 7f60e7cd4700 1 -- 172.21.15.38:0/322107249 >> 172.21.15.38:0/322107249 conn(0x7f60e00bd980 msgr2=0x7f60e01d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:13.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.140+0000 7f60e7cd4700 1 -- 172.21.15.38:0/322107249 shutdown_connections 2023-07-11T00:00:13.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.140+0000 7f60e7cd4700 1 -- 172.21.15.38:0/322107249 wait complete. 2023-07-11T00:00:13.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:00:13.154 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:00:13.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.280+0000 7f34fbfa3700 1 Processor -- start 2023-07-11T00:00:13.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.281+0000 7f34fbfa3700 1 -- start start 2023-07-11T00:00:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.281+0000 7f34fbfa3700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f34f40bc810 0x7f34f40ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.281+0000 7f34fbfa3700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.281+0000 7f34fbfa3700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f40b8620 con 0x7f34f41449d0 2023-07-11T00:00:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.281+0000 7f34fbfa3700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f40b97a0 con 0x7f34f40bc810 2023-07-11T00:00:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.281+0000 7f34fbfa3700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f4144da0 con 0x7f34f40b8d90 2023-07-11T00:00:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34fa540700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34f953e700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f34f40bc810 0x7f34f40ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34fa540700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f406ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:47586/0 (socket says 172.21.15.38:47586) 2023-07-11T00:00:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34fa540700 1 -- 172.21.15.38:0/1582274620 learned_addr learned my addr 172.21.15.38:0/1582274620 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34fa540700 1 -- 172.21.15.38:0/1582274620 >> v2:172.21.15.70:3300/0 conn(0x7f34f40bc810 msgr2=0x7f34f40ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34fa540700 1 --2- 172.21.15.38:0/1582274620 >> v2:172.21.15.70:3300/0 conn(0x7f34f40bc810 0x7f34f40ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34fa540700 1 -- 172.21.15.38:0/1582274620 >> v1:172.21.15.70:6789/0 conn(0x7f34f41449d0 legacy=0x7f34f414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34fa540700 1 -- 172.21.15.38:0/1582274620 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f40b8900 con 0x7f34f40b8d90 2023-07-11T00:00:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34f953e700 1 --2- 172.21.15.38:0/1582274620 >> v2:172.21.15.70:3300/0 conn(0x7f34f40bc810 0x7f34f40ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:13.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34fa540700 1 --2- 172.21.15.38:0/1582274620 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f406ade0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009e50 tx=0x7f34ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e9d0757f427f18e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:13.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34f8d3d700 1 -- 172.21.15.38:0/1582274620 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec00e070 con 0x7f34f40b8d90 2023-07-11T00:00:13.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34f8d3d700 1 -- 172.21.15.38:0/1582274620 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec00b910 con 0x7f34f40b8d90 2023-07-11T00:00:13.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.282+0000 7f34f8d3d700 1 -- 172.21.15.38:0/1582274620 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec00bcc0 con 0x7f34f40b8d90 2023-07-11T00:00:13.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.283+0000 7f34fbfa3700 1 -- 172.21.15.38:0/1582274620 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 msgr2=0x7f34f406ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.283+0000 7f34fbfa3700 1 --2- 172.21.15.38:0/1582274620 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f406ade0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009e50 tx=0x7f34ec00b330 comp rx=0 tx=0).stop 2023-07-11T00:00:13.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.283+0000 7f34fbfa3700 1 -- 172.21.15.38:0/1582274620 shutdown_connections 2023-07-11T00:00:13.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.283+0000 7f34fbfa3700 1 --2- 172.21.15.38:0/1582274620 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f406ade0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.283+0000 7f34fbfa3700 1 --2- 172.21.15.38:0/1582274620 >> v2:172.21.15.70:3300/0 conn(0x7f34f40bc810 0x7f34f40ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.283+0000 7f34fbfa3700 1 -- 172.21.15.38:0/1582274620 >> 172.21.15.38:0/1582274620 conn(0x7f34f40c0860 msgr2=0x7f34f40c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.283+0000 7f34fbfa3700 1 -- 172.21.15.38:0/1582274620 shutdown_connections 2023-07-11T00:00:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.283+0000 7f34fbfa3700 1 -- 172.21.15.38:0/1582274620 wait complete. 2023-07-11T00:00:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.284+0000 7f34fbfa3700 1 Processor -- start 2023-07-11T00:00:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.284+0000 7f34fbfa3700 1 -- start start 2023-07-11T00:00:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34fbfa3700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f41d4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34fbfa3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34f40bc810 0x7f34f41d57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34fbfa3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f41449d0 0x7f34f41d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34fbfa3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f4142af0 con 0x7f34f40bc810 2023-07-11T00:00:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34fbfa3700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f4142dd0 con 0x7f34f41449d0 2023-07-11T00:00:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34fbfa3700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41d3e50 con 0x7f34f40b8d90 2023-07-11T00:00:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34f9d3f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f41d4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34f953e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34f40bc810 0x7f34f41d57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34f9d3f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f41d4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:47602/0 (socket says 172.21.15.38:47602) 2023-07-11T00:00:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34f953e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34f40bc810 0x7f34f41d57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49218/0 (socket says 172.21.15.38:49218) 2023-07-11T00:00:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34f9d3f700 1 -- 172.21.15.38:0/3151752789 learned_addr learned my addr 172.21.15.38:0/3151752789 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34fa540700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f41449d0 0x7f34f41d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34f9d3f700 1 -- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f41449d0 msgr2=0x7f34f41d5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34f9d3f700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f41449d0 0x7f34f41d5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34f9d3f700 1 -- 172.21.15.38:0/3151752789 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34f40bc810 msgr2=0x7f34f41d57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34f9d3f700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34f40bc810 0x7f34f41d57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34f9d3f700 1 -- 172.21.15.38:0/3151752789 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f00094a0 con 0x7f34f40b8d90 2023-07-11T00:00:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34fa540700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f41449d0 0x7f34f41d5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.285+0000 7f34f953e700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34f40bc810 0x7f34f41d57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.286+0000 7f34f9d3f700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f41d4370 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c430 tx=0x7f34e400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.286+0000 7f34ea7fc700 1 -- 172.21.15.38:0/3151752789 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e40050d0 con 0x7f34f40b8d90 2023-07-11T00:00:13.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.286+0000 7f34ea7fc700 1 -- 172.21.15.38:0/3151752789 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e4005250 con 0x7f34f40b8d90 2023-07-11T00:00:13.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.286+0000 7f34ea7fc700 1 -- 172.21.15.38:0/3151752789 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4006860 con 0x7f34f40b8d90 2023-07-11T00:00:13.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.286+0000 7f34fbfa3700 1 -- 172.21.15.38:0/3151752789 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ec009b30 con 0x7f34f40b8d90 2023-07-11T00:00:13.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.286+0000 7f34fbfa3700 1 -- 172.21.15.38:0/3151752789 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f4145f40 con 0x7f34f40b8d90 2023-07-11T00:00:13.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.287+0000 7f34fbfa3700 1 -- 172.21.15.38:0/3151752789 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f4074360 con 0x7f34f40b8d90 2023-07-11T00:00:13.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.287+0000 7f34ea7fc700 1 -- 172.21.15.38:0/3151752789 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34e4003680 con 0x7f34f40b8d90 2023-07-11T00:00:13.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.288+0000 7f34ea7fc700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f34d806ace0 0x7f34d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.288+0000 7f34ea7fc700 1 -- 172.21.15.38:0/3151752789 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f34e40881e0 con 0x7f34f40b8d90 2023-07-11T00:00:13.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.288+0000 7f34f953e700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f34d806ace0 0x7f34d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.288+0000 7f34f953e700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f34d806ace0 0x7f34d806d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f34f40bfef0 tx=0x7f34f0009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:13.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.293+0000 7f34ea7fc700 1 -- 172.21.15.38:0/3151752789 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f34e4053670 con 0x7f34f40b8d90 2023-07-11T00:00:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.486+0000 7f34fbfa3700 1 -- 172.21.15.38:0/3151752789 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f34f40bcf50 con 0x7f34f40b8d90 2023-07-11T00:00:13.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.487+0000 7f34ea7fc700 1 -- 172.21.15.38:0/3151752789 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34e4056c90 con 0x7f34f40b8d90 2023-07-11T00:00:13.489 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:00:13.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 -- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f34d806ace0 msgr2=0x7f34d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f34d806ace0 0x7f34d806d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f34f40bfef0 tx=0x7f34f0009210 comp rx=0 tx=0).stop 2023-07-11T00:00:13.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 -- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 msgr2=0x7f34f41d4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f41d4370 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c430 tx=0x7f34e400c740 comp rx=0 tx=0).stop 2023-07-11T00:00:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 -- 172.21.15.38:0/3151752789 shutdown_connections 2023-07-11T00:00:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f34d806ace0 0x7f34d806d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f41449d0 0x7f34f41d5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34f40b8d90 0x7f34f41d4370 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 --2- 172.21.15.38:0/3151752789 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34f40bc810 0x7f34f41d57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 -- 172.21.15.38:0/3151752789 >> 172.21.15.38:0/3151752789 conn(0x7f34f40c0860 msgr2=0x7f34f40baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 -- 172.21.15.38:0/3151752789 shutdown_connections 2023-07-11T00:00:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.489+0000 7f34fbfa3700 1 -- 172.21.15.38:0/3151752789 wait complete. 2023-07-11T00:00:13.503 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:00:13.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.630+0000 7f97386fb700 1 Processor -- start 2023-07-11T00:00:13.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.630+0000 7f97386fb700 1 -- start start 2023-07-11T00:00:13.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f97386fb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9730147dc0 0x7f97300721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f97386fb700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9730071840 0x7f9730154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f97386fb700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973006f680 con 0x7f9730069f30 2023-07-11T00:00:13.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f97386fb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9730070950 con 0x7f9730147dc0 2023-07-11T00:00:13.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f97386fb700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973006f920 con 0x7f9730071840 2023-07-11T00:00:13.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f9736497700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9730147dc0 0x7f97300721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f9736497700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9730147dc0 0x7f97300721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49234/0 (socket says 172.21.15.38:49234) 2023-07-11T00:00:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f9736497700 1 -- 172.21.15.38:0/2935133942 learned_addr learned my addr 172.21.15.38:0/2935133942 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f9736c98700 1 --2- 172.21.15.38:0/2935133942 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9730071840 0x7f9730154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f9736497700 1 -- 172.21.15.38:0/2935133942 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9730071840 msgr2=0x7f9730154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f9736497700 1 --2- 172.21.15.38:0/2935133942 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9730071840 0x7f9730154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f9736497700 1 -- 172.21.15.38:0/2935133942 >> v1:172.21.15.70:6789/0 conn(0x7f9730069f30 legacy=0x7f9730071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f9736497700 1 -- 172.21.15.38:0/2935133942 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300b9660 con 0x7f9730147dc0 2023-07-11T00:00:13.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.631+0000 7f9736497700 1 --2- 172.21.15.38:0/2935133942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9730147dc0 0x7f97300721e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f97200098f0 tx=0x7f9720009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e56543572345b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:13.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.632+0000 7f9735495700 1 -- 172.21.15.38:0/2935133942 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720004230 con 0x7f9730147dc0 2023-07-11T00:00:13.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.632+0000 7f9735495700 1 -- 172.21.15.38:0/2935133942 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9720004390 con 0x7f9730147dc0 2023-07-11T00:00:13.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.632+0000 7f9735495700 1 -- 172.21.15.38:0/2935133942 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200036a0 con 0x7f9730147dc0 2023-07-11T00:00:13.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.632+0000 7f97386fb700 1 -- 172.21.15.38:0/2935133942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9730147dc0 msgr2=0x7f97300721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.632+0000 7f97386fb700 1 --2- 172.21.15.38:0/2935133942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9730147dc0 0x7f97300721e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f97200098f0 tx=0x7f9720009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:13.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.632+0000 7f97386fb700 1 -- 172.21.15.38:0/2935133942 shutdown_connections 2023-07-11T00:00:13.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.632+0000 7f97386fb700 1 --2- 172.21.15.38:0/2935133942 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9730071840 0x7f9730154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.632+0000 7f97386fb700 1 --2- 172.21.15.38:0/2935133942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9730147dc0 0x7f97300721e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.632+0000 7f97386fb700 1 -- 172.21.15.38:0/2935133942 >> 172.21.15.38:0/2935133942 conn(0x7f973006d0e0 msgr2=0x7f973006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:13.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.632+0000 7f97386fb700 1 -- 172.21.15.38:0/2935133942 shutdown_connections 2023-07-11T00:00:13.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.632+0000 7f97386fb700 1 -- 172.21.15.38:0/2935133942 wait complete. 2023-07-11T00:00:13.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.633+0000 7f97386fb700 1 Processor -- start 2023-07-11T00:00:13.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.633+0000 7f97386fb700 1 -- start start 2023-07-11T00:00:13.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f97386fb700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9730069f30 0x7f973013dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f97386fb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730071840 0x7f973013cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f97386fb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9730147dc0 0x7f973013d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f97386fb700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973014be60 con 0x7f9730147dc0 2023-07-11T00:00:13.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f97386fb700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973014b870 con 0x7f9730071840 2023-07-11T00:00:13.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f97386fb700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973013e760 con 0x7f9730069f30 2023-07-11T00:00:13.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f9736c98700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9730147dc0 0x7f973013d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f9736c98700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9730147dc0 0x7f973013d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49236/0 (socket says 172.21.15.38:49236) 2023-07-11T00:00:13.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f9736c98700 1 -- 172.21.15.38:0/3572708422 learned_addr learned my addr 172.21.15.38:0/3572708422 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:13.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f9736497700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9730069f30 0x7f973013dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f9735c96700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730071840 0x7f973013cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f9736c98700 1 -- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9730069f30 msgr2=0x7f973013dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f9736c98700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9730069f30 0x7f973013dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f9736c98700 1 -- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730071840 msgr2=0x7f973013cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f9736c98700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730071840 0x7f973013cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.634+0000 7f9736c98700 1 -- 172.21.15.38:0/3572708422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9720009550 con 0x7f9730147dc0 2023-07-11T00:00:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.635+0000 7f9736c98700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9730147dc0 0x7f973013d1c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f972800cd60 tx=0x7f972800a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.635+0000 7f9726ffd700 1 -- 172.21.15.38:0/3572708422 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728003a20 con 0x7f9730147dc0 2023-07-11T00:00:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.635+0000 7f9726ffd700 1 -- 172.21.15.38:0/3572708422 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728003ba0 con 0x7f9730147dc0 2023-07-11T00:00:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.635+0000 7f97386fb700 1 -- 172.21.15.38:0/3572708422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973013e210 con 0x7f9730147dc0 2023-07-11T00:00:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.635+0000 7f9726ffd700 1 -- 172.21.15.38:0/3572708422 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728004020 con 0x7f9730147dc0 2023-07-11T00:00:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.635+0000 7f97386fb700 1 -- 172.21.15.38:0/3572708422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973013c760 con 0x7f9730147dc0 2023-07-11T00:00:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.636+0000 7f97386fb700 1 -- 172.21.15.38:0/3572708422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9730074360 con 0x7f9730147dc0 2023-07-11T00:00:13.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.636+0000 7f9726ffd700 1 -- 172.21.15.38:0/3572708422 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9728004180 con 0x7f9730147dc0 2023-07-11T00:00:13.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.637+0000 7f9726ffd700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f971406ace0 0x7f971406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.637+0000 7f9726ffd700 1 -- 172.21.15.38:0/3572708422 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9728012070 con 0x7f9730147dc0 2023-07-11T00:00:13.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.637+0000 7f9736497700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f971406ace0 0x7f971406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.637+0000 7f9736497700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f971406ace0 0x7f971406d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9720009130 tx=0x7f9720008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:13.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.641+0000 7f9726ffd700 1 -- 172.21.15.38:0/3572708422 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9728054c40 con 0x7f9730147dc0 2023-07-11T00:00:13.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.836+0000 7f97386fb700 1 -- 172.21.15.38:0/3572708422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97300b81c0 con 0x7f9730147dc0 2023-07-11T00:00:13.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.836+0000 7f9726ffd700 1 -- 172.21.15.38:0/3572708422 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9728058260 con 0x7f9730147dc0 2023-07-11T00:00:13.839 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:00:13.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 -- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f971406ace0 msgr2=0x7f971406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f971406ace0 0x7f971406d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9720009130 tx=0x7f9720008030 comp rx=0 tx=0).stop 2023-07-11T00:00:13.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 -- 172.21.15.38:0/3572708422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9730147dc0 msgr2=0x7f973013d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9730147dc0 0x7f973013d1c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f972800cd60 tx=0x7f972800a570 comp rx=0 tx=0).stop 2023-07-11T00:00:13.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 -- 172.21.15.38:0/3572708422 shutdown_connections 2023-07-11T00:00:13.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f971406ace0 0x7f971406d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9730147dc0 0x7f973013d1c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9730069f30 0x7f973013dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 --2- 172.21.15.38:0/3572708422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730071840 0x7f973013cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 -- 172.21.15.38:0/3572708422 >> 172.21.15.38:0/3572708422 conn(0x7f973006d0e0 msgr2=0x7f973006a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:13.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 -- 172.21.15.38:0/3572708422 shutdown_connections 2023-07-11T00:00:13.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.839+0000 7f97386fb700 1 -- 172.21.15.38:0/3572708422 wait complete. 2023-07-11T00:00:13.852 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-11T00:00:13.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.976+0000 7f3a42c79700 1 Processor -- start 2023-07-11T00:00:13.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.976+0000 7f3a42c79700 1 -- start start 2023-07-11T00:00:13.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a42c79700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a3c071bc0 0x7f3a3c0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a42c79700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3a3c0ba3e0 0x7f3a3c142410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a42c79700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a3c0ba010 con 0x7f3a3c0717f0 2023-07-11T00:00:13.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a42c79700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a3c0b9570 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a42c79700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c0ba860 con 0x7f3a3c071bc0 2023-07-11T00:00:13.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a41216700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3a3c0ba3e0 0x7f3a3c142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a40a15700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3a3c0717f0 0x7f3a3c0b8e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53706/0 (socket says 172.21.15.38:53706) 2023-07-11T00:00:13.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a40a15700 1 -- 172.21.15.38:0/617475786 learned_addr learned my addr 172.21.15.38:0/617475786 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:13.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a3bfff700 1 --2- 172.21.15.38:0/617475786 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a3c071bc0 0x7f3a3c0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a41216700 1 -- 172.21.15.38:0/617475786 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a3c071bc0 msgr2=0x7f3a3c0b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:13.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a41216700 1 --2- 172.21.15.38:0/617475786 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a3c071bc0 0x7f3a3c0b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a41216700 1 -- 172.21.15.38:0/617475786 >> v1:172.21.15.38:6789/0 conn(0x7f3a3c0717f0 legacy=0x7f3a3c0b8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a3b7fe700 1 -- 172.21.15.38:0/617475786 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307786092 0 0) 0x7f3a3c0ba010 con 0x7f3a3c0717f0 2023-07-11T00:00:13.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a41216700 1 -- 172.21.15.38:0/617475786 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c0b85a0 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a3bfff700 1 --2- 172.21.15.38:0/617475786 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a3c071bc0 0x7f3a3c0b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:13.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a41216700 1 --2- 172.21.15.38:0/617475786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a3c0ba3e0 0x7f3a3c142410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009df0 tx=0x7f3a3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55c5fd531d4bd server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:13.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a3b7fe700 1 -- 172.21.15.38:0/617475786 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400e070 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a3b7fe700 1 -- 172.21.15.38:0/617475786 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3400bb50 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.977+0000 7f3a3b7fe700 1 -- 172.21.15.38:0/617475786 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34012430 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.978+0000 7f3a42c79700 1 -- 172.21.15.38:0/617475786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a3c0ba3e0 msgr2=0x7f3a3c142410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.978+0000 7f3a42c79700 1 --2- 172.21.15.38:0/617475786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a3c0ba3e0 0x7f3a3c142410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009df0 tx=0x7f3a3400b330 comp rx=0 tx=0).stop 2023-07-11T00:00:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.978+0000 7f3a42c79700 1 -- 172.21.15.38:0/617475786 shutdown_connections 2023-07-11T00:00:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.978+0000 7f3a42c79700 1 --2- 172.21.15.38:0/617475786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a3c0ba3e0 0x7f3a3c142410 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.978+0000 7f3a42c79700 1 --2- 172.21.15.38:0/617475786 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a3c071bc0 0x7f3a3c0b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.978+0000 7f3a42c79700 1 -- 172.21.15.38:0/617475786 >> 172.21.15.38:0/617475786 conn(0x7f3a3c06d0e0 msgr2=0x7f3a3c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.978+0000 7f3a42c79700 1 -- 172.21.15.38:0/617475786 shutdown_connections 2023-07-11T00:00:13.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.978+0000 7f3a42c79700 1 -- 172.21.15.38:0/617475786 wait complete. 2023-07-11T00:00:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.979+0000 7f3a42c79700 1 Processor -- start 2023-07-11T00:00:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.979+0000 7f3a42c79700 1 -- start start 2023-07-11T00:00:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a42c79700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a3c0717f0 0x7f3a3c139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a42c79700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a3c071bc0 0x7f3a3c13a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a42c79700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a3c0ba3e0 0x7f3a3c13a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a42c79700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c0bbaf0 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a42c79700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c1dd6a0 con 0x7f3a3c0717f0 2023-07-11T00:00:13.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a42c79700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c1ddf00 con 0x7f3a3c071bc0 2023-07-11T00:00:13.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a41216700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a3c0ba3e0 0x7f3a3c13a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a41216700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a3c0ba3e0 0x7f3a3c13a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49242/0 (socket says 172.21.15.38:49242) 2023-07-11T00:00:13.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a41216700 1 -- 172.21.15.38:0/1443341297 learned_addr learned my addr 172.21.15.38:0/1443341297 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:13.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a40a15700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a3c0717f0 0x7f3a3c139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a3bfff700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a3c071bc0 0x7f3a3c13a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a41216700 1 -- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a3c071bc0 msgr2=0x7f3a3c13a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a41216700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a3c071bc0 0x7f3a3c13a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a41216700 1 -- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a3c0717f0 msgr2=0x7f3a3c139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:13.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a41216700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a3c0717f0 0x7f3a3c139870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:13.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.980+0000 7f3a41216700 1 -- 172.21.15.38:0/1443341297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a34009a70 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.981+0000 7f3a41216700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a3c0ba3e0 0x7f3a3c13a870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400b370 tx=0x7f3a34004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:13.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.981+0000 7f3a397fa700 1 -- 172.21.15.38:0/1443341297 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34012430 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.981+0000 7f3a397fa700 1 -- 172.21.15.38:0/1443341297 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a34020070 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.981+0000 7f3a397fa700 1 -- 172.21.15.38:0/1443341297 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340098f0 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.981+0000 7f3a42c79700 1 -- 172.21.15.38:0/1443341297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3c1dd8b0 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.981+0000 7f3a42c79700 1 -- 172.21.15.38:0/1443341297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3c0b6710 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.982+0000 7f3a42c79700 1 -- 172.21.15.38:0/1443341297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3c074360 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.982+0000 7f3a397fa700 1 -- 172.21.15.38:0/1443341297 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a34004040 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.982+0000 7f3a397fa700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a2006ace0 0x7f3a2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:13.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.983+0000 7f3a397fa700 1 -- 172.21.15.38:0/1443341297 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3a34022070 con 0x7f3a3c0ba3e0 2023-07-11T00:00:13.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.983+0000 7f3a40a15700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a2006ace0 0x7f3a2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:13.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.983+0000 7f3a40a15700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a2006ace0 0x7f3a2006d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3a30007fd0 tx=0x7f3a30007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:13.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:13.987+0000 7f3a397fa700 1 -- 172.21.15.38:0/1443341297 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3a34056220 con 0x7f3a3c0ba3e0 2023-07-11T00:00:14.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.186+0000 7f3a42c79700 1 -- 172.21.15.38:0/1443341297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3a3c1de040 con 0x7f3a3c0ba3e0 2023-07-11T00:00:14.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.187+0000 7f3a397fa700 1 -- 172.21.15.38:0/1443341297 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f3a3402c020 con 0x7f3a3c0ba3e0 2023-07-11T00:00:14.189 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:14.189 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-07-11T00:00:14.189 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:14.189 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-07-11T00:00:14.189 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": "rbd" 2023-07-11T00:00:14.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:14.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:14.190 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 2, 2023-07-11T00:00:14.190 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-07-11T00:00:14.190 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:14.190 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-07-11T00:00:14.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 -- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a2006ace0 msgr2=0x7f3a2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:14.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a2006ace0 0x7f3a2006d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3a30007fd0 tx=0x7f3a30007de0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 -- 172.21.15.38:0/1443341297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a3c0ba3e0 msgr2=0x7f3a3c13a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:14.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a3c0ba3e0 0x7f3a3c13a870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400b370 tx=0x7f3a34004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 -- 172.21.15.38:0/1443341297 shutdown_connections 2023-07-11T00:00:14.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a2006ace0 0x7f3a2006d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a3c0ba3e0 0x7f3a3c13a870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a3c0717f0 0x7f3a3c139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 --2- 172.21.15.38:0/1443341297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a3c071bc0 0x7f3a3c13a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 -- 172.21.15.38:0/1443341297 >> 172.21.15.38:0/1443341297 conn(0x7f3a3c06d0e0 msgr2=0x7f3a3c1419e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:14.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 -- 172.21.15.38:0/1443341297 shutdown_connections 2023-07-11T00:00:14.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.189+0000 7f3a42c79700 1 -- 172.21.15.38:0/1443341297 wait complete. 2023-07-11T00:00:14.203 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-11T00:00:14.203 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-11T00:00:14.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.331+0000 7ff2055d4700 1 Processor -- start 2023-07-11T00:00:14.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.331+0000 7ff2055d4700 1 -- start start 2023-07-11T00:00:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.331+0000 7ff2055d4700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff2000b6980 0x7ff20014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.331+0000 7ff2055d4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2000bb380 con 0x7ff20014aae0 2023-07-11T00:00:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.331+0000 7ff2055d4700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2000bc4c0 con 0x7ff2000bb880 2023-07-11T00:00:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.331+0000 7ff2055d4700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2000b7dd0 con 0x7ff2000b6980 2023-07-11T00:00:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fe7fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff20014aae0 0x7ff2001443d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53710/0 (socket says 172.21.15.38:53710) 2023-07-11T00:00:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fe7fc700 1 -- 172.21.15.38:0/1723154278 learned_addr learned my addr 172.21.15.38:0/1723154278 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:14.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1feffd700 1 --2- 172.21.15.38:0/1723154278 >> v2:172.21.15.70:3300/0 conn(0x7ff2000b6980 0x7ff20014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:14.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469667378 0 0) 0x7ff2000bb380 con 0x7ff20014aae0 2023-07-11T00:00:14.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e80035b0 con 0x7ff20014aae0 2023-07-11T00:00:14.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2165157248 0 0) 0x7ff1e80035b0 con 0x7ff20014aae0 2023-07-11T00:00:14.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 >> v2:172.21.15.70:3300/0 conn(0x7ff2000b6980 msgr2=0x7ff20014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:14.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 --2- 172.21.15.38:0/1723154278 >> v2:172.21.15.70:3300/0 conn(0x7ff2000b6980 0x7ff20014a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 >> v1:172.21.15.70:6789/0 conn(0x7ff2000bb880 legacy=0x7ff2000bbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:14.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20014aff0 con 0x7ff20014aae0 2023-07-11T00:00:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7ff1f4001670 con 0x7ff20014aae0 2023-07-11T00:00:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 >> v1:172.21.15.38:6789/0 conn(0x7ff20014aae0 legacy=0x7ff2001443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 --2- 172.21.15.38:0/1723154278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e8003a00 0x7ff1e8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 --2- 172.21.15.38:0/1723154278 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1e8004850 0x7ff1e8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 --2- 172.21.15.38:0/1723154278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1e8005200 0x7ff1e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000b7dd0 con 0x7ff1e8005200 2023-07-11T00:00:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e800c080 con 0x7ff1e8003a00 2023-07-11T00:00:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e800c240 con 0x7ff1e8004850 2023-07-11T00:00:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1ff7fe700 1 --2- 172.21.15.38:0/1723154278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1e8005200 0x7ff1e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1feffd700 1 --2- 172.21.15.38:0/1723154278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e8003a00 0x7ff1e8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.332+0000 7ff1fe7fc700 1 --2- 172.21.15.38:0/1723154278 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1e8004850 0x7ff1e8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff1ff7fe700 1 -- 172.21.15.38:0/1723154278 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1e8004850 msgr2=0x7ff1e8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff1ff7fe700 1 --2- 172.21.15.38:0/1723154278 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1e8004850 0x7ff1e8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff1ff7fe700 1 -- 172.21.15.38:0/1723154278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e8003a00 msgr2=0x7ff1e8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff1ff7fe700 1 --2- 172.21.15.38:0/1723154278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e8003a00 0x7ff1e8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff1ff7fe700 1 -- 172.21.15.38:0/1723154278 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e80035b0 con 0x7ff1e8005200 2023-07-11T00:00:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff1ff7fe700 1 -- 172.21.15.38:0/1723154278 reap_dead start 2023-07-11T00:00:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff1ff7fe700 1 --2- 172.21.15.38:0/1723154278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1e8005200 0x7ff1e800ba10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c190 tx=0x7ff1e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7f3df1997b7f4f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8001db0 con 0x7ff1e8005200 2023-07-11T00:00:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f800ccf0 con 0x7ff1e8005200 2023-07-11T00:00:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff1fdffb700 1 -- 172.21.15.38:0/1723154278 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8003c40 con 0x7ff1e8005200 2023-07-11T00:00:14.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff2055d4700 1 -- 172.21.15.38:0/1723154278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1e8005200 msgr2=0x7ff1e800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:14.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff2055d4700 1 --2- 172.21.15.38:0/1723154278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1e8005200 0x7ff1e800ba10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c190 tx=0x7ff1e8005880 comp rx=0 tx=0).stop 2023-07-11T00:00:14.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.333+0000 7ff2055d4700 1 -- 172.21.15.38:0/1723154278 shutdown_connections 2023-07-11T00:00:14.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.334+0000 7ff2055d4700 1 --2- 172.21.15.38:0/1723154278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1e8005200 0x7ff1e800ba10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.334+0000 7ff2055d4700 1 -- 172.21.15.38:0/1723154278 >> 172.21.15.38:0/1723154278 conn(0x7ff200071660 msgr2=0x7ff200071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:14.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.334+0000 7ff2055d4700 1 -- 172.21.15.38:0/1723154278 shutdown_connections 2023-07-11T00:00:14.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.334+0000 7ff2055d4700 1 -- 172.21.15.38:0/1723154278 wait complete. 2023-07-11T00:00:14.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.335+0000 7ff2055d4700 1 Processor -- start 2023-07-11T00:00:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.335+0000 7ff2055d4700 1 -- start start 2023-07-11T00:00:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.335+0000 7ff2055d4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e8005200 0x7ff2000b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.335+0000 7ff2055d4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2001d4460 0x7ff2001d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.335+0000 7ff2055d4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff2001d2920 0x7ff2001d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.335+0000 7ff2055d4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2001d3ff0 con 0x7ff2001d4460 2023-07-11T00:00:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.335+0000 7ff2055d4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20013af60 con 0x7ff1e8005200 2023-07-11T00:00:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff2055d4700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2001d48d0 con 0x7ff2001d2920 2023-07-11T00:00:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1fe7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2001d4460 0x7ff2001d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1fe7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2001d4460 0x7ff2001d3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49262/0 (socket says 172.21.15.38:49262) 2023-07-11T00:00:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1fe7fc700 1 -- 172.21.15.38:0/856946822 learned_addr learned my addr 172.21.15.38:0/856946822 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1feffd700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e8005200 0x7ff2000b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1ff7fe700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff2001d2920 0x7ff2001d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1fe7fc700 1 -- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff2001d2920 msgr2=0x7ff2001d2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1fe7fc700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff2001d2920 0x7ff2001d2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1fe7fc700 1 -- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e8005200 msgr2=0x7ff2000b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1fe7fc700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e8005200 0x7ff2000b85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1fe7fc700 1 -- 172.21.15.38:0/856946822 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2001d32d0 con 0x7ff2001d4460 2023-07-11T00:00:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1feffd700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e8005200 0x7ff2000b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1ff7fe700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff2001d2920 0x7ff2001d2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1fe7fc700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2001d4460 0x7ff2001d3ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40072c0 tx=0x7ff1f4007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1e77fe700 1 -- 172.21.15.38:0/856946822 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f40014c0 con 0x7ff2001d4460 2023-07-11T00:00:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1e77fe700 1 -- 172.21.15.38:0/856946822 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f400f850 con 0x7ff2001d4460 2023-07-11T00:00:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff2055d4700 1 -- 172.21.15.38:0/856946822 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20013a910 con 0x7ff2001d4460 2023-07-11T00:00:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff1e77fe700 1 -- 172.21.15.38:0/856946822 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f400fc00 con 0x7ff2001d4460 2023-07-11T00:00:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.336+0000 7ff2055d4700 1 -- 172.21.15.38:0/856946822 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2001d2030 con 0x7ff2001d4460 2023-07-11T00:00:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.337+0000 7ff2055d4700 1 -- 172.21.15.38:0/856946822 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20013b0d0 con 0x7ff2001d4460 2023-07-11T00:00:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.338+0000 7ff1e77fe700 1 -- 172.21.15.38:0/856946822 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff1f400fd60 con 0x7ff2001d4460 2023-07-11T00:00:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.338+0000 7ff1e77fe700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1ec06ace0 0x7ff1ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.338+0000 7ff1e77fe700 1 -- 172.21.15.38:0/856946822 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff1f4088b30 con 0x7ff2001d4460 2023-07-11T00:00:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.338+0000 7ff1feffd700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1ec06ace0 0x7ff1ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.339+0000 7ff1feffd700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1ec06ace0 0x7ff1ec06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009ae0 tx=0x7ff1f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.343+0000 7ff1e77fe700 1 -- 172.21.15.38:0/856946822 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff1f4053fc0 con 0x7ff2001d4460 2023-07-11T00:00:14.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:14.541+0000 7ff2055d4700 1 -- 172.21.15.38:0/856946822 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff200074360 con 0x7ff2001d4460 2023-07-11T00:00:15.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.361+0000 7ff1e77fe700 1 -- 172.21.15.38:0/856946822 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff1f40575e0 con 0x7ff2001d4460 2023-07-11T00:00:15.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.365+0000 7ff2055d4700 1 -- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1ec06ace0 msgr2=0x7ff1ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:15.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.365+0000 7ff2055d4700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1ec06ace0 0x7ff1ec06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009ae0 tx=0x7ff1f0008040 comp rx=0 tx=0).stop 2023-07-11T00:00:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.365+0000 7ff2055d4700 1 -- 172.21.15.38:0/856946822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2001d4460 msgr2=0x7ff2001d3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.365+0000 7ff2055d4700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2001d4460 0x7ff2001d3ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40072c0 tx=0x7ff1f4007680 comp rx=0 tx=0).stop 2023-07-11T00:00:15.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.365+0000 7ff2055d4700 1 -- 172.21.15.38:0/856946822 shutdown_connections 2023-07-11T00:00:15.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.365+0000 7ff2055d4700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1ec06ace0 0x7ff1ec06d190 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009ae0 tx=0x7ff1f0008040 comp rx=0 tx=0).stop 2023-07-11T00:00:15.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.365+0000 7ff2055d4700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff2001d2920 0x7ff2001d2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.365+0000 7ff2055d4700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1e8005200 0x7ff2000b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.365+0000 7ff2055d4700 1 --2- 172.21.15.38:0/856946822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2001d4460 0x7ff2001d3ab0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.365+0000 7ff2055d4700 1 -- 172.21.15.38:0/856946822 >> 172.21.15.38:0/856946822 conn(0x7ff200071660 msgr2=0x7ff2000b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.367+0000 7ff2055d4700 1 -- 172.21.15.38:0/856946822 shutdown_connections 2023-07-11T00:00:15.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.367+0000 7ff2055d4700 1 -- 172.21.15.38:0/856946822 wait complete. 2023-07-11T00:00:15.370 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-07-11T00:00:15.385 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-11T00:00:15.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.523+0000 7f18e08de700 1 Processor -- start 2023-07-11T00:00:15.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.523+0000 7f18e08de700 1 -- start start 2023-07-11T00:00:15.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.524+0000 7f18e08de700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f18dc06b120 0x7f18dc06edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:15.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.524+0000 7f18e08de700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc0b93e0 con 0x7f18dc06f340 2023-07-11T00:00:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.524+0000 7f18e08de700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc141200 con 0x7f18dc071ab0 2023-07-11T00:00:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.524+0000 7f18e08de700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc071690 con 0x7f18dc06b120 2023-07-11T00:00:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.524+0000 7f18dad9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f18dc06f340 0x7f18dc151370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53722/0 (socket says 172.21.15.38:53722) 2023-07-11T00:00:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.524+0000 7f18dad9d700 1 -- 172.21.15.38:0/371838357 learned_addr learned my addr 172.21.15.38:0/371838357 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945907104 0 0) 0x7f18dc0b93e0 con 0x7f18dc06f340 2023-07-11T00:00:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c40035b0 con 0x7f18dc06f340 2023-07-11T00:00:15.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18da59c700 1 --2- 172.21.15.38:0/371838357 >> v2:172.21.15.70:3300/0 conn(0x7f18dc06b120 0x7f18dc06edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3309547851 0 0) 0x7f18c40035b0 con 0x7f18dc06f340 2023-07-11T00:00:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 >> v2:172.21.15.70:3300/0 conn(0x7f18dc06b120 msgr2=0x7f18dc06edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 --2- 172.21.15.38:0/371838357 >> v2:172.21.15.70:3300/0 conn(0x7f18dc06b120 0x7f18dc06edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 >> v1:172.21.15.70:6789/0 conn(0x7f18dc071ab0 legacy=0x7f18dc140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc06f8d0 con 0x7f18dc06f340 2023-07-11T00:00:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f18d40019f0 con 0x7f18dc06f340 2023-07-11T00:00:15.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 >> v1:172.21.15.38:6789/0 conn(0x7f18dc06f340 legacy=0x7f18dc151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 --2- 172.21.15.38:0/371838357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18c4003a00 0x7f18c4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 --2- 172.21.15.38:0/371838357 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18c4004850 0x7f18c4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 --2- 172.21.15.38:0/371838357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c4005200 0x7f18c400cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc071690 con 0x7f18c4005200 2023-07-11T00:00:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c400d170 con 0x7f18c4003a00 2023-07-11T00:00:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c400d330 con 0x7f18c4004850 2023-07-11T00:00:15.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18dad9d700 1 --2- 172.21.15.38:0/371838357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c4005200 0x7f18c400cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18da59c700 1 --2- 172.21.15.38:0/371838357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18c4003a00 0x7f18c4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18d9d9b700 1 --2- 172.21.15.38:0/371838357 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18c4004850 0x7f18c4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18dad9d700 1 -- 172.21.15.38:0/371838357 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18c4004850 msgr2=0x7f18c4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18dad9d700 1 --2- 172.21.15.38:0/371838357 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18c4004850 0x7f18c4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18dad9d700 1 -- 172.21.15.38:0/371838357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18c4003a00 msgr2=0x7f18c4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18dad9d700 1 --2- 172.21.15.38:0/371838357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18c4003a00 0x7f18c4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18dad9d700 1 -- 172.21.15.38:0/371838357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c40035b0 con 0x7f18c4005200 2023-07-11T00:00:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.525+0000 7f18dad9d700 1 -- 172.21.15.38:0/371838357 reap_dead start 2023-07-11T00:00:15.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.526+0000 7f18dad9d700 1 --2- 172.21.15.38:0/371838357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c4005200 0x7f18c400cb20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18d40013d0 tx=0x7f18c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce72c5666833e762 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:15.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.526+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4012600 con 0x7f18c4005200 2023-07-11T00:00:15.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.526+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d40127a0 con 0x7f18c4005200 2023-07-11T00:00:15.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.526+0000 7f18d959a700 1 -- 172.21.15.38:0/371838357 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4012b50 con 0x7f18c4005200 2023-07-11T00:00:15.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.526+0000 7f18e08de700 1 -- 172.21.15.38:0/371838357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c4005200 msgr2=0x7f18c400cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:15.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.526+0000 7f18e08de700 1 --2- 172.21.15.38:0/371838357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c4005200 0x7f18c400cb20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18d40013d0 tx=0x7f18c4005880 comp rx=0 tx=0).stop 2023-07-11T00:00:15.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.526+0000 7f18e08de700 1 -- 172.21.15.38:0/371838357 shutdown_connections 2023-07-11T00:00:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.526+0000 7f18e08de700 1 --2- 172.21.15.38:0/371838357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18c4005200 0x7f18c400cb20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.526+0000 7f18e08de700 1 -- 172.21.15.38:0/371838357 >> 172.21.15.38:0/371838357 conn(0x7f18dc0bd980 msgr2=0x7f18dc0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.526+0000 7f18e08de700 1 -- 172.21.15.38:0/371838357 shutdown_connections 2023-07-11T00:00:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.526+0000 7f18e08de700 1 -- 172.21.15.38:0/371838357 wait complete. 2023-07-11T00:00:15.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.528+0000 7f18e08de700 1 Processor -- start 2023-07-11T00:00:15.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.528+0000 7f18e08de700 1 -- start start 2023-07-11T00:00:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.528+0000 7f18e08de700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18c4005200 0x7f18dc0b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.528+0000 7f18e08de700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18dc143e80 0x7f18dc142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.528+0000 7f18e08de700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18dc1432a0 0x7f18dc0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.528+0000 7f18e08de700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc0b7f30 con 0x7f18dc143e80 2023-07-11T00:00:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.528+0000 7f18e08de700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc0b3580 con 0x7f18c4005200 2023-07-11T00:00:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.528+0000 7f18e08de700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc1425b0 con 0x7f18dc1432a0 2023-07-11T00:00:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.528+0000 7f18d9d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18dc143e80 0x7f18dc142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.528+0000 7f18d9d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18dc143e80 0x7f18dc142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49274/0 (socket says 172.21.15.38:49274) 2023-07-11T00:00:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.528+0000 7f18d9d9b700 1 -- 172.21.15.38:0/1481769510 learned_addr learned my addr 172.21.15.38:0/1481769510 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18da59c700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18c4005200 0x7f18dc0b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18dad9d700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18dc1432a0 0x7f18dc0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18d9d9b700 1 -- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18dc1432a0 msgr2=0x7f18dc0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18d9d9b700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18dc1432a0 0x7f18dc0b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18d9d9b700 1 -- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18c4005200 msgr2=0x7f18dc0b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18d9d9b700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18c4005200 0x7f18dc0b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18d9d9b700 1 -- 172.21.15.38:0/1481769510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc0b30f0 con 0x7f18dc143e80 2023-07-11T00:00:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18d9d9b700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18dc143e80 0x7f18dc142d60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f18d000f880 tx=0x7f18d000fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18caffd700 1 -- 172.21.15.38:0/1481769510 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00050d0 con 0x7f18dc143e80 2023-07-11T00:00:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18caffd700 1 -- 172.21.15.38:0/1481769510 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0005230 con 0x7f18dc143e80 2023-07-11T00:00:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18e08de700 1 -- 172.21.15.38:0/1481769510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc142800 con 0x7f18dc143e80 2023-07-11T00:00:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18caffd700 1 -- 172.21.15.38:0/1481769510 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0003680 con 0x7f18dc143e80 2023-07-11T00:00:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.529+0000 7f18e08de700 1 -- 172.21.15.38:0/1481769510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc0b6580 con 0x7f18dc143e80 2023-07-11T00:00:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.530+0000 7f18e08de700 1 -- 172.21.15.38:0/1481769510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc0b3280 con 0x7f18dc143e80 2023-07-11T00:00:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.530+0000 7f18caffd700 1 -- 172.21.15.38:0/1481769510 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18d00037e0 con 0x7f18dc143e80 2023-07-11T00:00:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.531+0000 7f18caffd700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f18bc06ace0 0x7f18bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.531+0000 7f18caffd700 1 -- 172.21.15.38:0/1481769510 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f18d00890a0 con 0x7f18dc143e80 2023-07-11T00:00:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.531+0000 7f18da59c700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f18bc06ace0 0x7f18bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.532+0000 7f18da59c700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f18bc06ace0 0x7f18bc06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009b20 tx=0x7f18cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.536+0000 7f18caffd700 1 -- 172.21.15.38:0/1481769510 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f18d0054290 con 0x7f18dc143e80 2023-07-11T00:00:15.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:15.733+0000 7f18e08de700 1 -- 172.21.15.38:0/1481769510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f18dc070e10 con 0x7f18dc143e80 2023-07-11T00:00:15.835 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:00:15.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:00:15.839 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:00:16.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.374+0000 7f18caffd700 1 -- 172.21.15.38:0/1481769510 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f18d005d0d0 con 0x7f18dc143e80 2023-07-11T00:00:16.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.381+0000 7f18e08de700 1 -- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f18bc06ace0 msgr2=0x7f18bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:16.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.381+0000 7f18e08de700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f18bc06ace0 0x7f18bc06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009b20 tx=0x7f18cc008040 comp rx=0 tx=0).stop 2023-07-11T00:00:16.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.381+0000 7f18e08de700 1 -- 172.21.15.38:0/1481769510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18dc143e80 msgr2=0x7f18dc142d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:16.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.381+0000 7f18e08de700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18dc143e80 0x7f18dc142d60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f18d000f880 tx=0x7f18d000fc40 comp rx=0 tx=0).stop 2023-07-11T00:00:16.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.381+0000 7f18e08de700 1 -- 172.21.15.38:0/1481769510 shutdown_connections 2023-07-11T00:00:16.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.381+0000 7f18e08de700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f18bc06ace0 0x7f18bc06d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:16.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.381+0000 7f18e08de700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18dc1432a0 0x7f18dc0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:16.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.381+0000 7f18e08de700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18c4005200 0x7f18dc0b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:16.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.381+0000 7f18e08de700 1 --2- 172.21.15.38:0/1481769510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18dc143e80 0x7f18dc142d60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:16.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.381+0000 7f18e08de700 1 -- 172.21.15.38:0/1481769510 >> 172.21.15.38:0/1481769510 conn(0x7f18dc0bd980 msgr2=0x7f18dc13f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:16.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.382+0000 7f18e08de700 1 -- 172.21.15.38:0/1481769510 shutdown_connections 2023-07-11T00:00:16.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.382+0000 7f18e08de700 1 -- 172.21.15.38:0/1481769510 wait complete. 2023-07-11T00:00:16.387 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-07-11T00:00:16.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-11T00:00:16.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.531+0000 7fb0fcce2700 1 Processor -- start 2023-07-11T00:00:16.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.531+0000 7fb0fcce2700 1 -- start start 2023-07-11T00:00:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.531+0000 7fb0fcce2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb0f81449d0 0x7fb0f814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.531+0000 7fb0fcce2700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0f80b8d90 0x7fb0f806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:16.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0fcce2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f80b8620 con 0x7fb0f80bc810 2023-07-11T00:00:16.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0fcce2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f80b97a0 con 0x7fb0f81449d0 2023-07-11T00:00:16.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0fcce2700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f8144da0 con 0x7fb0f80b8d90 2023-07-11T00:00:16.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb0f81449d0 0x7fb0f814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:16.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f5d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb0f80bc810 0x7fb0f80ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53732/0 (socket says 172.21.15.38:53732) 2023-07-11T00:00:16.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f5d9b700 1 -- 172.21.15.38:0/2496324565 learned_addr learned my addr 172.21.15.38:0/2496324565 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:16.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f6d9d700 1 --2- 172.21.15.38:0/2496324565 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0f80b8d90 0x7fb0f806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:16.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f659c700 1 -- 172.21.15.38:0/2496324565 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0f80b8d90 msgr2=0x7fb0f806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:16.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f659c700 1 --2- 172.21.15.38:0/2496324565 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0f80b8d90 0x7fb0f806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:16.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f659c700 1 -- 172.21.15.38:0/2496324565 >> v1:172.21.15.38:6789/0 conn(0x7fb0f80bc810 legacy=0x7fb0f80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:16.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f559a700 1 -- 172.21.15.38:0/2496324565 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591401154 0 0) 0x7fb0f80b8620 con 0x7fb0f80bc810 2023-07-11T00:00:16.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f659c700 1 -- 172.21.15.38:0/2496324565 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80b8900 con 0x7fb0f81449d0 2023-07-11T00:00:16.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f659c700 1 --2- 172.21.15.38:0/2496324565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0f81449d0 0x7fb0f814db50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009840 tx=0x7fb0e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25765e816693fe03 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:16.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f559a700 1 -- 172.21.15.38:0/2496324565 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8011830 con 0x7fb0f81449d0 2023-07-11T00:00:16.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f559a700 1 -- 172.21.15.38:0/2496324565 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e8011990 con 0x7fb0f81449d0 2023-07-11T00:00:16.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.532+0000 7fb0f559a700 1 -- 172.21.15.38:0/2496324565 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8011d20 con 0x7fb0f81449d0 2023-07-11T00:00:16.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.533+0000 7fb0fcce2700 1 -- 172.21.15.38:0/2496324565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0f81449d0 msgr2=0x7fb0f814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:16.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.533+0000 7fb0fcce2700 1 --2- 172.21.15.38:0/2496324565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0f81449d0 0x7fb0f814db50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009840 tx=0x7fb0e8009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:16.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.533+0000 7fb0fcce2700 1 -- 172.21.15.38:0/2496324565 shutdown_connections 2023-07-11T00:00:16.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.533+0000 7fb0fcce2700 1 --2- 172.21.15.38:0/2496324565 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0f80b8d90 0x7fb0f806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:16.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.533+0000 7fb0fcce2700 1 --2- 172.21.15.38:0/2496324565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0f81449d0 0x7fb0f814db50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:16.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.533+0000 7fb0fcce2700 1 -- 172.21.15.38:0/2496324565 >> 172.21.15.38:0/2496324565 conn(0x7fb0f80c0860 msgr2=0x7fb0f80c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:16.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.533+0000 7fb0fcce2700 1 -- 172.21.15.38:0/2496324565 shutdown_connections 2023-07-11T00:00:16.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.533+0000 7fb0fcce2700 1 -- 172.21.15.38:0/2496324565 wait complete. 2023-07-11T00:00:16.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.534+0000 7fb0fcce2700 1 Processor -- start 2023-07-11T00:00:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.534+0000 7fb0fcce2700 1 -- start start 2023-07-11T00:00:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0fcce2700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0f80b8d90 0x7fb0f814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0fcce2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f80bc810 0x7fb0f81e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0fcce2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0f81449d0 0x7fb0f81e3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0fcce2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f814d130 con 0x7fb0f81449d0 2023-07-11T00:00:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0fcce2700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f80b45d0 con 0x7fb0f80bc810 2023-07-11T00:00:16.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0fcce2700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f80b3ca0 con 0x7fb0f80b8d90 2023-07-11T00:00:16.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0f81449d0 0x7fb0f81e3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:16.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0f81449d0 0x7fb0f81e3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49302/0 (socket says 172.21.15.38:49302) 2023-07-11T00:00:16.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f6d9d700 1 -- 172.21.15.38:0/1945880748 learned_addr learned my addr 172.21.15.38:0/1945880748 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:16.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f659c700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0f80b8d90 0x7fb0f814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:16.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f5d9b700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f80bc810 0x7fb0f81e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f6d9d700 1 -- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0f80b8d90 msgr2=0x7fb0f814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f6d9d700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0f80b8d90 0x7fb0f814cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f6d9d700 1 -- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f80bc810 msgr2=0x7fb0f81e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f6d9d700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f80bc810 0x7fb0f81e2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f6d9d700 1 -- 172.21.15.38:0/1945880748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80094a0 con 0x7fb0f81449d0 2023-07-11T00:00:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f659c700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0f80b8d90 0x7fb0f814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:16.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f5d9b700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f80bc810 0x7fb0f81e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:16.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.535+0000 7fb0f6d9d700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0f81449d0 0x7fb0f81e3250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0007e40 tx=0x7fb0f000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:16.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.536+0000 7fb0e6ffd700 1 -- 172.21.15.38:0/1945880748 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f000eea0 con 0x7fb0f81449d0 2023-07-11T00:00:16.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.536+0000 7fb0e6ffd700 1 -- 172.21.15.38:0/1945880748 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f0014420 con 0x7fb0f81449d0 2023-07-11T00:00:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.536+0000 7fb0e6ffd700 1 -- 172.21.15.38:0/1945880748 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00147b0 con 0x7fb0f81449d0 2023-07-11T00:00:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.536+0000 7fb0fcce2700 1 -- 172.21.15.38:0/1945880748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f80b3f80 con 0x7fb0f81449d0 2023-07-11T00:00:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.536+0000 7fb0fcce2700 1 -- 172.21.15.38:0/1945880748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f80ba990 con 0x7fb0f81449d0 2023-07-11T00:00:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.537+0000 7fb0fcce2700 1 -- 172.21.15.38:0/1945880748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f8074360 con 0x7fb0f81449d0 2023-07-11T00:00:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.537+0000 7fb0e6ffd700 1 -- 172.21.15.38:0/1945880748 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb0f0014910 con 0x7fb0f81449d0 2023-07-11T00:00:16.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.537+0000 7fb0e6ffd700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb0d806ace0 0x7fb0d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:16.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.538+0000 7fb0e6ffd700 1 -- 172.21.15.38:0/1945880748 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fb0f0089bd0 con 0x7fb0f81449d0 2023-07-11T00:00:16.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.538+0000 7fb0f659c700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb0d806ace0 0x7fb0d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:16.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.538+0000 7fb0f659c700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb0d806ace0 0x7fb0d806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80090b0 tx=0x7fb0e801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:16.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.542+0000 7fb0e6ffd700 1 -- 172.21.15.38:0/1945880748 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb0f0054d70 con 0x7fb0f81449d0 2023-07-11T00:00:16.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:16.786+0000 7fb0fcce2700 1 -- 172.21.15.38:0/1945880748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb0f81436c0 con 0x7fb0f81449d0 2023-07-11T00:00:17.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.377+0000 7fb0e6ffd700 1 -- 172.21.15.38:0/1945880748 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb0f0058390 con 0x7fb0f81449d0 2023-07-11T00:00:17.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.383+0000 7fb0fcce2700 1 -- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb0d806ace0 msgr2=0x7fb0d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.383+0000 7fb0fcce2700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb0d806ace0 0x7fb0d806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80090b0 tx=0x7fb0e801c040 comp rx=0 tx=0).stop 2023-07-11T00:00:17.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.383+0000 7fb0fcce2700 1 -- 172.21.15.38:0/1945880748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0f81449d0 msgr2=0x7fb0f81e3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.383+0000 7fb0fcce2700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0f81449d0 0x7fb0f81e3250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0007e40 tx=0x7fb0f000e3c0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.392+0000 7fb0fcce2700 1 -- 172.21.15.38:0/1945880748 shutdown_connections 2023-07-11T00:00:17.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.392+0000 7fb0fcce2700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb0d806ace0 0x7fb0d806d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.392+0000 7fb0fcce2700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0f81449d0 0x7fb0f81e3250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.392+0000 7fb0fcce2700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0f80b8d90 0x7fb0f814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.392+0000 7fb0fcce2700 1 --2- 172.21.15.38:0/1945880748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f80bc810 0x7fb0f81e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.392+0000 7fb0fcce2700 1 -- 172.21.15.38:0/1945880748 >> 172.21.15.38:0/1945880748 conn(0x7fb0f80c0860 msgr2=0x7fb0f8143ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:17.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.394+0000 7fb0fcce2700 1 -- 172.21.15.38:0/1945880748 shutdown_connections 2023-07-11T00:00:17.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.394+0000 7fb0fcce2700 1 -- 172.21.15.38:0/1945880748 wait complete. 2023-07-11T00:00:17.400 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 3 and data pool 4 2023-07-11T00:00:17.415 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:17.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.543+0000 7fd21bf8b700 1 Processor -- start 2023-07-11T00:00:17.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.544+0000 7fd21bf8b700 1 -- start start 2023-07-11T00:00:17.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.544+0000 7fd21bf8b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2140b8d90 0x7fd21406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.544+0000 7fd21bf8b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2140b8620 con 0x7fd2141449d0 2023-07-11T00:00:17.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.544+0000 7fd21bf8b700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2140b8900 con 0x7fd2140bc810 2023-07-11T00:00:17.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.544+0000 7fd21bf8b700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b97a0 con 0x7fd2140b8d90 2023-07-11T00:00:17.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.544+0000 7fd219d27700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd2141449d0 0x7fd21414db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53738/0 (socket says 172.21.15.38:53738) 2023-07-11T00:00:17.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.544+0000 7fd219d27700 1 -- 172.21.15.38:0/357754977 learned_addr learned my addr 172.21.15.38:0/357754977 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:17.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.544+0000 7fd21a528700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2140b8d90 0x7fd21406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612684336 0 0) 0x7fd2140b8620 con 0x7fd2141449d0 2023-07-11T00:00:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2000035b0 con 0x7fd2141449d0 2023-07-11T00:00:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3334743111 0 0) 0x7fd2000035b0 con 0x7fd2141449d0 2023-07-11T00:00:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2140b8d90 msgr2=0x7fd21406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2140b8d90 0x7fd21406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 >> v1:172.21.15.70:6789/0 conn(0x7fd2140bc810 legacy=0x7fd2140ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2140bac40 con 0x7fd2141449d0 2023-07-11T00:00:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7fd2100019f0 con 0x7fd2141449d0 2023-07-11T00:00:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd21a528700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2140b8d90 0x7fd21406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 >> v1:172.21.15.38:6789/0 conn(0x7fd2141449d0 legacy=0x7fd21414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd200003a30 0x7fd200003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd200004850 0x7fd200004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2140b8d90 0x7fd200005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b97a0 con 0x7fd200004850 2023-07-11T00:00:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20000bb80 con 0x7fd200003a30 2023-07-11T00:00:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20000bd40 con 0x7fd2140b8d90 2023-07-11T00:00:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd219526700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd200004850 0x7fd200004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd219d27700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd200003a30 0x7fd200003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd21a528700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2140b8d90 0x7fd200005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd219526700 1 -- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2140b8d90 msgr2=0x7fd200005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd219526700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2140b8d90 0x7fd200005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd219526700 1 -- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd200003a30 msgr2=0x7fd200003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd219526700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd200003a30 0x7fd200003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.545+0000 7fd219526700 1 -- 172.21.15.38:0/357754977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000035b0 con 0x7fd200004850 2023-07-11T00:00:17.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.546+0000 7fd219526700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd200004850 0x7fd200004cc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd204001800 tx=0x7fd200005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248ff8463daa3f09 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:17.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.546+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040012f0 con 0x7fd200004850 2023-07-11T00:00:17.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.546+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2040052f0 con 0x7fd200004850 2023-07-11T00:00:17.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.546+0000 7fd218d25700 1 -- 172.21.15.38:0/357754977 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204006860 con 0x7fd200004850 2023-07-11T00:00:17.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.546+0000 7fd21bf8b700 1 -- 172.21.15.38:0/357754977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd200004850 msgr2=0x7fd200004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.546+0000 7fd21bf8b700 1 --2- 172.21.15.38:0/357754977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd200004850 0x7fd200004cc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd204001800 tx=0x7fd200005880 comp rx=0 tx=0).stop 2023-07-11T00:00:17.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.546+0000 7fd21a528700 1 -- 172.21.15.38:0/357754977 reap_dead start 2023-07-11T00:00:17.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.546+0000 7fd21bf8b700 1 -- 172.21.15.38:0/357754977 shutdown_connections 2023-07-11T00:00:17.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.546+0000 7fd21bf8b700 1 -- 172.21.15.38:0/357754977 >> 172.21.15.38:0/357754977 conn(0x7fd2140c0860 msgr2=0x7fd2140c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:17.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.546+0000 7fd21bf8b700 1 -- 172.21.15.38:0/357754977 shutdown_connections 2023-07-11T00:00:17.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.546+0000 7fd21bf8b700 1 -- 172.21.15.38:0/357754977 wait complete. 2023-07-11T00:00:17.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.547+0000 7fd21bf8b700 1 Processor -- start 2023-07-11T00:00:17.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.547+0000 7fd21bf8b700 1 -- start start 2023-07-11T00:00:17.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21bf8b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd200004850 0x7fd2140b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21bf8b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2140b2d40 0x7fd2141483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21bf8b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2140b3620 0x7fd2140b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21bf8b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b2920 con 0x7fd2140b3620 2023-07-11T00:00:17.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21bf8b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b1b90 con 0x7fd2140b2d40 2023-07-11T00:00:17.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21bf8b700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21414ade0 con 0x7fd200004850 2023-07-11T00:00:17.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21a528700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2140b3620 0x7fd2140b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21a528700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2140b3620 0x7fd2140b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49328/0 (socket says 172.21.15.38:49328) 2023-07-11T00:00:17.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21a528700 1 -- 172.21.15.38:0/3951568585 learned_addr learned my addr 172.21.15.38:0/3951568585 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:17.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd219d27700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd200004850 0x7fd2140b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd219526700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2140b2d40 0x7fd2141483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21a528700 1 -- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd200004850 msgr2=0x7fd2140b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21a528700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd200004850 0x7fd2140b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21a528700 1 -- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2140b2d40 msgr2=0x7fd2141483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21a528700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2140b2d40 0x7fd2141483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.548+0000 7fd21a528700 1 -- 172.21.15.38:0/3951568585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21414b030 con 0x7fd2140b3620 2023-07-11T00:00:17.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.549+0000 7fd21a528700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2140b3620 0x7fd2140b3a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd2000047d0 tx=0x7fd20c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:17.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.549+0000 7fd20a7fc700 1 -- 172.21.15.38:0/3951568585 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c009ea0 con 0x7fd2140b3620 2023-07-11T00:00:17.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.549+0000 7fd20a7fc700 1 -- 172.21.15.38:0/3951568585 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c014610 con 0x7fd2140b3620 2023-07-11T00:00:17.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.549+0000 7fd21bf8b700 1 -- 172.21.15.38:0/3951568585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2140b40c0 con 0x7fd2140b3620 2023-07-11T00:00:17.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.549+0000 7fd20a7fc700 1 -- 172.21.15.38:0/3951568585 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c014a00 con 0x7fd2140b3620 2023-07-11T00:00:17.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.549+0000 7fd21bf8b700 1 -- 172.21.15.38:0/3951568585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2140b2540 con 0x7fd2140b3620 2023-07-11T00:00:17.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.550+0000 7fd21bf8b700 1 -- 172.21.15.38:0/3951568585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2140b2a60 con 0x7fd2140b3620 2023-07-11T00:00:17.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.550+0000 7fd20a7fc700 1 -- 172.21.15.38:0/3951568585 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd20c014b60 con 0x7fd2140b3620 2023-07-11T00:00:17.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.551+0000 7fd20a7fc700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd1f806ace0 0x7fd1f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.551+0000 7fd20a7fc700 1 -- 172.21.15.38:0/3951568585 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd20c0893d0 con 0x7fd2140b3620 2023-07-11T00:00:17.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.551+0000 7fd219d27700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd1f806ace0 0x7fd1f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.551+0000 7fd219d27700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd1f806ace0 0x7fd1f806d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd210007280 tx=0x7fd210006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:17.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.555+0000 7fd20a7fc700 1 -- 172.21.15.38:0/3951568585 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd2140b2a60 con 0x7fd2140b3620 2023-07-11T00:00:17.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.752+0000 7fd21bf8b700 1 -- 172.21.15.38:0/3951568585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2140b2a60 con 0x7fd2140b3620 2023-07-11T00:00:17.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.754+0000 7fd20a7fc700 1 -- 172.21.15.38:0/3951568585 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18174 (secure 0 0 0) 0x7fd2140b2a60 con 0x7fd2140b3620 2023-07-11T00:00:17.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:17.756 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:16.787457+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:17.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 -- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd1f806ace0 msgr2=0x7fd1f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd1f806ace0 0x7fd1f806d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd210007280 tx=0x7fd210006040 comp rx=0 tx=0).stop 2023-07-11T00:00:17.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 -- 172.21.15.38:0/3951568585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2140b3620 msgr2=0x7fd2140b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2140b3620 0x7fd2140b3a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd2000047d0 tx=0x7fd20c009860 comp rx=0 tx=0).stop 2023-07-11T00:00:17.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 -- 172.21.15.38:0/3951568585 shutdown_connections 2023-07-11T00:00:17.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd1f806ace0 0x7fd1f806d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2140b3620 0x7fd2140b3a70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd200004850 0x7fd2140b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 --2- 172.21.15.38:0/3951568585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2140b2d40 0x7fd2141483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 -- 172.21.15.38:0/3951568585 >> 172.21.15.38:0/3951568585 conn(0x7fd2140c0860 msgr2=0x7fd2140baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:17.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 -- 172.21.15.38:0/3951568585 shutdown_connections 2023-07-11T00:00:17.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.756+0000 7fd21bf8b700 1 -- 172.21.15.38:0/3951568585 wait complete. 2023-07-11T00:00:17.770 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.896+0000 7f958fe23700 1 Processor -- start 2023-07-11T00:00:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.896+0000 7f958fe23700 1 -- start start 2023-07-11T00:00:17.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958fe23700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958806b120 0x7f958806edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958fe23700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f958806f340 0x7f9588146b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958fe23700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95880b93e0 con 0x7f9588071ab0 2023-07-11T00:00:17.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958fe23700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9588071690 con 0x7f958806f340 2023-07-11T00:00:17.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958fe23700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958806fe90 con 0x7f958806b120 2023-07-11T00:00:17.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958e3c0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f958806f340 0x7f9588146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958e3c0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f958806f340 0x7f9588146b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49342/0 (socket says 172.21.15.38:49342) 2023-07-11T00:00:17.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958e3c0700 1 -- 172.21.15.38:0/871848063 learned_addr learned my addr 172.21.15.38:0/871848063 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:17.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958dbbf700 1 --2- 172.21.15.38:0/871848063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958806b120 0x7f958806edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958e3c0700 1 -- 172.21.15.38:0/871848063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958806b120 msgr2=0x7f958806edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:17.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958e3c0700 1 --2- 172.21.15.38:0/871848063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958806b120 0x7f958806edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958e3c0700 1 -- 172.21.15.38:0/871848063 >> v1:172.21.15.70:6789/0 conn(0x7f9588071ab0 legacy=0x7f9588140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.897+0000 7f958e3c0700 1 -- 172.21.15.38:0/871848063 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9588147060 con 0x7f958806f340 2023-07-11T00:00:17.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958e3c0700 1 --2- 172.21.15.38:0/871848063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f958806f340 0x7f9588146b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f958000d150 tx=0x7f958000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ed46c257cf1490 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:17.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958cbbd700 1 -- 172.21.15.38:0/871848063 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580010070 con 0x7f958806f340 2023-07-11T00:00:17.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958cbbd700 1 -- 172.21.15.38:0/871848063 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958000dd10 con 0x7f958806f340 2023-07-11T00:00:17.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958cbbd700 1 -- 172.21.15.38:0/871848063 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958000b310 con 0x7f958806f340 2023-07-11T00:00:17.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958fe23700 1 -- 172.21.15.38:0/871848063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f958806f340 msgr2=0x7f9588146b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958fe23700 1 --2- 172.21.15.38:0/871848063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f958806f340 0x7f9588146b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f958000d150 tx=0x7f958000d460 comp rx=0 tx=0).stop 2023-07-11T00:00:17.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958fe23700 1 -- 172.21.15.38:0/871848063 shutdown_connections 2023-07-11T00:00:17.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958fe23700 1 --2- 172.21.15.38:0/871848063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f958806f340 0x7f9588146b20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958fe23700 1 --2- 172.21.15.38:0/871848063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958806b120 0x7f958806edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958fe23700 1 -- 172.21.15.38:0/871848063 >> 172.21.15.38:0/871848063 conn(0x7f95880bd980 msgr2=0x7f95880b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:17.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958fe23700 1 -- 172.21.15.38:0/871848063 shutdown_connections 2023-07-11T00:00:17.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.898+0000 7f958fe23700 1 -- 172.21.15.38:0/871848063 wait complete. 2023-07-11T00:00:17.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.899+0000 7f958fe23700 1 Processor -- start 2023-07-11T00:00:17.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958fe23700 1 -- start start 2023-07-11T00:00:17.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958fe23700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958806b120 0x7f9588143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958fe23700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958806f340 0x7f9588144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958fe23700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9588071ab0 0x7f9588141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958fe23700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9588145090 con 0x7f9588071ab0 2023-07-11T00:00:17.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958fe23700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9588142b00 con 0x7f958806b120 2023-07-11T00:00:17.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958fe23700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95880b6d10 con 0x7f958806f340 2023-07-11T00:00:17.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958e3c0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9588071ab0 0x7f9588141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958e3c0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9588071ab0 0x7f9588141420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49354/0 (socket says 172.21.15.38:49354) 2023-07-11T00:00:17.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958e3c0700 1 -- 172.21.15.38:0/3803316908 learned_addr learned my addr 172.21.15.38:0/3803316908 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:17.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958dbbf700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958806b120 0x7f9588143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.900+0000 7f958d3be700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958806f340 0x7f9588144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.901+0000 7f958e3c0700 1 -- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958806f340 msgr2=0x7f9588144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.901+0000 7f958e3c0700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958806f340 0x7f9588144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.901+0000 7f958e3c0700 1 -- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958806b120 msgr2=0x7f9588143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:17.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.901+0000 7f958e3c0700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958806b120 0x7f9588143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:17.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.901+0000 7f958e3c0700 1 -- 172.21.15.38:0/3803316908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958000bd40 con 0x7f9588071ab0 2023-07-11T00:00:17.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.901+0000 7f958e3c0700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9588071ab0 0x7f9588141420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f958000d4a0 tx=0x7f9580004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:17.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.901+0000 7f957e7fc700 1 -- 172.21.15.38:0/3803316908 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580009a10 con 0x7f9588071ab0 2023-07-11T00:00:17.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.901+0000 7f957e7fc700 1 -- 172.21.15.38:0/3803316908 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9580009b70 con 0x7f9588071ab0 2023-07-11T00:00:17.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.901+0000 7f958fe23700 1 -- 172.21.15.38:0/3803316908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95880b33a0 con 0x7f9588071ab0 2023-07-11T00:00:17.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.901+0000 7f957e7fc700 1 -- 172.21.15.38:0/3803316908 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958000b4c0 con 0x7f9588071ab0 2023-07-11T00:00:17.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.901+0000 7f958fe23700 1 -- 172.21.15.38:0/3803316908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9588142840 con 0x7f9588071ab0 2023-07-11T00:00:17.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.902+0000 7f958fe23700 1 -- 172.21.15.38:0/3803316908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9588142f90 con 0x7f9588071ab0 2023-07-11T00:00:17.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.902+0000 7f957e7fc700 1 -- 172.21.15.38:0/3803316908 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9580004040 con 0x7f9588071ab0 2023-07-11T00:00:17.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.903+0000 7f957e7fc700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956c06ace0 0x7f956c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:17.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.903+0000 7f957e7fc700 1 -- 172.21.15.38:0/3803316908 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f958008a940 con 0x7f9588071ab0 2023-07-11T00:00:17.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.903+0000 7f958dbbf700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956c06ace0 0x7f956c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:17.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.903+0000 7f958dbbf700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956c06ace0 0x7f956c06d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9584009be0 tx=0x7f9584009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:17.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:17.907+0000 7f957e7fc700 1 -- 172.21.15.38:0/3803316908 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9588142f90 con 0x7f9588071ab0 2023-07-11T00:00:18.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.102+0000 7f958fe23700 1 -- 172.21.15.38:0/3803316908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9588142f90 con 0x7f9588071ab0 2023-07-11T00:00:18.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.104+0000 7f957e7fc700 1 -- 172.21.15.38:0/3803316908 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18174 (secure 0 0 0) 0x7f9588142f90 con 0x7f9588071ab0 2023-07-11T00:00:18.106 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:18.106 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:16.787457+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:18.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 -- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956c06ace0 msgr2=0x7f956c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:18.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956c06ace0 0x7f956c06d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9584009be0 tx=0x7f9584009210 comp rx=0 tx=0).stop 2023-07-11T00:00:18.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 -- 172.21.15.38:0/3803316908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9588071ab0 msgr2=0x7f9588141420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:18.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9588071ab0 0x7f9588141420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f958000d4a0 tx=0x7f9580004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:18.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 -- 172.21.15.38:0/3803316908 shutdown_connections 2023-07-11T00:00:18.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956c06ace0 0x7f956c06d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:18.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9588071ab0 0x7f9588141420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:18.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958806b120 0x7f9588143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:18.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 --2- 172.21.15.38:0/3803316908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958806f340 0x7f9588144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:18.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 -- 172.21.15.38:0/3803316908 >> 172.21.15.38:0/3803316908 conn(0x7f95880bd980 msgr2=0x7f958813f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:18.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 -- 172.21.15.38:0/3803316908 shutdown_connections 2023-07-11T00:00:18.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.106+0000 7f958fe23700 1 -- 172.21.15.38:0/3803316908 wait complete. 2023-07-11T00:00:18.121 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-11T00:00:18.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.248+0000 7fcc85da0700 1 Processor -- start 2023-07-11T00:00:18.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.248+0000 7fcc85da0700 1 -- start start 2023-07-11T00:00:18.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.249+0000 7fcc85da0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcc8006b120 0x7fcc800b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:18.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.249+0000 7fcc85da0700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcc801444c0 0x7fcc801448e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:18.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.249+0000 7fcc85da0700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc80070410 con 0x7fcc8014aa40 2023-07-11T00:00:18.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.249+0000 7fcc85da0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800b9590 con 0x7fcc8006b120 2023-07-11T00:00:18.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.249+0000 7fcc85da0700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8006ef60 con 0x7fcc801444c0 2023-07-11T00:00:18.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.249+0000 7fcc7f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcc8006b120 0x7fcc800b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:18.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.249+0000 7fcc7f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcc8006b120 0x7fcc800b8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49366/0 (socket says 172.21.15.38:49366) 2023-07-11T00:00:18.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.249+0000 7fcc7f7fe700 1 -- 172.21.15.38:0/74030773 learned_addr learned my addr 172.21.15.38:0/74030773 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:18.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.249+0000 7fcc7ffff700 1 --2- 172.21.15.38:0/74030773 >> v2:172.21.15.70:3300/0 conn(0x7fcc801444c0 0x7fcc801448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:18.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc7f7fe700 1 -- 172.21.15.38:0/74030773 >> v2:172.21.15.70:3300/0 conn(0x7fcc801444c0 msgr2=0x7fcc801448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:18.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc7f7fe700 1 --2- 172.21.15.38:0/74030773 >> v2:172.21.15.70:3300/0 conn(0x7fcc801444c0 0x7fcc801448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:18.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc7f7fe700 1 -- 172.21.15.38:0/74030773 >> v1:172.21.15.70:6789/0 conn(0x7fcc8014aa40 legacy=0x7fcc8014aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:18.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc7f7fe700 1 -- 172.21.15.38:0/74030773 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8006f240 con 0x7fcc8006b120 2023-07-11T00:00:18.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc7ffff700 1 --2- 172.21.15.38:0/74030773 >> v2:172.21.15.70:3300/0 conn(0x7fcc801444c0 0x7fcc801448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:18.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc7f7fe700 1 --2- 172.21.15.38:0/74030773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc8006b120 0x7fcc800b8cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc80067370 tx=0x7fcc70009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfe9be2eb5efa7b server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:18.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc7effd700 1 -- 172.21.15.38:0/74030773 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000b870 con 0x7fcc8006b120 2023-07-11T00:00:18.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc7effd700 1 -- 172.21.15.38:0/74030773 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7000b9d0 con 0x7fcc8006b120 2023-07-11T00:00:18.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc7effd700 1 -- 172.21.15.38:0/74030773 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000bd60 con 0x7fcc8006b120 2023-07-11T00:00:18.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc85da0700 1 -- 172.21.15.38:0/74030773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc8006b120 msgr2=0x7fcc800b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:18.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc85da0700 1 --2- 172.21.15.38:0/74030773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc8006b120 0x7fcc800b8cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc80067370 tx=0x7fcc70009bd0 comp rx=0 tx=0).stop 2023-07-11T00:00:18.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc85da0700 1 -- 172.21.15.38:0/74030773 shutdown_connections 2023-07-11T00:00:18.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc85da0700 1 --2- 172.21.15.38:0/74030773 >> v2:172.21.15.70:3300/0 conn(0x7fcc801444c0 0x7fcc801448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:18.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.250+0000 7fcc85da0700 1 --2- 172.21.15.38:0/74030773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc8006b120 0x7fcc800b8cd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:18.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.251+0000 7fcc85da0700 1 -- 172.21.15.38:0/74030773 >> 172.21.15.38:0/74030773 conn(0x7fcc800bd980 msgr2=0x7fcc800b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:18.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.251+0000 7fcc85da0700 1 -- 172.21.15.38:0/74030773 shutdown_connections 2023-07-11T00:00:18.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.251+0000 7fcc85da0700 1 -- 172.21.15.38:0/74030773 wait complete. 2023-07-11T00:00:18.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc85da0700 1 Processor -- start 2023-07-11T00:00:18.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc85da0700 1 -- start start 2023-07-11T00:00:18.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc85da0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc8006b120 0x7fcc8014d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:18.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc85da0700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc801444c0 0x7fcc8014cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:18.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc85da0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc8014aa40 0x7fcc801e3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:18.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc85da0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8014df20 con 0x7fcc8006b120 2023-07-11T00:00:18.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc85da0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8014c2d0 con 0x7fcc8014aa40 2023-07-11T00:00:18.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc85da0700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc801459b0 con 0x7fcc801444c0 2023-07-11T00:00:18.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc7f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc8006b120 0x7fcc8014d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:18.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc7f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc8006b120 0x7fcc8014d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49376/0 (socket says 172.21.15.38:49376) 2023-07-11T00:00:18.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc7f7fe700 1 -- 172.21.15.38:0/4200383715 learned_addr learned my addr 172.21.15.38:0/4200383715 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:18.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.252+0000 7fcc77fff700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc801444c0 0x7fcc8014cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:18.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc7ffff700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc8014aa40 0x7fcc801e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:18.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc7f7fe700 1 -- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc801444c0 msgr2=0x7fcc8014cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:18.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc7f7fe700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc801444c0 0x7fcc8014cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:18.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc7f7fe700 1 -- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc8014aa40 msgr2=0x7fcc801e3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:18.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc7f7fe700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc8014aa40 0x7fcc801e3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:18.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc7f7fe700 1 -- 172.21.15.38:0/4200383715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc70009550 con 0x7fcc8006b120 2023-07-11T00:00:18.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc7f7fe700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc8006b120 0x7fcc8014d9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc70000c00 tx=0x7fcc70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:18.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc7cff9700 1 -- 172.21.15.38:0/4200383715 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70004540 con 0x7fcc8006b120 2023-07-11T00:00:18.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc7cff9700 1 -- 172.21.15.38:0/4200383715 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc700036a0 con 0x7fcc8006b120 2023-07-11T00:00:18.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc85da0700 1 -- 172.21.15.38:0/4200383715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc80147fa0 con 0x7fcc8006b120 2023-07-11T00:00:18.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc7cff9700 1 -- 172.21.15.38:0/4200383715 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70003a30 con 0x7fcc8006b120 2023-07-11T00:00:18.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.253+0000 7fcc85da0700 1 -- 172.21.15.38:0/4200383715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc80145c20 con 0x7fcc8006b120 2023-07-11T00:00:18.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.254+0000 7fcc85da0700 1 -- 172.21.15.38:0/4200383715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8014c830 con 0x7fcc8006b120 2023-07-11T00:00:18.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.254+0000 7fcc7cff9700 1 -- 172.21.15.38:0/4200383715 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc70021070 con 0x7fcc8006b120 2023-07-11T00:00:18.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.255+0000 7fcc7cff9700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcc6006ace0 0x7fcc6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:18.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.255+0000 7fcc7cff9700 1 -- 172.21.15.38:0/4200383715 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcc7008abc0 con 0x7fcc8006b120 2023-07-11T00:00:18.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.255+0000 7fcc77fff700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcc6006ace0 0x7fcc6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:18.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.255+0000 7fcc77fff700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcc6006ace0 0x7fcc6006d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc68000f60 tx=0x7fcc68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:18.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.259+0000 7fcc7cff9700 1 -- 172.21.15.38:0/4200383715 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fcc70055d00 con 0x7fcc8006b120 2023-07-11T00:00:18.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:18.499+0000 7fcc85da0700 1 -- 172.21.15.38:0/4200383715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcc8014cb30 con 0x7fcc8006b120 2023-07-11T00:00:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.398+0000 7fcc7cff9700 1 -- 172.21.15.38:0/4200383715 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcc70059320 con 0x7fcc8006b120 2023-07-11T00:00:19.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 -- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcc6006ace0 msgr2=0x7fcc6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcc6006ace0 0x7fcc6006d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc68000f60 tx=0x7fcc68009040 comp rx=0 tx=0).stop 2023-07-11T00:00:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 -- 172.21.15.38:0/4200383715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc8006b120 msgr2=0x7fcc8014d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc8006b120 0x7fcc8014d9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc70000c00 tx=0x7fcc70004750 comp rx=0 tx=0).stop 2023-07-11T00:00:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 -- 172.21.15.38:0/4200383715 shutdown_connections 2023-07-11T00:00:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcc6006ace0 0x7fcc6006d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc8014aa40 0x7fcc801e3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc8006b120 0x7fcc8014d9e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 --2- 172.21.15.38:0/4200383715 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc801444c0 0x7fcc8014cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 -- 172.21.15.38:0/4200383715 >> 172.21.15.38:0/4200383715 conn(0x7fcc800bd980 msgr2=0x7fcc800babf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 -- 172.21.15.38:0/4200383715 shutdown_connections 2023-07-11T00:00:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.401+0000 7fcc85da0700 1 -- 172.21.15.38:0/4200383715 wait complete. 2023-07-11T00:00:19.417 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-11T00:00:19.418 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-11T00:00:19.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.551+0000 7f03f6a8b700 1 Processor -- start 2023-07-11T00:00:19.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.551+0000 7f03f6a8b700 1 -- start start 2023-07-11T00:00:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03f6a8b700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03f00b8d90 0x7f03f006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03f6a8b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00b8620 con 0x7f03f01449d0 2023-07-11T00:00:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03f6a8b700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00b8900 con 0x7f03f00bc810 2023-07-11T00:00:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03f6a8b700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00b97a0 con 0x7f03f00b8d90 2023-07-11T00:00:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03f4827700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f03f01449d0 0x7f03f014db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53748/0 (socket says 172.21.15.38:53748) 2023-07-11T00:00:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03f4827700 1 -- 172.21.15.38:0/1639125800 learned_addr learned my addr 172.21.15.38:0/1639125800 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03f5028700 1 --2- 172.21.15.38:0/1639125800 >> v2:172.21.15.70:3300/0 conn(0x7f03f00b8d90 0x7f03f006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03ef7fe700 1 -- 172.21.15.38:0/1639125800 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366394567 0 0) 0x7f03f00b8620 con 0x7f03f01449d0 2023-07-11T00:00:19.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03ef7fe700 1 -- 172.21.15.38:0/1639125800 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03e00035b0 con 0x7f03f01449d0 2023-07-11T00:00:19.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03ef7fe700 1 -- 172.21.15.38:0/1639125800 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2485459612 0 0) 0x7f03e00035b0 con 0x7f03f01449d0 2023-07-11T00:00:19.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03f5028700 1 -- 172.21.15.38:0/1639125800 >> v1:172.21.15.70:6789/0 conn(0x7f03f00bc810 legacy=0x7f03f00ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:19.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03f5028700 1 -- 172.21.15.38:0/1639125800 >> v1:172.21.15.38:6789/0 conn(0x7f03f01449d0 legacy=0x7f03f014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:19.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03f5028700 1 -- 172.21.15.38:0/1639125800 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00bac40 con 0x7f03f00b8d90 2023-07-11T00:00:19.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.552+0000 7f03f5028700 1 --2- 172.21.15.38:0/1639125800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03f00b8d90 0x7f03f006ade0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009d90 tx=0x7f03e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6f5095d46a25663 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:19.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.553+0000 7f03ef7fe700 1 -- 172.21.15.38:0/1639125800 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e800e070 con 0x7f03f00b8d90 2023-07-11T00:00:19.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.553+0000 7f03ef7fe700 1 -- 172.21.15.38:0/1639125800 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e8003a20 con 0x7f03f00b8d90 2023-07-11T00:00:19.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.553+0000 7f03ef7fe700 1 -- 172.21.15.38:0/1639125800 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4001670 con 0x7f03f00b8d90 2023-07-11T00:00:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.553+0000 7f03f6a8b700 1 -- 172.21.15.38:0/1639125800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03f00b8d90 msgr2=0x7f03f006ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.553+0000 7f03f6a8b700 1 --2- 172.21.15.38:0/1639125800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03f00b8d90 0x7f03f006ade0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009d90 tx=0x7f03e800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.553+0000 7f03f6a8b700 1 -- 172.21.15.38:0/1639125800 shutdown_connections 2023-07-11T00:00:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.553+0000 7f03f6a8b700 1 --2- 172.21.15.38:0/1639125800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03f00b8d90 0x7f03f006ade0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.553+0000 7f03f6a8b700 1 -- 172.21.15.38:0/1639125800 >> 172.21.15.38:0/1639125800 conn(0x7f03f00c0860 msgr2=0x7f03f00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:19.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.553+0000 7f03f6a8b700 1 -- 172.21.15.38:0/1639125800 shutdown_connections 2023-07-11T00:00:19.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.553+0000 7f03f6a8b700 1 -- 172.21.15.38:0/1639125800 wait complete. 2023-07-11T00:00:19.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.554+0000 7f03f6a8b700 1 Processor -- start 2023-07-11T00:00:19.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.554+0000 7f03f6a8b700 1 -- start start 2023-07-11T00:00:19.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f6a8b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f00b8d90 0x7f03f01dff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:19.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f6a8b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03f00bc810 0x7f03f01d6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:19.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f6a8b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03f01449d0 0x7f03f0146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:19.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f6a8b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00a5d80 con 0x7f03f00b8d90 2023-07-11T00:00:19.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f6a8b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00b3670 con 0x7f03f01449d0 2023-07-11T00:00:19.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f6a8b700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f014b200 con 0x7f03f00bc810 2023-07-11T00:00:19.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f4827700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f00b8d90 0x7f03f01dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:19.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f4827700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f00b8d90 0x7f03f01dff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49390/0 (socket says 172.21.15.38:49390) 2023-07-11T00:00:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f4827700 1 -- 172.21.15.38:0/2062390967 learned_addr learned my addr 172.21.15.38:0/2062390967 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f5028700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03f01449d0 0x7f03f0146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03effff700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03f00bc810 0x7f03f01d6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f4827700 1 -- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03f00bc810 msgr2=0x7f03f01d6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f4827700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03f00bc810 0x7f03f01d6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f4827700 1 -- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03f01449d0 msgr2=0x7f03f0146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f4827700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03f01449d0 0x7f03f0146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03f4827700 1 -- 172.21.15.38:0/2062390967 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8009a70 con 0x7f03f00b8d90 2023-07-11T00:00:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.555+0000 7f03effff700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03f00bc810 0x7f03f01d6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.556+0000 7f03f4827700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f00b8d90 0x7f03f01dff00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f03e40011e0 tx=0x7f03e400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.556+0000 7f03ed7fa700 1 -- 172.21.15.38:0/2062390967 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4004c80 con 0x7f03f00b8d90 2023-07-11T00:00:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.556+0000 7f03ed7fa700 1 -- 172.21.15.38:0/2062390967 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e4004e00 con 0x7f03f00b8d90 2023-07-11T00:00:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.556+0000 7f03f6a8b700 1 -- 172.21.15.38:0/2062390967 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f00a5fd0 con 0x7f03f00b8d90 2023-07-11T00:00:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.556+0000 7f03ed7fa700 1 -- 172.21.15.38:0/2062390967 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4007310 con 0x7f03f00b8d90 2023-07-11T00:00:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.556+0000 7f03f6a8b700 1 -- 172.21.15.38:0/2062390967 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f01e0440 con 0x7f03f00b8d90 2023-07-11T00:00:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.557+0000 7f03f6a8b700 1 -- 172.21.15.38:0/2062390967 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f0074360 con 0x7f03f00b8d90 2023-07-11T00:00:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.557+0000 7f03ed7fa700 1 -- 172.21.15.38:0/2062390967 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03e4007470 con 0x7f03f00b8d90 2023-07-11T00:00:19.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.558+0000 7f03ed7fa700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f03d406ace0 0x7f03d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:19.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.558+0000 7f03ed7fa700 1 -- 172.21.15.38:0/2062390967 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03e4089220 con 0x7f03f00b8d90 2023-07-11T00:00:19.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.558+0000 7f03effff700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f03d406ace0 0x7f03d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:19.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.558+0000 7f03effff700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f03d406ace0 0x7f03d406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03f01e44f0 tx=0x7f03dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.562+0000 7f03ed7fa700 1 -- 172.21.15.38:0/2062390967 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f03e40542c0 con 0x7f03f00b8d90 2023-07-11T00:00:19.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:19.805+0000 7f03f6a8b700 1 -- 172.21.15.38:0/2062390967 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f03f00bc330 con 0x7f03f00b8d90 2023-07-11T00:00:20.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.410+0000 7f03ed7fa700 1 -- 172.21.15.38:0/2062390967 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f03e40578e0 con 0x7f03f00b8d90 2023-07-11T00:00:20.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 -- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f03d406ace0 msgr2=0x7f03d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f03d406ace0 0x7f03d406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03f01e44f0 tx=0x7f03dc009040 comp rx=0 tx=0).stop 2023-07-11T00:00:20.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 -- 172.21.15.38:0/2062390967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f00b8d90 msgr2=0x7f03f01dff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f00b8d90 0x7f03f01dff00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f03e40011e0 tx=0x7f03e400c9e0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 -- 172.21.15.38:0/2062390967 shutdown_connections 2023-07-11T00:00:20.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f03d406ace0 0x7f03d406d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03f01449d0 0x7f03f0146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f00b8d90 0x7f03f01dff00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 --2- 172.21.15.38:0/2062390967 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03f00bc810 0x7f03f01d6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 -- 172.21.15.38:0/2062390967 >> 172.21.15.38:0/2062390967 conn(0x7f03f00c0860 msgr2=0x7f03f00baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:20.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 -- 172.21.15.38:0/2062390967 shutdown_connections 2023-07-11T00:00:20.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.413+0000 7f03f6a8b700 1 -- 172.21.15.38:0/2062390967 wait complete. 2023-07-11T00:00:20.430 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-11T00:00:20.430 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:00:20.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.561+0000 7fdc5bb20700 1 Processor -- start 2023-07-11T00:00:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.561+0000 7fdc5bb20700 1 -- start start 2023-07-11T00:00:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.561+0000 7fdc5bb20700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdc541449d0 0x7fdc5414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.561+0000 7fdc5bb20700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540bc810 0x7fdc540ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc5bb20700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc540b8620 con 0x7fdc540b8d90 2023-07-11T00:00:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc5bb20700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc540b97a0 con 0x7fdc541449d0 2023-07-11T00:00:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc5bb20700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54144da0 con 0x7fdc540bc810 2023-07-11T00:00:20.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc5a0bd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdc540b8d90 0x7fdc5406ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54402/0 (socket says 172.21.15.38:54402) 2023-07-11T00:00:20.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc5a0bd700 1 -- 172.21.15.38:0/1649304198 learned_addr learned my addr 172.21.15.38:0/1649304198 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:20.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc590bb700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540bc810 0x7fdc540ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255362998 0 0) 0x7fdc540b8620 con 0x7fdc540b8d90 2023-07-11T00:00:20.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc400035b0 con 0x7fdc540b8d90 2023-07-11T00:00:20.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc598bc700 1 --2- 172.21.15.38:0/1649304198 >> v2:172.21.15.70:3300/0 conn(0x7fdc541449d0 0x7fdc5414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2383899455 0 0) 0x7fdc400035b0 con 0x7fdc540b8d90 2023-07-11T00:00:20.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540bc810 msgr2=0x7fdc540ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:20.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540bc810 0x7fdc540ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 >> v2:172.21.15.70:3300/0 conn(0x7fdc541449d0 msgr2=0x7fdc5414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:20.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 --2- 172.21.15.38:0/1649304198 >> v2:172.21.15.70:3300/0 conn(0x7fdc541449d0 0x7fdc5414db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc540b8900 con 0x7fdc540b8d90 2023-07-11T00:00:20.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7fdc4c0019f0 con 0x7fdc540b8d90 2023-07-11T00:00:20.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 >> v1:172.21.15.38:6789/0 conn(0x7fdc540b8d90 legacy=0x7fdc5406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc40003a00 0x7fdc40003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540bc810 0x7fdc40004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40004d90 0x7fdc40005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540b97a0 con 0x7fdc40003a00 2023-07-11T00:00:20.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4000ba10 con 0x7fdc40004d90 2023-07-11T00:00:20.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4000bb50 con 0x7fdc540bc810 2023-07-11T00:00:20.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc598bc700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc40003a00 0x7fdc40003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.562+0000 7fdc590bb700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540bc810 0x7fdc40004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.563+0000 7fdc5a0bd700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40004d90 0x7fdc40005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.563+0000 7fdc598bc700 1 -- 172.21.15.38:0/1649304198 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540bc810 msgr2=0x7fdc40004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.563+0000 7fdc598bc700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540bc810 0x7fdc40004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.563+0000 7fdc598bc700 1 -- 172.21.15.38:0/1649304198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40004d90 msgr2=0x7fdc40005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.563+0000 7fdc598bc700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40004d90 0x7fdc40005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.563+0000 7fdc598bc700 1 -- 172.21.15.38:0/1649304198 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc400035b0 con 0x7fdc40003a00 2023-07-11T00:00:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.563+0000 7fdc598bc700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc40003a00 0x7fdc40003e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009b90 tx=0x7fdc40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443b48ab8f5410a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:20.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.563+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000e660 con 0x7fdc40003a00 2023-07-11T00:00:20.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.563+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5000e7c0 con 0x7fdc40003a00 2023-07-11T00:00:20.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.563+0000 7fdc588ba700 1 -- 172.21.15.38:0/1649304198 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000eb30 con 0x7fdc40003a00 2023-07-11T00:00:20.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.564+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1649304198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc40003a00 msgr2=0x7fdc40003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.564+0000 7fdc5bb20700 1 --2- 172.21.15.38:0/1649304198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc40003a00 0x7fdc40003e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009b90 tx=0x7fdc40005880 comp rx=0 tx=0).stop 2023-07-11T00:00:20.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.564+0000 7fdc5a0bd700 1 -- 172.21.15.38:0/1649304198 reap_dead start 2023-07-11T00:00:20.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.564+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1649304198 shutdown_connections 2023-07-11T00:00:20.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.564+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1649304198 >> 172.21.15.38:0/1649304198 conn(0x7fdc540c0860 msgr2=0x7fdc540c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:20.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.564+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1649304198 shutdown_connections 2023-07-11T00:00:20.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.564+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1649304198 wait complete. 2023-07-11T00:00:20.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.565+0000 7fdc5bb20700 1 Processor -- start 2023-07-11T00:00:20.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.565+0000 7fdc5bb20700 1 -- start start 2023-07-11T00:00:20.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.565+0000 7fdc5bb20700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40003a00 0x7fdc54146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.565+0000 7fdc5bb20700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540a2ff0 0x7fdc540a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.565+0000 7fdc5bb20700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc540a3460 0x7fdc540a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.565+0000 7fdc5bb20700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54145220 con 0x7fdc540a3460 2023-07-11T00:00:20.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.565+0000 7fdc5bb20700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54145500 con 0x7fdc40003a00 2023-07-11T00:00:20.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.565+0000 7fdc5bb20700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc541457e0 con 0x7fdc540a2ff0 2023-07-11T00:00:20.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc5a0bd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc540a3460 0x7fdc540a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc5a0bd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc540a3460 0x7fdc540a23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52634/0 (socket says 172.21.15.38:52634) 2023-07-11T00:00:20.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc5a0bd700 1 -- 172.21.15.38:0/1917876801 learned_addr learned my addr 172.21.15.38:0/1917876801 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:20.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc598bc700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40003a00 0x7fdc54146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc590bb700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540a2ff0 0x7fdc540a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc5a0bd700 1 -- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540a2ff0 msgr2=0x7fdc540a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc5a0bd700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540a2ff0 0x7fdc540a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc5a0bd700 1 -- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40003a00 msgr2=0x7fdc54146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc5a0bd700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40003a00 0x7fdc54146330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc5a0bd700 1 -- 172.21.15.38:0/1917876801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc54145ac0 con 0x7fdc540a3460 2023-07-11T00:00:20.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc5a0bd700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc540a3460 0x7fdc540a23c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc540b78c0 tx=0x7fdc4c00a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:20.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc4a7fc700 1 -- 172.21.15.38:0/1917876801 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0019e0 con 0x7fdc540a3460 2023-07-11T00:00:20.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc4a7fc700 1 -- 172.21.15.38:0/1917876801 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c00adb0 con 0x7fdc540a3460 2023-07-11T00:00:20.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1917876801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc54147d40 con 0x7fdc540a3460 2023-07-11T00:00:20.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc4a7fc700 1 -- 172.21.15.38:0/1917876801 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c013650 con 0x7fdc540a3460 2023-07-11T00:00:20.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.566+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1917876801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc540b75d0 con 0x7fdc540a3460 2023-07-11T00:00:20.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.567+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1917876801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc541442f0 con 0x7fdc540a3460 2023-07-11T00:00:20.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.568+0000 7fdc4a7fc700 1 -- 172.21.15.38:0/1917876801 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc4c0137b0 con 0x7fdc540a3460 2023-07-11T00:00:20.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.568+0000 7fdc4a7fc700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fdc3806ad10 0x7fdc3806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.568+0000 7fdc4a7fc700 1 -- 172.21.15.38:0/1917876801 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc4c089bc0 con 0x7fdc540a3460 2023-07-11T00:00:20.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.568+0000 7fdc598bc700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fdc3806ad10 0x7fdc3806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.569+0000 7fdc598bc700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fdc3806ad10 0x7fdc3806d1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdc500090b0 tx=0x7fdc5001f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:20.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.572+0000 7fdc4a7fc700 1 -- 172.21.15.38:0/1917876801 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fdc4c054c70 con 0x7fdc540a3460 2023-07-11T00:00:20.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.815+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1917876801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc54145360 con 0x7fdc540a3460 2023-07-11T00:00:20.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.815+0000 7fdc4a7fc700 1 -- 172.21.15.38:0/1917876801 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3909 (secure 0 0 0) 0x7fdc54145360 con 0x7fdc540a3460 2023-07-11T00:00:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:20.818 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3612343661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3612343661},{"type":"v1","addr":"172.21.15.38:6834","nonce":3612343661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3097729806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3097729806},{"type":"v1","addr":"172.21.15.70:6835","nonce":3097729806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:00:16.787420+0000","modified":"2023-07-11T00:00:19.806642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3594015619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3594015619},{"type":"v1","addr":"172.21.15.38:6835","nonce":3594015619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:00:20.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.817+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fdc3806ad10 msgr2=0x7fdc3806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.817+0000 7fdc5bb20700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fdc3806ad10 0x7fdc3806d1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdc500090b0 tx=0x7fdc5001f040 comp rx=0 tx=0).stop 2023-07-11T00:00:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.817+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1917876801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc540a3460 msgr2=0x7fdc540a23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.817+0000 7fdc5bb20700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc540a3460 0x7fdc540a23c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc540b78c0 tx=0x7fdc4c00a640 comp rx=0 tx=0).stop 2023-07-11T00:00:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.818+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1917876801 shutdown_connections 2023-07-11T00:00:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.818+0000 7fdc5bb20700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fdc3806ad10 0x7fdc3806d1c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.818+0000 7fdc5bb20700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc540a3460 0x7fdc540a23c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.818+0000 7fdc5bb20700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc40003a00 0x7fdc54146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.818+0000 7fdc5bb20700 1 --2- 172.21.15.38:0/1917876801 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc540a2ff0 0x7fdc540a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.818+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1917876801 >> 172.21.15.38:0/1917876801 conn(0x7fdc540c0860 msgr2=0x7fdc54143be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.818+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1917876801 shutdown_connections 2023-07-11T00:00:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.818+0000 7fdc5bb20700 1 -- 172.21.15.38:0/1917876801 wait complete. 2023-07-11T00:00:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 7 2023-07-11T00:00:20.832 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:20.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.955+0000 7faaed14d700 1 Processor -- start 2023-07-11T00:00:20.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.956+0000 7faaed14d700 1 -- start start 2023-07-11T00:00:20.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.956+0000 7faaed14d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7faae80bc810 0x7faae80ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.956+0000 7faaed14d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faae80b8d90 0x7faae806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.956+0000 7faaed14d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae80b8620 con 0x7faae81449d0 2023-07-11T00:00:20.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.956+0000 7faaed14d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae80b97a0 con 0x7faae80bc810 2023-07-11T00:00:20.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.956+0000 7faaed14d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae8144da0 con 0x7faae80b8d90 2023-07-11T00:00:20.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.956+0000 7faae659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7faae80bc810 0x7faae80ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.956+0000 7faae6d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7faae81449d0 0x7faae814db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54410/0 (socket says 172.21.15.38:54410) 2023-07-11T00:00:20.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.956+0000 7faae659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7faae80bc810 0x7faae80ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52650/0 (socket says 172.21.15.38:52650) 2023-07-11T00:00:20.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.956+0000 7faae6d9d700 1 -- 172.21.15.38:0/1500697548 learned_addr learned my addr 172.21.15.38:0/1500697548 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:20.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.956+0000 7faae759e700 1 --2- 172.21.15.38:0/1500697548 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faae80b8d90 0x7faae806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faae659c700 1 -- 172.21.15.38:0/1500697548 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faae80b8d90 msgr2=0x7faae806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:20.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faae659c700 1 --2- 172.21.15.38:0/1500697548 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faae80b8d90 0x7faae806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faae659c700 1 -- 172.21.15.38:0/1500697548 >> v1:172.21.15.38:6789/0 conn(0x7faae81449d0 legacy=0x7faae814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faae659c700 1 -- 172.21.15.38:0/1500697548 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae80b8900 con 0x7faae80bc810 2023-07-11T00:00:20.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faae5d9b700 1 -- 172.21.15.38:0/1500697548 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669393671 0 0) 0x7faae80b8620 con 0x7faae81449d0 2023-07-11T00:00:20.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faae659c700 1 --2- 172.21.15.38:0/1500697548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faae80bc810 0x7faae80ba530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faad8009840 tx=0x7faad8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228f1eb23a149c33 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:20.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faae5d9b700 1 -- 172.21.15.38:0/1500697548 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8011830 con 0x7faae80bc810 2023-07-11T00:00:20.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faae5d9b700 1 -- 172.21.15.38:0/1500697548 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad8011990 con 0x7faae80bc810 2023-07-11T00:00:20.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faae5d9b700 1 -- 172.21.15.38:0/1500697548 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8011d20 con 0x7faae80bc810 2023-07-11T00:00:20.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faaed14d700 1 -- 172.21.15.38:0/1500697548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faae80bc810 msgr2=0x7faae80ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faaed14d700 1 --2- 172.21.15.38:0/1500697548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faae80bc810 0x7faae80ba530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faad8009840 tx=0x7faad8009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:20.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faaed14d700 1 -- 172.21.15.38:0/1500697548 shutdown_connections 2023-07-11T00:00:20.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faaed14d700 1 --2- 172.21.15.38:0/1500697548 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faae80b8d90 0x7faae806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faaed14d700 1 --2- 172.21.15.38:0/1500697548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faae80bc810 0x7faae80ba530 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faaed14d700 1 -- 172.21.15.38:0/1500697548 >> 172.21.15.38:0/1500697548 conn(0x7faae80c0860 msgr2=0x7faae80c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:20.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faaed14d700 1 -- 172.21.15.38:0/1500697548 shutdown_connections 2023-07-11T00:00:20.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.957+0000 7faaed14d700 1 -- 172.21.15.38:0/1500697548 wait complete. 2023-07-11T00:00:20.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.959+0000 7faaed14d700 1 Processor -- start 2023-07-11T00:00:20.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.959+0000 7faaed14d700 1 -- start start 2023-07-11T00:00:20.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.960+0000 7faaed14d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faae80b8d90 0x7faae814c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.960+0000 7faaed14d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faae80bc810 0x7faae80b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.960+0000 7faaed14d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faae81449d0 0x7faae80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.960+0000 7faaed14d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae814ce50 con 0x7faae81449d0 2023-07-11T00:00:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.960+0000 7faaed14d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae81d7550 con 0x7faae80b8d90 2023-07-11T00:00:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.960+0000 7faaed14d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae81d5b30 con 0x7faae80bc810 2023-07-11T00:00:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.960+0000 7faae759e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faae81449d0 0x7faae80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.960+0000 7faae759e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faae81449d0 0x7faae80b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52656/0 (socket says 172.21.15.38:52656) 2023-07-11T00:00:20.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.960+0000 7faae759e700 1 -- 172.21.15.38:0/1637726217 learned_addr learned my addr 172.21.15.38:0/1637726217 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:20.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.960+0000 7faae659c700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faae80bc810 0x7faae80b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.960+0000 7faae6d9d700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faae80b8d90 0x7faae814c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.961+0000 7faae759e700 1 -- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faae80bc810 msgr2=0x7faae80b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.961+0000 7faae759e700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faae80bc810 0x7faae80b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.961+0000 7faae759e700 1 -- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faae80b8d90 msgr2=0x7faae814c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:20.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.961+0000 7faae759e700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faae80b8d90 0x7faae814c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:20.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.961+0000 7faae759e700 1 -- 172.21.15.38:0/1637726217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80094a0 con 0x7faae81449d0 2023-07-11T00:00:20.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.961+0000 7faae759e700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faae81449d0 0x7faae80b60e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faae0007e40 tx=0x7faae000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:20.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.961+0000 7faadf7fe700 1 -- 172.21.15.38:0/1637726217 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae000ed30 con 0x7faae81449d0 2023-07-11T00:00:20.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.961+0000 7faadf7fe700 1 -- 172.21.15.38:0/1637726217 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae0014420 con 0x7faae81449d0 2023-07-11T00:00:20.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.961+0000 7faaed14d700 1 -- 172.21.15.38:0/1637726217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae81d5e10 con 0x7faae81449d0 2023-07-11T00:00:20.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.961+0000 7faadf7fe700 1 -- 172.21.15.38:0/1637726217 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae00147d0 con 0x7faae81449d0 2023-07-11T00:00:20.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.961+0000 7faaed14d700 1 -- 172.21.15.38:0/1637726217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae81d6460 con 0x7faae81449d0 2023-07-11T00:00:20.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.962+0000 7faaed14d700 1 -- 172.21.15.38:0/1637726217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae8074360 con 0x7faae81449d0 2023-07-11T00:00:20.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.962+0000 7faadf7fe700 1 -- 172.21.15.38:0/1637726217 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faae0014930 con 0x7faae81449d0 2023-07-11T00:00:20.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.963+0000 7faadf7fe700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7faac806ace0 0x7faac806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:20.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.963+0000 7faadf7fe700 1 -- 172.21.15.38:0/1637726217 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faae0089ae0 con 0x7faae81449d0 2023-07-11T00:00:20.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.963+0000 7faae6d9d700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7faac806ace0 0x7faac806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:20.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.963+0000 7faae6d9d700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7faac806ace0 0x7faac806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faad0000f60 tx=0x7faad0007e70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:20.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:20.967+0000 7faadf7fe700 1 -- 172.21.15.38:0/1637726217 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7faae0054cd0 con 0x7faae81449d0 2023-07-11T00:00:21.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.165+0000 7faaed14d700 1 -- 172.21.15.38:0/1637726217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faae80bc330 con 0x7faae81449d0 2023-07-11T00:00:21.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.166+0000 7faadf7fe700 1 -- 172.21.15.38:0/1637726217 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7faae00582f0 con 0x7faae81449d0 2023-07-11T00:00:21.168 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:21.168 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:21.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 -- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7faac806ace0 msgr2=0x7faac806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7faac806ace0 0x7faac806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faad0000f60 tx=0x7faad0007e70 comp rx=0 tx=0).stop 2023-07-11T00:00:21.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 -- 172.21.15.38:0/1637726217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faae81449d0 msgr2=0x7faae80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faae81449d0 0x7faae80b60e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faae0007e40 tx=0x7faae000e3c0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 -- 172.21.15.38:0/1637726217 shutdown_connections 2023-07-11T00:00:21.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7faac806ace0 0x7faac806d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faae81449d0 0x7faae80b60e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faae80b8d90 0x7faae814c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 --2- 172.21.15.38:0/1637726217 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faae80bc810 0x7faae80b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 -- 172.21.15.38:0/1637726217 >> 172.21.15.38:0/1637726217 conn(0x7faae80c0860 msgr2=0x7faae80bf170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:21.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 -- 172.21.15.38:0/1637726217 shutdown_connections 2023-07-11T00:00:21.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.168+0000 7faaed14d700 1 -- 172.21.15.38:0/1637726217 wait complete. 2023-07-11T00:00:21.182 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-11T00:00:21.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:00:21.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.307+0000 7f70eb792700 1 Processor -- start 2023-07-11T00:00:21.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.307+0000 7f70eb792700 1 -- start start 2023-07-11T00:00:21.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70eb792700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e406b120 0x7f70e406edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70eb792700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f70e4071ab0 0x7f70e4146b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70eb792700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e40b93e0 con 0x7f70e406f340 2023-07-11T00:00:21.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70eb792700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e4071690 con 0x7f70e4071ab0 2023-07-11T00:00:21.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70eb792700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e406fe90 con 0x7f70e406b120 2023-07-11T00:00:21.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70e952e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e406b120 0x7f70e406edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70e8d2d700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f70e4071ab0 0x7f70e4146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70e952e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e406b120 0x7f70e406edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42618/0 (socket says 172.21.15.38:42618) 2023-07-11T00:00:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70e8d2d700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f70e4071ab0 0x7f70e4146b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53152/0 (socket says 172.21.15.38:53152) 2023-07-11T00:00:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70e9d2f700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f70e406f340 0x7f70e4140af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:57164/0 (socket says 172.21.15.38:57164) 2023-07-11T00:00:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70e952e700 1 -- 172.21.15.38:0/3961216435 learned_addr learned my addr 172.21.15.38:0/3961216435 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70e952e700 1 -- 172.21.15.38:0/3961216435 >> v2:172.21.15.70:3300/0 conn(0x7f70e4071ab0 msgr2=0x7f70e4146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70e952e700 1 --2- 172.21.15.38:0/3961216435 >> v2:172.21.15.70:3300/0 conn(0x7f70e4071ab0 0x7f70e4146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70e952e700 1 -- 172.21.15.38:0/3961216435 >> v1:172.21.15.70:6789/0 conn(0x7f70e406f340 legacy=0x7f70e4140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.308+0000 7f70e952e700 1 -- 172.21.15.38:0/3961216435 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e4147060 con 0x7f70e406b120 2023-07-11T00:00:21.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70e952e700 1 --2- 172.21.15.38:0/3961216435 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e406b120 0x7f70e406edc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f70e00098f0 tx=0x7f70e0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d265d0b7eb3fe57e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:21.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70dbfff700 1 -- 172.21.15.38:0/3961216435 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0011830 con 0x7f70e406b120 2023-07-11T00:00:21.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70dbfff700 1 -- 172.21.15.38:0/3961216435 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e0011990 con 0x7f70e406b120 2023-07-11T00:00:21.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70dbfff700 1 -- 172.21.15.38:0/3961216435 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0011d20 con 0x7f70e406b120 2023-07-11T00:00:21.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70eb792700 1 -- 172.21.15.38:0/3961216435 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e406b120 msgr2=0x7f70e406edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70eb792700 1 --2- 172.21.15.38:0/3961216435 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e406b120 0x7f70e406edc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f70e00098f0 tx=0x7f70e0009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:21.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70eb792700 1 -- 172.21.15.38:0/3961216435 shutdown_connections 2023-07-11T00:00:21.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70eb792700 1 --2- 172.21.15.38:0/3961216435 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e406b120 0x7f70e406edc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70eb792700 1 --2- 172.21.15.38:0/3961216435 >> v2:172.21.15.70:3300/0 conn(0x7f70e4071ab0 0x7f70e4146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70eb792700 1 -- 172.21.15.38:0/3961216435 >> 172.21.15.38:0/3961216435 conn(0x7f70e40bd980 msgr2=0x7f70e40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:21.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70eb792700 1 -- 172.21.15.38:0/3961216435 shutdown_connections 2023-07-11T00:00:21.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.309+0000 7f70eb792700 1 -- 172.21.15.38:0/3961216435 wait complete. 2023-07-11T00:00:21.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70eb792700 1 Processor -- start 2023-07-11T00:00:21.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70eb792700 1 -- start start 2023-07-11T00:00:21.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70eb792700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e406b120 0x7f70e4144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70eb792700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e406f340 0x7f70e41d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70eb792700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e4071ab0 0x7f70e40b6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70eb792700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41450d0 con 0x7f70e406f340 2023-07-11T00:00:21.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70eb792700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41d3020 con 0x7f70e406b120 2023-07-11T00:00:21.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70eb792700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41d1610 con 0x7f70e4071ab0 2023-07-11T00:00:21.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70e8d2d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e406f340 0x7f70e41d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70e8d2d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e406f340 0x7f70e41d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52660/0 (socket says 172.21.15.38:52660) 2023-07-11T00:00:21.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70e8d2d700 1 -- 172.21.15.38:0/2879297439 learned_addr learned my addr 172.21.15.38:0/2879297439 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:21.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70e952e700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e406b120 0x7f70e4144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.311+0000 7f70e9d2f700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e4071ab0 0x7f70e40b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.312+0000 7f70e8d2d700 1 -- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e4071ab0 msgr2=0x7f70e40b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.312+0000 7f70e8d2d700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e4071ab0 0x7f70e40b6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.312+0000 7f70e8d2d700 1 -- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e406b120 msgr2=0x7f70e4144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.312+0000 7f70e8d2d700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e406b120 0x7f70e4144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.312+0000 7f70e8d2d700 1 -- 172.21.15.38:0/2879297439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0009550 con 0x7f70e406f340 2023-07-11T00:00:21.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.312+0000 7f70e8d2d700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e406f340 0x7f70e41d10d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f70d400e870 tx=0x7f70d400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:21.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.312+0000 7f70d9ffb700 1 -- 172.21.15.38:0/2879297439 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4009590 con 0x7f70e406f340 2023-07-11T00:00:21.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.312+0000 7f70d9ffb700 1 -- 172.21.15.38:0/2879297439 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4013680 con 0x7f70e406f340 2023-07-11T00:00:21.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.312+0000 7f70eb792700 1 -- 172.21.15.38:0/2879297439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e41e02d0 con 0x7f70e406f340 2023-07-11T00:00:21.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.312+0000 7f70d9ffb700 1 -- 172.21.15.38:0/2879297439 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d40139f0 con 0x7f70e406f340 2023-07-11T00:00:21.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.312+0000 7f70eb792700 1 -- 172.21.15.38:0/2879297439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e41e0890 con 0x7f70e406f340 2023-07-11T00:00:21.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.313+0000 7f70eb792700 1 -- 172.21.15.38:0/2879297439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e41e0c00 con 0x7f70e406f340 2023-07-11T00:00:21.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.314+0000 7f70d9ffb700 1 -- 172.21.15.38:0/2879297439 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f70d4013b50 con 0x7f70e406f340 2023-07-11T00:00:21.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.314+0000 7f70d9ffb700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70c806ace0 0x7f70c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.314+0000 7f70d9ffb700 1 -- 172.21.15.38:0/2879297439 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70d40891f0 con 0x7f70e406f340 2023-07-11T00:00:21.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.314+0000 7f70e952e700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70c806ace0 0x7f70c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.315+0000 7f70e952e700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70c806ace0 0x7f70c806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009c40 tx=0x7f70e0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:21.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.319+0000 7f70d9ffb700 1 -- 172.21.15.38:0/2879297439 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f70d4057dc0 con 0x7f70e406f340 2023-07-11T00:00:21.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.514+0000 7f70eb792700 1 -- 172.21.15.38:0/2879297439 --> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70e406f8d0 con 0x7f70c806ace0 2023-07-11T00:00:21.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.523+0000 7f70d9ffb700 1 -- 172.21.15.38:0/2879297439 <== mgr.4105 v2:172.21.15.70:6832/2073477499 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286974 (secure 0 0 0) 0x7f70e0011c00 con 0x7f70c806ace0 2023-07-11T00:00:21.527 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 -- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70c806ace0 msgr2=0x7f70c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70c806ace0 0x7f70c806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009c40 tx=0x7f70e0008030 comp rx=0 tx=0).stop 2023-07-11T00:00:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 -- 172.21.15.38:0/2879297439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e406f340 msgr2=0x7f70e41d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e406f340 0x7f70e41d10d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f70d400e870 tx=0x7f70d400eb80 comp rx=0 tx=0).stop 2023-07-11T00:00:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 -- 172.21.15.38:0/2879297439 shutdown_connections 2023-07-11T00:00:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70c806ace0 0x7f70c806d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e4071ab0 0x7f70e40b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e406b120 0x7f70e4144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 --2- 172.21.15.38:0/2879297439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e406f340 0x7f70e41d10d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 -- 172.21.15.38:0/2879297439 >> 172.21.15.38:0/2879297439 conn(0x7f70e40bd980 msgr2=0x7f70e40b9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:21.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 -- 172.21.15.38:0/2879297439 shutdown_connections 2023-07-11T00:00:21.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.526+0000 7f70eb792700 1 -- 172.21.15.38:0/2879297439 wait complete. 2023-07-11T00:00:21.533 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-07-11T00:00:21.540 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-07-11T00:00:19.949936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2860,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2928640,"data_stored":1784987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.589894"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008537+0000","last_change":"2023-07-11T00:00:17.397708+0000","last_active":"2023-07-11T00:00:19.008537+0000","last_peered":"2023-07-11T00:00:19.008537+0000","last_clean":"2023-07-11T00:00:19.008537+0000","last_became_active":"2023-07-11T00:00:17.397420+0000","last_became_peered":"2023-07-11T00:00:17.397420+0000","last_unstale":"2023-07-11T00:00:19.008537+0000","last_undegraded":"2023-07-11T00:00:19.008537+0000","last_fullsized":"2023-07-11T00:00:19.008537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:36:59.464113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373811+0000","last_change":"2023-07-11T00:00:17.397645+0000","last_active":"2023-07-11T00:00:18.373811+0000","last_peered":"2023-07-11T00:00:18.373811+0000","last_clean":"2023-07-11T00:00:18.373811+0000","last_became_active":"2023-07-11T00:00:17.397379+0000","last_became_peered":"2023-07-11T00:00:17.397379+0000","last_unstale":"2023-07-11T00:00:18.373811+0000","last_undegraded":"2023-07-11T00:00:18.373811+0000","last_fullsized":"2023-07-11T00:00:18.373811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009115+0000","last_change":"2023-07-11T00:00:17.383242+0000","last_active":"2023-07-11T00:00:19.009115+0000","last_peered":"2023-07-11T00:00:19.009115+0000","last_clean":"2023-07-11T00:00:19.009115+0000","last_became_active":"2023-07-11T00:00:17.382949+0000","last_became_peered":"2023-07-11T00:00:17.382949+0000","last_unstale":"2023-07-11T00:00:19.009115+0000","last_undegraded":"2023-07-11T00:00:19.009115+0000","last_fullsized":"2023-07-11T00:00:19.009115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:03.546582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374355+0000","last_change":"2023-07-11T00:00:17.382742+0000","last_active":"2023-07-11T00:00:18.374355+0000","last_peered":"2023-07-11T00:00:18.374355+0000","last_clean":"2023-07-11T00:00:18.374355+0000","last_became_active":"2023-07-11T00:00:17.382485+0000","last_became_peered":"2023-07-11T00:00:17.382485+0000","last_unstale":"2023-07-11T00:00:18.374355+0000","last_undegraded":"2023-07-11T00:00:18.374355+0000","last_fullsized":"2023-07-11T00:00:18.374355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:10:20.060069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506405+0000","last_change":"2023-07-11T00:00:17.397047+0000","last_active":"2023-07-11T00:00:18.506405+0000","last_peered":"2023-07-11T00:00:18.506405+0000","last_clean":"2023-07-11T00:00:18.506405+0000","last_became_active":"2023-07-11T00:00:17.396780+0000","last_became_peered":"2023-07-11T00:00:17.396780+0000","last_unstale":"2023-07-11T00:00:18.506405+0000","last_undegraded":"2023-07-11T00:00:18.506405+0000","last_fullsized":"2023-07-11T00:00:18.506405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:49.980328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007933+0000","last_change":"2023-07-11T00:00:17.383091+0000","last_active":"2023-07-11T00:00:19.007933+0000","last_peered":"2023-07-11T00:00:19.007933+0000","last_clean":"2023-07-11T00:00:19.007933+0000","last_became_active":"2023-07-11T00:00:17.382732+0000","last_became_peered":"2023-07-11T00:00:17.382732+0000","last_unstale":"2023-07-11T00:00:19.007933+0000","last_undegraded":"2023-07-11T00:00:19.007933+0000","last_fullsized":"2023-07-11T00:00:19.007933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007960+0000","last_change":"2023-07-11T00:00:17.398152+0000","last_active":"2023-07-11T00:00:19.007960+0000","last_peered":"2023-07-11T00:00:19.007960+0000","last_clean":"2023-07-11T00:00:19.007960+0000","last_became_active":"2023-07-11T00:00:17.397866+0000","last_became_peered":"2023-07-11T00:00:17.397866+0000","last_unstale":"2023-07-11T00:00:19.007960+0000","last_undegraded":"2023-07-11T00:00:19.007960+0000","last_fullsized":"2023-07-11T00:00:19.007960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:45.858410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373410+0000","last_change":"2023-07-11T00:00:17.388247+0000","last_active":"2023-07-11T00:00:18.373410+0000","last_peered":"2023-07-11T00:00:18.373410+0000","last_clean":"2023-07-11T00:00:18.373410+0000","last_became_active":"2023-07-11T00:00:17.387971+0000","last_became_peered":"2023-07-11T00:00:17.387971+0000","last_unstale":"2023-07-11T00:00:18.373410+0000","last_undegraded":"2023-07-11T00:00:18.373410+0000","last_fullsized":"2023-07-11T00:00:18.373410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:49.980328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506791+0000","last_change":"2023-07-11T00:00:17.399917+0000","last_active":"2023-07-11T00:00:18.506791+0000","last_peered":"2023-07-11T00:00:18.506791+0000","last_clean":"2023-07-11T00:00:18.506791+0000","last_became_active":"2023-07-11T00:00:17.399650+0000","last_became_peered":"2023-07-11T00:00:17.399650+0000","last_unstale":"2023-07-11T00:00:18.506791+0000","last_undegraded":"2023-07-11T00:00:18.506791+0000","last_fullsized":"2023-07-11T00:00:18.506791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:16.918740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374155+0000","last_change":"2023-07-11T00:00:17.391372+0000","last_active":"2023-07-11T00:00:18.374155+0000","last_peered":"2023-07-11T00:00:18.374155+0000","last_clean":"2023-07-11T00:00:18.374155+0000","last_became_active":"2023-07-11T00:00:17.391073+0000","last_became_peered":"2023-07-11T00:00:17.391073+0000","last_unstale":"2023-07-11T00:00:18.374155+0000","last_undegraded":"2023-07-11T00:00:18.374155+0000","last_fullsized":"2023-07-11T00:00:18.374155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:57.519021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009402+0000","last_change":"2023-07-11T00:00:17.386526+0000","last_active":"2023-07-11T00:00:19.009402+0000","last_peered":"2023-07-11T00:00:19.009402+0000","last_clean":"2023-07-11T00:00:19.009402+0000","last_became_active":"2023-07-11T00:00:17.386224+0000","last_became_peered":"2023-07-11T00:00:17.386224+0000","last_unstale":"2023-07-11T00:00:19.009402+0000","last_undegraded":"2023-07-11T00:00:19.009402+0000","last_fullsized":"2023-07-11T00:00:19.009402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:33.551132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008039+0000","last_change":"2023-07-11T00:00:17.391880+0000","last_active":"2023-07-11T00:00:19.008039+0000","last_peered":"2023-07-11T00:00:19.008039+0000","last_clean":"2023-07-11T00:00:19.008039+0000","last_became_active":"2023-07-11T00:00:17.391579+0000","last_became_peered":"2023-07-11T00:00:17.391579+0000","last_unstale":"2023-07-11T00:00:19.008039+0000","last_undegraded":"2023-07-11T00:00:19.008039+0000","last_fullsized":"2023-07-11T00:00:19.008039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:36.282927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008235+0000","last_change":"2023-07-11T00:00:17.395824+0000","last_active":"2023-07-11T00:00:19.008235+0000","last_peered":"2023-07-11T00:00:19.008235+0000","last_clean":"2023-07-11T00:00:19.008235+0000","last_became_active":"2023-07-11T00:00:17.395540+0000","last_became_peered":"2023-07-11T00:00:17.395540+0000","last_unstale":"2023-07-11T00:00:19.008235+0000","last_undegraded":"2023-07-11T00:00:19.008235+0000","last_fullsized":"2023-07-11T00:00:19.008235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:12:34.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373653+0000","last_change":"2023-07-11T00:00:17.392402+0000","last_active":"2023-07-11T00:00:18.373653+0000","last_peered":"2023-07-11T00:00:18.373653+0000","last_clean":"2023-07-11T00:00:18.373653+0000","last_became_active":"2023-07-11T00:00:17.392138+0000","last_became_peered":"2023-07-11T00:00:17.392138+0000","last_unstale":"2023-07-11T00:00:18.373653+0000","last_undegraded":"2023-07-11T00:00:18.373653+0000","last_fullsized":"2023-07-11T00:00:18.373653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008481+0000","last_change":"2023-07-11T00:00:17.398211+0000","last_active":"2023-07-11T00:00:19.008481+0000","last_peered":"2023-07-11T00:00:19.008481+0000","last_clean":"2023-07-11T00:00:19.008481+0000","last_became_active":"2023-07-11T00:00:17.397884+0000","last_became_peered":"2023-07-11T00:00:17.397884+0000","last_unstale":"2023-07-11T00:00:19.008481+0000","last_undegraded":"2023-07-11T00:00:19.008481+0000","last_fullsized":"2023-07-11T00:00:19.008481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:18:53.735358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008071+0000","last_change":"2023-07-11T00:00:17.383250+0000","last_active":"2023-07-11T00:00:19.008071+0000","last_peered":"2023-07-11T00:00:19.008071+0000","last_clean":"2023-07-11T00:00:19.008071+0000","last_became_active":"2023-07-11T00:00:17.382988+0000","last_became_peered":"2023-07-11T00:00:17.382988+0000","last_unstale":"2023-07-11T00:00:19.008071+0000","last_undegraded":"2023-07-11T00:00:19.008071+0000","last_fullsized":"2023-07-11T00:00:19.008071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:40.051389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506790+0000","last_change":"2023-07-11T00:00:17.395710+0000","last_active":"2023-07-11T00:00:18.506790+0000","last_peered":"2023-07-11T00:00:18.506790+0000","last_clean":"2023-07-11T00:00:18.506790+0000","last_became_active":"2023-07-11T00:00:17.395425+0000","last_became_peered":"2023-07-11T00:00:17.395425+0000","last_unstale":"2023-07-11T00:00:18.506790+0000","last_undegraded":"2023-07-11T00:00:18.506790+0000","last_fullsized":"2023-07-11T00:00:18.506790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:40.051389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009267+0000","last_change":"2023-07-11T00:00:17.392947+0000","last_active":"2023-07-11T00:00:19.009267+0000","last_peered":"2023-07-11T00:00:19.009267+0000","last_clean":"2023-07-11T00:00:19.009267+0000","last_became_active":"2023-07-11T00:00:17.392696+0000","last_became_peered":"2023-07-11T00:00:17.392696+0000","last_unstale":"2023-07-11T00:00:19.009267+0000","last_undegraded":"2023-07-11T00:00:19.009267+0000","last_fullsized":"2023-07-11T00:00:19.009267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:51:54.640593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008178+0000","last_change":"2023-07-11T00:00:17.399163+0000","last_active":"2023-07-11T00:00:19.008178+0000","last_peered":"2023-07-11T00:00:19.008178+0000","last_clean":"2023-07-11T00:00:19.008178+0000","last_became_active":"2023-07-11T00:00:17.398876+0000","last_became_peered":"2023-07-11T00:00:17.398876+0000","last_unstale":"2023-07-11T00:00:19.008178+0000","last_undegraded":"2023-07-11T00:00:19.008178+0000","last_fullsized":"2023-07-11T00:00:19.008178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:40:09.287884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009140+0000","last_change":"2023-07-11T00:00:17.385145+0000","last_active":"2023-07-11T00:00:19.009140+0000","last_peered":"2023-07-11T00:00:19.009140+0000","last_clean":"2023-07-11T00:00:19.009140+0000","last_became_active":"2023-07-11T00:00:17.384889+0000","last_became_peered":"2023-07-11T00:00:17.384889+0000","last_unstale":"2023-07-11T00:00:19.009140+0000","last_undegraded":"2023-07-11T00:00:19.009140+0000","last_fullsized":"2023-07-11T00:00:19.009140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:49.096105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008620+0000","last_change":"2023-07-11T00:00:17.396464+0000","last_active":"2023-07-11T00:00:19.008620+0000","last_peered":"2023-07-11T00:00:19.008620+0000","last_clean":"2023-07-11T00:00:19.008620+0000","last_became_active":"2023-07-11T00:00:17.396157+0000","last_became_peered":"2023-07-11T00:00:17.396157+0000","last_unstale":"2023-07-11T00:00:19.008620+0000","last_undegraded":"2023-07-11T00:00:19.008620+0000","last_fullsized":"2023-07-11T00:00:19.008620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:56:38.988691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506379+0000","last_change":"2023-07-11T00:00:17.400807+0000","last_active":"2023-07-11T00:00:18.506379+0000","last_peered":"2023-07-11T00:00:18.506379+0000","last_clean":"2023-07-11T00:00:18.506379+0000","last_became_active":"2023-07-11T00:00:17.400518+0000","last_became_peered":"2023-07-11T00:00:17.400518+0000","last_unstale":"2023-07-11T00:00:18.506379+0000","last_undegraded":"2023-07-11T00:00:18.506379+0000","last_fullsized":"2023-07-11T00:00:18.506379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:26.253992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007811+0000","last_change":"2023-07-11T00:00:17.393536+0000","last_active":"2023-07-11T00:00:19.007811+0000","last_peered":"2023-07-11T00:00:19.007811+0000","last_clean":"2023-07-11T00:00:19.007811+0000","last_became_active":"2023-07-11T00:00:17.393218+0000","last_became_peered":"2023-07-11T00:00:17.393218+0000","last_unstale":"2023-07-11T00:00:19.007811+0000","last_undegraded":"2023-07-11T00:00:19.007811+0000","last_fullsized":"2023-07-11T00:00:19.007811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008065+0000","last_change":"2023-07-11T00:00:17.394760+0000","last_active":"2023-07-11T00:00:19.008065+0000","last_peered":"2023-07-11T00:00:19.008065+0000","last_clean":"2023-07-11T00:00:19.008065+0000","last_became_active":"2023-07-11T00:00:17.394413+0000","last_became_peered":"2023-07-11T00:00:17.394413+0000","last_unstale":"2023-07-11T00:00:19.008065+0000","last_undegraded":"2023-07-11T00:00:19.008065+0000","last_fullsized":"2023-07-11T00:00:19.008065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373353+0000","last_change":"2023-07-11T00:00:17.392669+0000","last_active":"2023-07-11T00:00:18.373353+0000","last_peered":"2023-07-11T00:00:18.373353+0000","last_clean":"2023-07-11T00:00:18.373353+0000","last_became_active":"2023-07-11T00:00:17.392196+0000","last_became_peered":"2023-07-11T00:00:17.392196+0000","last_unstale":"2023-07-11T00:00:18.373353+0000","last_undegraded":"2023-07-11T00:00:18.373353+0000","last_fullsized":"2023-07-11T00:00:18.373353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373327+0000","last_change":"2023-07-11T00:00:17.393336+0000","last_active":"2023-07-11T00:00:18.373327+0000","last_peered":"2023-07-11T00:00:18.373327+0000","last_clean":"2023-07-11T00:00:18.373327+0000","last_became_active":"2023-07-11T00:00:17.393012+0000","last_became_peered":"2023-07-11T00:00:17.393012+0000","last_unstale":"2023-07-11T00:00:18.373327+0000","last_undegraded":"2023-07-11T00:00:18.373327+0000","last_fullsized":"2023-07-11T00:00:18.373327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373803+0000","last_change":"2023-07-11T00:00:17.391606+0000","last_active":"2023-07-11T00:00:18.373803+0000","last_peered":"2023-07-11T00:00:18.373803+0000","last_clean":"2023-07-11T00:00:18.373803+0000","last_became_active":"2023-07-11T00:00:17.391040+0000","last_became_peered":"2023-07-11T00:00:17.391040+0000","last_unstale":"2023-07-11T00:00:18.373803+0000","last_undegraded":"2023-07-11T00:00:18.373803+0000","last_fullsized":"2023-07-11T00:00:18.373803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008846+0000","last_change":"2023-07-11T00:00:16.382120+0000","last_active":"2023-07-11T00:00:19.008846+0000","last_peered":"2023-07-11T00:00:19.008846+0000","last_clean":"2023-07-11T00:00:19.008846+0000","last_became_active":"2023-07-11T00:00:16.381850+0000","last_became_peered":"2023-07-11T00:00:16.381850+0000","last_unstale":"2023-07-11T00:00:19.008846+0000","last_undegraded":"2023-07-11T00:00:19.008846+0000","last_fullsized":"2023-07-11T00:00:19.008846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:56.513606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008521+0000","last_change":"2023-07-11T00:00:17.399984+0000","last_active":"2023-07-11T00:00:19.008521+0000","last_peered":"2023-07-11T00:00:19.008521+0000","last_clean":"2023-07-11T00:00:19.008521+0000","last_became_active":"2023-07-11T00:00:17.399791+0000","last_became_peered":"2023-07-11T00:00:17.399791+0000","last_unstale":"2023-07-11T00:00:19.008521+0000","last_undegraded":"2023-07-11T00:00:19.008521+0000","last_fullsized":"2023-07-11T00:00:19.008521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372863+0000","last_change":"2023-07-11T00:00:16.386771+0000","last_active":"2023-07-11T00:00:18.372863+0000","last_peered":"2023-07-11T00:00:18.372863+0000","last_clean":"2023-07-11T00:00:18.372863+0000","last_became_active":"2023-07-11T00:00:16.386510+0000","last_became_peered":"2023-07-11T00:00:16.386510+0000","last_unstale":"2023-07-11T00:00:18.372863+0000","last_undegraded":"2023-07-11T00:00:18.372863+0000","last_fullsized":"2023-07-11T00:00:18.372863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:04:26.155667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506805+0000","last_change":"2023-07-11T00:00:17.382846+0000","last_active":"2023-07-11T00:00:18.506805+0000","last_peered":"2023-07-11T00:00:18.506805+0000","last_clean":"2023-07-11T00:00:18.506805+0000","last_became_active":"2023-07-11T00:00:17.382575+0000","last_became_peered":"2023-07-11T00:00:17.382575+0000","last_unstale":"2023-07-11T00:00:18.506805+0000","last_undegraded":"2023-07-11T00:00:18.506805+0000","last_fullsized":"2023-07-11T00:00:18.506805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:29.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008088+0000","last_change":"2023-07-11T00:00:16.385044+0000","last_active":"2023-07-11T00:00:19.008088+0000","last_peered":"2023-07-11T00:00:19.008088+0000","last_clean":"2023-07-11T00:00:19.008088+0000","last_became_active":"2023-07-11T00:00:16.384163+0000","last_became_peered":"2023-07-11T00:00:16.384163+0000","last_unstale":"2023-07-11T00:00:19.008088+0000","last_undegraded":"2023-07-11T00:00:19.008088+0000","last_fullsized":"2023-07-11T00:00:19.008088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:39.045974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374477+0000","last_change":"2023-07-11T00:00:17.386852+0000","last_active":"2023-07-11T00:00:18.374477+0000","last_peered":"2023-07-11T00:00:18.374477+0000","last_clean":"2023-07-11T00:00:18.374477+0000","last_became_active":"2023-07-11T00:00:17.386559+0000","last_became_peered":"2023-07-11T00:00:17.386559+0000","last_unstale":"2023-07-11T00:00:18.374477+0000","last_undegraded":"2023-07-11T00:00:18.374477+0000","last_fullsized":"2023-07-11T00:00:18.374477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:17.746982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506933+0000","last_change":"2023-07-11T00:00:16.386985+0000","last_active":"2023-07-11T00:00:18.506933+0000","last_peered":"2023-07-11T00:00:18.506933+0000","last_clean":"2023-07-11T00:00:18.506933+0000","last_became_active":"2023-07-11T00:00:16.386092+0000","last_became_peered":"2023-07-11T00:00:16.386092+0000","last_unstale":"2023-07-11T00:00:18.506933+0000","last_undegraded":"2023-07-11T00:00:18.506933+0000","last_fullsized":"2023-07-11T00:00:18.506933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:56.513606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007916+0000","last_change":"2023-07-11T00:00:17.400026+0000","last_active":"2023-07-11T00:00:19.007916+0000","last_peered":"2023-07-11T00:00:19.007916+0000","last_clean":"2023-07-11T00:00:19.007916+0000","last_became_active":"2023-07-11T00:00:17.399293+0000","last_became_peered":"2023-07-11T00:00:17.399293+0000","last_unstale":"2023-07-11T00:00:19.007916+0000","last_undegraded":"2023-07-11T00:00:19.007916+0000","last_fullsized":"2023-07-11T00:00:19.007916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374001+0000","last_change":"2023-07-11T00:00:16.384101+0000","last_active":"2023-07-11T00:00:18.374001+0000","last_peered":"2023-07-11T00:00:18.374001+0000","last_clean":"2023-07-11T00:00:18.374001+0000","last_became_active":"2023-07-11T00:00:16.383818+0000","last_became_peered":"2023-07-11T00:00:16.383818+0000","last_unstale":"2023-07-11T00:00:18.374001+0000","last_undegraded":"2023-07-11T00:00:18.374001+0000","last_fullsized":"2023-07-11T00:00:18.374001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:28.418665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008115+0000","last_change":"2023-07-11T00:00:17.389712+0000","last_active":"2023-07-11T00:00:19.008115+0000","last_peered":"2023-07-11T00:00:19.008115+0000","last_clean":"2023-07-11T00:00:19.008115+0000","last_became_active":"2023-07-11T00:00:17.389347+0000","last_became_peered":"2023-07-11T00:00:17.389347+0000","last_unstale":"2023-07-11T00:00:19.008115+0000","last_undegraded":"2023-07-11T00:00:19.008115+0000","last_fullsized":"2023-07-11T00:00:19.008115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:29.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008467+0000","last_change":"2023-07-11T00:00:16.389670+0000","last_active":"2023-07-11T00:00:19.008467+0000","last_peered":"2023-07-11T00:00:19.008467+0000","last_clean":"2023-07-11T00:00:19.008467+0000","last_became_active":"2023-07-11T00:00:16.389452+0000","last_became_peered":"2023-07-11T00:00:16.389452+0000","last_unstale":"2023-07-11T00:00:19.008467+0000","last_undegraded":"2023-07-11T00:00:19.008467+0000","last_fullsized":"2023-07-11T00:00:19.008467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:51:53.635178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372965+0000","last_change":"2023-07-11T00:00:17.395904+0000","last_active":"2023-07-11T00:00:18.372965+0000","last_peered":"2023-07-11T00:00:18.372965+0000","last_clean":"2023-07-11T00:00:18.372965+0000","last_became_active":"2023-07-11T00:00:17.392236+0000","last_became_peered":"2023-07-11T00:00:17.392236+0000","last_unstale":"2023-07-11T00:00:18.372965+0000","last_undegraded":"2023-07-11T00:00:18.372965+0000","last_fullsized":"2023-07-11T00:00:18.372965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:12:05.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009431+0000","last_change":"2023-07-11T00:00:16.382024+0000","last_active":"2023-07-11T00:00:19.009431+0000","last_peered":"2023-07-11T00:00:19.009431+0000","last_clean":"2023-07-11T00:00:19.009431+0000","last_became_active":"2023-07-11T00:00:16.380867+0000","last_became_peered":"2023-07-11T00:00:16.380867+0000","last_unstale":"2023-07-11T00:00:19.009431+0000","last_undegraded":"2023-07-11T00:00:19.009431+0000","last_fullsized":"2023-07-11T00:00:19.009431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:56:37.983275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009263+0000","last_change":"2023-07-11T00:00:17.378560+0000","last_active":"2023-07-11T00:00:19.009263+0000","last_peered":"2023-07-11T00:00:19.009263+0000","last_clean":"2023-07-11T00:00:19.009263+0000","last_became_active":"2023-07-11T00:00:17.378254+0000","last_became_peered":"2023-07-11T00:00:17.378254+0000","last_unstale":"2023-07-11T00:00:19.009263+0000","last_undegraded":"2023-07-11T00:00:19.009263+0000","last_fullsized":"2023-07-11T00:00:19.009263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:23.254269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008429+0000","last_change":"2023-07-11T00:00:16.384078+0000","last_active":"2023-07-11T00:00:19.008429+0000","last_peered":"2023-07-11T00:00:19.008429+0000","last_clean":"2023-07-11T00:00:19.008429+0000","last_became_active":"2023-07-11T00:00:16.383846+0000","last_became_peered":"2023-07-11T00:00:16.383846+0000","last_unstale":"2023-07-11T00:00:19.008429+0000","last_undegraded":"2023-07-11T00:00:19.008429+0000","last_fullsized":"2023-07-11T00:00:19.008429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:22.248854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008163+0000","last_change":"2023-07-11T00:00:17.399815+0000","last_active":"2023-07-11T00:00:19.008163+0000","last_peered":"2023-07-11T00:00:19.008163+0000","last_clean":"2023-07-11T00:00:19.008163+0000","last_became_active":"2023-07-11T00:00:17.399521+0000","last_became_peered":"2023-07-11T00:00:17.399521+0000","last_unstale":"2023-07-11T00:00:19.008163+0000","last_undegraded":"2023-07-11T00:00:19.008163+0000","last_fullsized":"2023-07-11T00:00:19.008163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:05.297107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506521+0000","last_change":"2023-07-11T00:00:16.380652+0000","last_active":"2023-07-11T00:00:18.506521+0000","last_peered":"2023-07-11T00:00:18.506521+0000","last_clean":"2023-07-11T00:00:18.506521+0000","last_became_active":"2023-07-11T00:00:16.380380+0000","last_became_peered":"2023-07-11T00:00:16.380380+0000","last_unstale":"2023-07-11T00:00:18.506521+0000","last_undegraded":"2023-07-11T00:00:18.506521+0000","last_fullsized":"2023-07-11T00:00:18.506521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:06.207909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373844+0000","last_change":"2023-07-11T00:00:17.390008+0000","last_active":"2023-07-11T00:00:18.373844+0000","last_peered":"2023-07-11T00:00:18.373844+0000","last_clean":"2023-07-11T00:00:18.373844+0000","last_became_active":"2023-07-11T00:00:17.389740+0000","last_became_peered":"2023-07-11T00:00:17.389740+0000","last_unstale":"2023-07-11T00:00:18.373844+0000","last_undegraded":"2023-07-11T00:00:18.373844+0000","last_fullsized":"2023-07-11T00:00:18.373844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008147+0000","last_change":"2023-07-11T00:00:16.383128+0000","last_active":"2023-07-11T00:00:19.008147+0000","last_peered":"2023-07-11T00:00:19.008147+0000","last_clean":"2023-07-11T00:00:19.008147+0000","last_became_active":"2023-07-11T00:00:16.382870+0000","last_became_peered":"2023-07-11T00:00:16.382870+0000","last_unstale":"2023-07-11T00:00:19.008147+0000","last_undegraded":"2023-07-11T00:00:19.008147+0000","last_fullsized":"2023-07-11T00:00:19.008147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:02.541167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506680+0000","last_change":"2023-07-11T00:00:17.394408+0000","last_active":"2023-07-11T00:00:18.506680+0000","last_peered":"2023-07-11T00:00:18.506680+0000","last_clean":"2023-07-11T00:00:18.506680+0000","last_became_active":"2023-07-11T00:00:17.394079+0000","last_became_peered":"2023-07-11T00:00:17.394079+0000","last_unstale":"2023-07-11T00:00:18.506680+0000","last_undegraded":"2023-07-11T00:00:18.506680+0000","last_fullsized":"2023-07-11T00:00:18.506680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373459+0000","last_change":"2023-07-11T00:00:16.380308+0000","last_active":"2023-07-11T00:00:18.373459+0000","last_peered":"2023-07-11T00:00:18.373459+0000","last_clean":"2023-07-11T00:00:18.373459+0000","last_became_active":"2023-07-11T00:00:16.380036+0000","last_became_peered":"2023-07-11T00:00:16.380036+0000","last_unstale":"2023-07-11T00:00:18.373459+0000","last_undegraded":"2023-07-11T00:00:18.373459+0000","last_fullsized":"2023-07-11T00:00:18.373459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:57:14.865203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008874+0000","last_change":"2023-07-11T00:00:17.396665+0000","last_active":"2023-07-11T00:00:19.008874+0000","last_peered":"2023-07-11T00:00:19.008874+0000","last_clean":"2023-07-11T00:00:19.008874+0000","last_became_active":"2023-07-11T00:00:17.396049+0000","last_became_peered":"2023-07-11T00:00:17.396049+0000","last_unstale":"2023-07-11T00:00:19.008874+0000","last_undegraded":"2023-07-11T00:00:19.008874+0000","last_fullsized":"2023-07-11T00:00:19.008874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:23.254269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008597+0000","last_change":"2023-07-11T00:00:16.382403+0000","last_active":"2023-07-11T00:00:19.008597+0000","last_peered":"2023-07-11T00:00:19.008597+0000","last_clean":"2023-07-11T00:00:19.008597+0000","last_became_active":"2023-07-11T00:00:16.382062+0000","last_became_peered":"2023-07-11T00:00:16.382062+0000","last_unstale":"2023-07-11T00:00:19.008597+0000","last_undegraded":"2023-07-11T00:00:19.008597+0000","last_fullsized":"2023-07-11T00:00:19.008597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:17:20.832645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373662+0000","last_change":"2023-07-11T00:00:17.384147+0000","last_active":"2023-07-11T00:00:18.373662+0000","last_peered":"2023-07-11T00:00:18.373662+0000","last_clean":"2023-07-11T00:00:18.373662+0000","last_became_active":"2023-07-11T00:00:17.383896+0000","last_became_peered":"2023-07-11T00:00:17.383896+0000","last_unstale":"2023-07-11T00:00:18.373662+0000","last_undegraded":"2023-07-11T00:00:18.373662+0000","last_fullsized":"2023-07-11T00:00:18.373662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008430+0000","last_change":"2023-07-11T00:00:16.384123+0000","last_active":"2023-07-11T00:00:19.008430+0000","last_peered":"2023-07-11T00:00:19.008430+0000","last_clean":"2023-07-11T00:00:19.008430+0000","last_became_active":"2023-07-11T00:00:16.383832+0000","last_became_peered":"2023-07-11T00:00:16.383832+0000","last_unstale":"2023-07-11T00:00:19.008430+0000","last_undegraded":"2023-07-11T00:00:19.008430+0000","last_fullsized":"2023-07-11T00:00:19.008430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:34:19.684185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008056+0000","last_change":"2023-07-11T00:00:17.387530+0000","last_active":"2023-07-11T00:00:19.008056+0000","last_peered":"2023-07-11T00:00:19.008056+0000","last_clean":"2023-07-11T00:00:19.008056+0000","last_became_active":"2023-07-11T00:00:17.387105+0000","last_became_peered":"2023-07-11T00:00:17.387105+0000","last_unstale":"2023-07-11T00:00:19.008056+0000","last_undegraded":"2023-07-11T00:00:19.008056+0000","last_fullsized":"2023-07-11T00:00:19.008056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008383+0000","last_change":"2023-07-11T00:00:16.385068+0000","last_active":"2023-07-11T00:00:19.008383+0000","last_peered":"2023-07-11T00:00:19.008383+0000","last_clean":"2023-07-11T00:00:19.008383+0000","last_became_active":"2023-07-11T00:00:16.384772+0000","last_became_peered":"2023-07-11T00:00:16.384772+0000","last_unstale":"2023-07-11T00:00:19.008383+0000","last_undegraded":"2023-07-11T00:00:19.008383+0000","last_fullsized":"2023-07-11T00:00:19.008383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:32.545716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374548+0000","last_change":"2023-07-11T00:00:17.383412+0000","last_active":"2023-07-11T00:00:18.374548+0000","last_peered":"2023-07-11T00:00:18.374548+0000","last_clean":"2023-07-11T00:00:18.374548+0000","last_became_active":"2023-07-11T00:00:17.383162+0000","last_became_peered":"2023-07-11T00:00:17.383162+0000","last_unstale":"2023-07-11T00:00:18.374548+0000","last_undegraded":"2023-07-11T00:00:18.374548+0000","last_fullsized":"2023-07-11T00:00:18.374548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373928+0000","last_change":"2023-07-11T00:00:16.386464+0000","last_active":"2023-07-11T00:00:18.373928+0000","last_peered":"2023-07-11T00:00:18.373928+0000","last_clean":"2023-07-11T00:00:18.373928+0000","last_became_active":"2023-07-11T00:00:16.385972+0000","last_became_peered":"2023-07-11T00:00:16.385972+0000","last_unstale":"2023-07-11T00:00:18.373928+0000","last_undegraded":"2023-07-11T00:00:18.373928+0000","last_fullsized":"2023-07-11T00:00:18.373928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:39.045974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506589+0000","last_change":"2023-07-11T00:00:17.397631+0000","last_active":"2023-07-11T00:00:18.506589+0000","last_peered":"2023-07-11T00:00:18.506589+0000","last_clean":"2023-07-11T00:00:18.506589+0000","last_became_active":"2023-07-11T00:00:17.397331+0000","last_became_peered":"2023-07-11T00:00:17.397331+0000","last_unstale":"2023-07-11T00:00:18.506589+0000","last_undegraded":"2023-07-11T00:00:18.506589+0000","last_fullsized":"2023-07-11T00:00:18.506589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008780+0000","last_change":"2023-07-11T00:00:16.385414+0000","last_active":"2023-07-11T00:00:19.008780+0000","last_peered":"2023-07-11T00:00:19.008780+0000","last_clean":"2023-07-11T00:00:19.008780+0000","last_became_active":"2023-07-11T00:00:16.385078+0000","last_became_peered":"2023-07-11T00:00:16.385078+0000","last_unstale":"2023-07-11T00:00:19.008780+0000","last_undegraded":"2023-07-11T00:00:19.008780+0000","last_fullsized":"2023-07-11T00:00:19.008780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:48.090690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009326+0000","last_change":"2023-07-11T00:00:17.394701+0000","last_active":"2023-07-11T00:00:19.009326+0000","last_peered":"2023-07-11T00:00:19.009326+0000","last_clean":"2023-07-11T00:00:19.009326+0000","last_became_active":"2023-07-11T00:00:17.394427+0000","last_became_peered":"2023-07-11T00:00:17.394427+0000","last_unstale":"2023-07-11T00:00:19.009326+0000","last_undegraded":"2023-07-11T00:00:19.009326+0000","last_fullsized":"2023-07-11T00:00:19.009326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:18:53.735358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374476+0000","last_change":"2023-07-11T00:00:16.379119+0000","last_active":"2023-07-11T00:00:18.374476+0000","last_peered":"2023-07-11T00:00:18.374476+0000","last_clean":"2023-07-11T00:00:18.374476+0000","last_became_active":"2023-07-11T00:00:16.378596+0000","last_became_peered":"2023-07-11T00:00:16.378596+0000","last_unstale":"2023-07-11T00:00:18.374476+0000","last_undegraded":"2023-07-11T00:00:18.374476+0000","last_fullsized":"2023-07-11T00:00:18.374476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:48.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009450+0000","last_change":"2023-07-11T00:00:17.392798+0000","last_active":"2023-07-11T00:00:19.009450+0000","last_peered":"2023-07-11T00:00:19.009450+0000","last_clean":"2023-07-11T00:00:19.009450+0000","last_became_active":"2023-07-11T00:00:17.392534+0000","last_became_peered":"2023-07-11T00:00:17.392534+0000","last_unstale":"2023-07-11T00:00:19.009450+0000","last_undegraded":"2023-07-11T00:00:19.009450+0000","last_fullsized":"2023-07-11T00:00:19.009450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:18.979975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008294+0000","last_change":"2023-07-11T00:00:16.381752+0000","last_active":"2023-07-11T00:00:19.008294+0000","last_peered":"2023-07-11T00:00:19.008294+0000","last_clean":"2023-07-11T00:00:19.008294+0000","last_became_active":"2023-07-11T00:00:16.381446+0000","last_became_peered":"2023-07-11T00:00:16.381446+0000","last_unstale":"2023-07-11T00:00:19.008294+0000","last_undegraded":"2023-07-11T00:00:19.008294+0000","last_fullsized":"2023-07-11T00:00:19.008294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:28.418665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009436+0000","last_change":"2023-07-11T00:00:17.381280+0000","last_active":"2023-07-11T00:00:19.009436+0000","last_peered":"2023-07-11T00:00:19.009436+0000","last_clean":"2023-07-11T00:00:19.009436+0000","last_became_active":"2023-07-11T00:00:17.380991+0000","last_became_peered":"2023-07-11T00:00:17.380991+0000","last_unstale":"2023-07-11T00:00:19.009436+0000","last_undegraded":"2023-07-11T00:00:19.009436+0000","last_fullsized":"2023-07-11T00:00:19.009436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:17:21.838060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008404+0000","last_change":"2023-07-11T00:00:16.385241+0000","last_active":"2023-07-11T00:00:19.008404+0000","last_peered":"2023-07-11T00:00:19.008404+0000","last_clean":"2023-07-11T00:00:19.008404+0000","last_became_active":"2023-07-11T00:00:16.384948+0000","last_became_peered":"2023-07-11T00:00:16.384948+0000","last_unstale":"2023-07-11T00:00:19.008404+0000","last_undegraded":"2023-07-11T00:00:19.008404+0000","last_fullsized":"2023-07-11T00:00:19.008404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:44.852995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373444+0000","last_change":"2023-07-11T00:00:17.394512+0000","last_active":"2023-07-11T00:00:18.373444+0000","last_peered":"2023-07-11T00:00:18.373444+0000","last_clean":"2023-07-11T00:00:18.373444+0000","last_became_active":"2023-07-11T00:00:17.394195+0000","last_became_peered":"2023-07-11T00:00:17.394195+0000","last_unstale":"2023-07-11T00:00:18.373444+0000","last_undegraded":"2023-07-11T00:00:18.373444+0000","last_fullsized":"2023-07-11T00:00:18.373444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008794+0000","last_change":"2023-07-11T00:00:16.385203+0000","last_active":"2023-07-11T00:00:19.008794+0000","last_peered":"2023-07-11T00:00:19.008794+0000","last_clean":"2023-07-11T00:00:19.008794+0000","last_became_active":"2023-07-11T00:00:16.384926+0000","last_became_peered":"2023-07-11T00:00:16.384926+0000","last_unstale":"2023-07-11T00:00:19.008794+0000","last_undegraded":"2023-07-11T00:00:19.008794+0000","last_fullsized":"2023-07-11T00:00:19.008794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:02.541167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009209+0000","last_change":"2023-07-11T00:00:11.737777+0000","last_active":"2023-07-11T00:00:19.009209+0000","last_peered":"2023-07-11T00:00:19.009209+0000","last_clean":"2023-07-11T00:00:19.009209+0000","last_became_active":"2023-07-11T00:00:11.737518+0000","last_became_peered":"2023-07-11T00:00:11.737518+0000","last_unstale":"2023-07-11T00:00:19.009209+0000","last_undegraded":"2023-07-11T00:00:19.009209+0000","last_fullsized":"2023-07-11T00:00:19.009209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:34:14.575826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007733+0000","last_change":"2023-07-11T00:00:17.392911+0000","last_active":"2023-07-11T00:00:19.007733+0000","last_peered":"2023-07-11T00:00:19.007733+0000","last_clean":"2023-07-11T00:00:19.007733+0000","last_became_active":"2023-07-11T00:00:17.392614+0000","last_became_peered":"2023-07-11T00:00:17.392614+0000","last_unstale":"2023-07-11T00:00:19.007733+0000","last_undegraded":"2023-07-11T00:00:19.007733+0000","last_fullsized":"2023-07-11T00:00:19.007733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008255+0000","last_change":"2023-07-11T00:00:11.270609+0000","last_active":"2023-07-11T00:00:19.008255+0000","last_peered":"2023-07-11T00:00:19.008255+0000","last_clean":"2023-07-11T00:00:19.008255+0000","last_became_active":"2023-07-11T00:00:11.270289+0000","last_became_peered":"2023-07-11T00:00:11.270289+0000","last_unstale":"2023-07-11T00:00:19.008255+0000","last_undegraded":"2023-07-11T00:00:19.008255+0000","last_fullsized":"2023-07-11T00:00:19.008255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:51.405247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506875+0000","last_change":"2023-07-11T00:00:16.381972+0000","last_active":"2023-07-11T00:00:18.506875+0000","last_peered":"2023-07-11T00:00:18.506875+0000","last_clean":"2023-07-11T00:00:18.506875+0000","last_became_active":"2023-07-11T00:00:16.381691+0000","last_became_peered":"2023-07-11T00:00:16.381691+0000","last_unstale":"2023-07-11T00:00:18.506875+0000","last_undegraded":"2023-07-11T00:00:18.506875+0000","last_fullsized":"2023-07-11T00:00:18.506875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:04.291692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008189+0000","last_change":"2023-07-11T00:00:17.380382+0000","last_active":"2023-07-11T00:00:19.008189+0000","last_peered":"2023-07-11T00:00:19.008189+0000","last_clean":"2023-07-11T00:00:19.008189+0000","last_became_active":"2023-07-11T00:00:17.380071+0000","last_became_peered":"2023-07-11T00:00:17.380071+0000","last_unstale":"2023-07-11T00:00:19.008189+0000","last_undegraded":"2023-07-11T00:00:19.008189+0000","last_fullsized":"2023-07-11T00:00:19.008189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:16.918740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372829+0000","last_change":"2023-07-11T00:00:11.269546+0000","last_active":"2023-07-11T00:00:18.372829+0000","last_peered":"2023-07-11T00:00:18.372829+0000","last_clean":"2023-07-11T00:00:18.372829+0000","last_became_active":"2023-07-11T00:00:11.269178+0000","last_became_peered":"2023-07-11T00:00:11.269178+0000","last_unstale":"2023-07-11T00:00:18.372829+0000","last_undegraded":"2023-07-11T00:00:18.372829+0000","last_fullsized":"2023-07-11T00:00:18.372829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:43.866553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008074+0000","last_change":"2023-07-11T00:00:11.270402+0000","last_active":"2023-07-11T00:00:19.008074+0000","last_peered":"2023-07-11T00:00:19.008074+0000","last_clean":"2023-07-11T00:00:19.008074+0000","last_became_active":"2023-07-11T00:00:11.270024+0000","last_became_peered":"2023-07-11T00:00:11.270024+0000","last_unstale":"2023-07-11T00:00:19.008074+0000","last_undegraded":"2023-07-11T00:00:19.008074+0000","last_fullsized":"2023-07-11T00:00:19.008074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:44.333198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506429+0000","last_change":"2023-07-11T00:00:16.384464+0000","last_active":"2023-07-11T00:00:18.506429+0000","last_peered":"2023-07-11T00:00:18.506429+0000","last_clean":"2023-07-11T00:00:18.506429+0000","last_became_active":"2023-07-11T00:00:16.384194+0000","last_became_peered":"2023-07-11T00:00:16.384194+0000","last_unstale":"2023-07-11T00:00:18.506429+0000","last_undegraded":"2023-07-11T00:00:18.506429+0000","last_fullsized":"2023-07-11T00:00:18.506429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:16.741566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506745+0000","last_change":"2023-07-11T00:00:17.398420+0000","last_active":"2023-07-11T00:00:18.506745+0000","last_peered":"2023-07-11T00:00:18.506745+0000","last_clean":"2023-07-11T00:00:18.506745+0000","last_became_active":"2023-07-11T00:00:17.398014+0000","last_became_peered":"2023-07-11T00:00:17.398014+0000","last_unstale":"2023-07-11T00:00:18.506745+0000","last_undegraded":"2023-07-11T00:00:18.506745+0000","last_fullsized":"2023-07-11T00:00:18.506745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008280+0000","last_change":"2023-07-11T00:00:11.518743+0000","last_active":"2023-07-11T00:00:19.008280+0000","last_peered":"2023-07-11T00:00:19.008280+0000","last_clean":"2023-07-11T00:00:19.008280+0000","last_became_active":"2023-07-11T00:00:11.518395+0000","last_became_peered":"2023-07-11T00:00:11.518395+0000","last_unstale":"2023-07-11T00:00:19.008280+0000","last_undegraded":"2023-07-11T00:00:19.008280+0000","last_fullsized":"2023-07-11T00:00:19.008280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:42.982331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372725+0000","last_change":"2023-07-11T00:00:16.379506+0000","last_active":"2023-07-11T00:00:18.372725+0000","last_peered":"2023-07-11T00:00:18.372725+0000","last_clean":"2023-07-11T00:00:18.372725+0000","last_became_active":"2023-07-11T00:00:16.379263+0000","last_became_peered":"2023-07-11T00:00:16.379263+0000","last_unstale":"2023-07-11T00:00:18.372725+0000","last_undegraded":"2023-07-11T00:00:18.372725+0000","last_fullsized":"2023-07-11T00:00:18.372725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:43:40.599156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373432+0000","last_change":"2023-07-11T00:00:17.387290+0000","last_active":"2023-07-11T00:00:18.373432+0000","last_peered":"2023-07-11T00:00:18.373432+0000","last_clean":"2023-07-11T00:00:18.373432+0000","last_became_active":"2023-07-11T00:00:17.386701+0000","last_became_peered":"2023-07-11T00:00:17.386701+0000","last_unstale":"2023-07-11T00:00:18.373432+0000","last_undegraded":"2023-07-11T00:00:18.373432+0000","last_fullsized":"2023-07-11T00:00:18.373432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007892+0000","last_change":"2023-07-11T00:00:11.518875+0000","last_active":"2023-07-11T00:00:19.007892+0000","last_peered":"2023-07-11T00:00:19.007892+0000","last_clean":"2023-07-11T00:00:19.007892+0000","last_became_active":"2023-07-11T00:00:11.518595+0000","last_became_peered":"2023-07-11T00:00:11.518595+0000","last_unstale":"2023-07-11T00:00:19.007892+0000","last_undegraded":"2023-07-11T00:00:19.007892+0000","last_fullsized":"2023-07-11T00:00:19.007892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:51.405247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008089+0000","last_change":"2023-07-11T00:00:16.384893+0000","last_active":"2023-07-11T00:00:19.008089+0000","last_peered":"2023-07-11T00:00:19.008089+0000","last_clean":"2023-07-11T00:00:19.008089+0000","last_became_active":"2023-07-11T00:00:16.384614+0000","last_became_peered":"2023-07-11T00:00:16.384614+0000","last_unstale":"2023-07-11T00:00:19.008089+0000","last_undegraded":"2023-07-11T00:00:19.008089+0000","last_fullsized":"2023-07-11T00:00:19.008089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:15.913324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374261+0000","last_change":"2023-07-11T00:00:17.381906+0000","last_active":"2023-07-11T00:00:18.374261+0000","last_peered":"2023-07-11T00:00:18.374261+0000","last_clean":"2023-07-11T00:00:18.374261+0000","last_became_active":"2023-07-11T00:00:17.381630+0000","last_became_peered":"2023-07-11T00:00:17.381630+0000","last_unstale":"2023-07-11T00:00:18.374261+0000","last_undegraded":"2023-07-11T00:00:18.374261+0000","last_fullsized":"2023-07-11T00:00:18.374261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:12:05.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373405+0000","last_change":"2023-07-11T00:00:11.518769+0000","last_active":"2023-07-11T00:00:18.373405+0000","last_peered":"2023-07-11T00:00:18.373405+0000","last_clean":"2023-07-11T00:00:18.373405+0000","last_became_active":"2023-07-11T00:00:11.518440+0000","last_became_peered":"2023-07-11T00:00:11.518440+0000","last_unstale":"2023-07-11T00:00:18.373405+0000","last_undegraded":"2023-07-11T00:00:18.373405+0000","last_fullsized":"2023-07-11T00:00:18.373405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:11.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009013+0000","last_change":"2023-07-11T00:00:16.384509+0000","last_active":"2023-07-11T00:00:19.009013+0000","last_peered":"2023-07-11T00:00:19.009013+0000","last_clean":"2023-07-11T00:00:19.009013+0000","last_became_active":"2023-07-11T00:00:16.384064+0000","last_became_peered":"2023-07-11T00:00:16.384064+0000","last_unstale":"2023-07-11T00:00:19.009013+0000","last_undegraded":"2023-07-11T00:00:19.009013+0000","last_fullsized":"2023-07-11T00:00:19.009013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:49.441556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373265+0000","last_change":"2023-07-11T00:00:17.393714+0000","last_active":"2023-07-11T00:00:18.373265+0000","last_peered":"2023-07-11T00:00:18.373265+0000","last_clean":"2023-07-11T00:00:18.373265+0000","last_became_active":"2023-07-11T00:00:17.392964+0000","last_became_peered":"2023-07-11T00:00:17.392964+0000","last_unstale":"2023-07-11T00:00:18.373265+0000","last_undegraded":"2023-07-11T00:00:18.373265+0000","last_fullsized":"2023-07-11T00:00:18.373265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:17.746982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374578+0000","last_change":"2023-07-11T00:00:11.518696+0000","last_active":"2023-07-11T00:00:18.374578+0000","last_peered":"2023-07-11T00:00:18.374578+0000","last_clean":"2023-07-11T00:00:18.374578+0000","last_became_active":"2023-07-11T00:00:11.518413+0000","last_became_peered":"2023-07-11T00:00:11.518413+0000","last_unstale":"2023-07-11T00:00:18.374578+0000","last_undegraded":"2023-07-11T00:00:18.374578+0000","last_fullsized":"2023-07-11T00:00:18.374578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:01.099550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373125+0000","last_change":"2023-07-11T00:00:16.379703+0000","last_active":"2023-07-11T00:00:18.373125+0000","last_peered":"2023-07-11T00:00:18.373125+0000","last_clean":"2023-07-11T00:00:18.373125+0000","last_became_active":"2023-07-11T00:00:16.379251+0000","last_became_peered":"2023-07-11T00:00:16.379251+0000","last_unstale":"2023-07-11T00:00:18.373125+0000","last_undegraded":"2023-07-11T00:00:18.373125+0000","last_fullsized":"2023-07-11T00:00:18.373125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:25.248576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506437+0000","last_change":"2023-07-11T00:00:17.390220+0000","last_active":"2023-07-11T00:00:18.506437+0000","last_peered":"2023-07-11T00:00:18.506437+0000","last_clean":"2023-07-11T00:00:18.506437+0000","last_became_active":"2023-07-11T00:00:17.389938+0000","last_became_peered":"2023-07-11T00:00:17.389938+0000","last_unstale":"2023-07-11T00:00:18.506437+0000","last_undegraded":"2023-07-11T00:00:18.506437+0000","last_fullsized":"2023-07-11T00:00:18.506437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374335+0000","last_change":"2023-07-11T00:00:11.269674+0000","last_active":"2023-07-11T00:00:18.374335+0000","last_peered":"2023-07-11T00:00:18.374335+0000","last_clean":"2023-07-11T00:00:18.374335+0000","last_became_active":"2023-07-11T00:00:11.269355+0000","last_became_peered":"2023-07-11T00:00:11.269355+0000","last_unstale":"2023-07-11T00:00:18.374335+0000","last_undegraded":"2023-07-11T00:00:18.374335+0000","last_fullsized":"2023-07-11T00:00:18.374335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:20.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373947+0000","last_change":"2023-07-11T00:00:16.386828+0000","last_active":"2023-07-11T00:00:18.373947+0000","last_peered":"2023-07-11T00:00:18.373947+0000","last_clean":"2023-07-11T00:00:18.373947+0000","last_became_active":"2023-07-11T00:00:16.386586+0000","last_became_peered":"2023-07-11T00:00:16.386586+0000","last_unstale":"2023-07-11T00:00:18.373947+0000","last_undegraded":"2023-07-11T00:00:18.373947+0000","last_fullsized":"2023-07-11T00:00:18.373947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:15.913324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372814+0000","last_change":"2023-07-11T00:00:17.393914+0000","last_active":"2023-07-11T00:00:18.372814+0000","last_peered":"2023-07-11T00:00:18.372814+0000","last_clean":"2023-07-11T00:00:18.372814+0000","last_became_active":"2023-07-11T00:00:17.392216+0000","last_became_peered":"2023-07-11T00:00:17.392216+0000","last_unstale":"2023-07-11T00:00:18.372814+0000","last_undegraded":"2023-07-11T00:00:18.372814+0000","last_fullsized":"2023-07-11T00:00:18.372814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:57:15.870619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506667+0000","last_change":"2023-07-11T00:00:16.383581+0000","last_active":"2023-07-11T00:00:18.506667+0000","last_peered":"2023-07-11T00:00:18.506667+0000","last_clean":"2023-07-11T00:00:18.506667+0000","last_became_active":"2023-07-11T00:00:16.383295+0000","last_became_peered":"2023-07-11T00:00:16.383295+0000","last_unstale":"2023-07-11T00:00:18.506667+0000","last_undegraded":"2023-07-11T00:00:18.506667+0000","last_fullsized":"2023-07-11T00:00:18.506667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:17.100187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008310+0000","last_change":"2023-07-11T00:00:17.398128+0000","last_active":"2023-07-11T00:00:19.008310+0000","last_peered":"2023-07-11T00:00:19.008310+0000","last_clean":"2023-07-11T00:00:19.008310+0000","last_became_active":"2023-07-11T00:00:17.397851+0000","last_became_peered":"2023-07-11T00:00:17.397851+0000","last_unstale":"2023-07-11T00:00:19.008310+0000","last_undegraded":"2023-07-11T00:00:19.008310+0000","last_fullsized":"2023-07-11T00:00:19.008310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:00:40.235957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373474+0000","last_change":"2023-07-11T00:00:16.382786+0000","last_active":"2023-07-11T00:00:18.373474+0000","last_peered":"2023-07-11T00:00:18.373474+0000","last_clean":"2023-07-11T00:00:18.373474+0000","last_became_active":"2023-07-11T00:00:16.382519+0000","last_became_peered":"2023-07-11T00:00:16.382519+0000","last_unstale":"2023-07-11T00:00:18.373474+0000","last_undegraded":"2023-07-11T00:00:18.373474+0000","last_fullsized":"2023-07-11T00:00:18.373474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:28.631488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008963+0000","last_change":"2023-07-11T00:00:17.396289+0000","last_active":"2023-07-11T00:00:19.008963+0000","last_peered":"2023-07-11T00:00:19.008963+0000","last_clean":"2023-07-11T00:00:19.008963+0000","last_became_active":"2023-07-11T00:00:17.395948+0000","last_became_peered":"2023-07-11T00:00:17.395948+0000","last_unstale":"2023-07-11T00:00:19.008963+0000","last_undegraded":"2023-07-11T00:00:19.008963+0000","last_fullsized":"2023-07-11T00:00:19.008963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373988+0000","last_change":"2023-07-11T00:00:16.381779+0000","last_active":"2023-07-11T00:00:18.373988+0000","last_peered":"2023-07-11T00:00:18.373988+0000","last_clean":"2023-07-11T00:00:18.373988+0000","last_became_active":"2023-07-11T00:00:16.381496+0000","last_became_peered":"2023-07-11T00:00:16.381496+0000","last_unstale":"2023-07-11T00:00:18.373988+0000","last_undegraded":"2023-07-11T00:00:18.373988+0000","last_fullsized":"2023-07-11T00:00:18.373988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:04.291692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008966+0000","last_change":"2023-07-11T00:00:17.392394+0000","last_active":"2023-07-11T00:00:19.008966+0000","last_peered":"2023-07-11T00:00:19.008966+0000","last_clean":"2023-07-11T00:00:19.008966+0000","last_became_active":"2023-07-11T00:00:17.391500+0000","last_became_peered":"2023-07-11T00:00:17.391500+0000","last_unstale":"2023-07-11T00:00:19.008966+0000","last_undegraded":"2023-07-11T00:00:19.008966+0000","last_fullsized":"2023-07-11T00:00:19.008966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:45.858410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008803+0000","last_change":"2023-07-11T00:00:16.384057+0000","last_active":"2023-07-11T00:00:19.008803+0000","last_peered":"2023-07-11T00:00:19.008803+0000","last_clean":"2023-07-11T00:00:19.008803+0000","last_became_active":"2023-07-11T00:00:16.383707+0000","last_became_peered":"2023-07-11T00:00:16.383707+0000","last_unstale":"2023-07-11T00:00:19.008803+0000","last_undegraded":"2023-07-11T00:00:19.008803+0000","last_fullsized":"2023-07-11T00:00:19.008803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:32.545716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007992+0000","last_change":"2023-07-11T00:00:17.393506+0000","last_active":"2023-07-11T00:00:19.007992+0000","last_peered":"2023-07-11T00:00:19.007992+0000","last_clean":"2023-07-11T00:00:19.007992+0000","last_became_active":"2023-07-11T00:00:17.392891+0000","last_became_peered":"2023-07-11T00:00:17.392891+0000","last_unstale":"2023-07-11T00:00:19.007992+0000","last_undegraded":"2023-07-11T00:00:19.007992+0000","last_fullsized":"2023-07-11T00:00:19.007992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506934+0000","last_change":"2023-07-11T00:00:16.386794+0000","last_active":"2023-07-11T00:00:18.506934+0000","last_peered":"2023-07-11T00:00:18.506934+0000","last_clean":"2023-07-11T00:00:18.506934+0000","last_became_active":"2023-07-11T00:00:16.386581+0000","last_became_peered":"2023-07-11T00:00:16.386581+0000","last_unstale":"2023-07-11T00:00:18.506934+0000","last_undegraded":"2023-07-11T00:00:18.506934+0000","last_fullsized":"2023-07-11T00:00:18.506934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:44.852995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007926+0000","last_change":"2023-07-11T00:00:17.383214+0000","last_active":"2023-07-11T00:00:19.007926+0000","last_peered":"2023-07-11T00:00:19.007926+0000","last_clean":"2023-07-11T00:00:19.007926+0000","last_became_active":"2023-07-11T00:00:17.381360+0000","last_became_peered":"2023-07-11T00:00:17.381360+0000","last_unstale":"2023-07-11T00:00:19.007926+0000","last_undegraded":"2023-07-11T00:00:19.007926+0000","last_fullsized":"2023-07-11T00:00:19.007926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373840+0000","last_change":"2023-07-11T00:00:17.392151+0000","last_active":"2023-07-11T00:00:18.373840+0000","last_peered":"2023-07-11T00:00:18.373840+0000","last_clean":"2023-07-11T00:00:18.373840+0000","last_became_active":"2023-07-11T00:00:17.391869+0000","last_became_peered":"2023-07-11T00:00:17.391869+0000","last_unstale":"2023-07-11T00:00:18.373840+0000","last_undegraded":"2023-07-11T00:00:18.373840+0000","last_fullsized":"2023-07-11T00:00:18.373840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:04:27.161083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007854+0000","last_change":"2023-07-11T00:00:17.400395+0000","last_active":"2023-07-11T00:00:19.007854+0000","last_peered":"2023-07-11T00:00:19.007854+0000","last_clean":"2023-07-11T00:00:19.007854+0000","last_became_active":"2023-07-11T00:00:17.400124+0000","last_became_peered":"2023-07-11T00:00:17.400124+0000","last_unstale":"2023-07-11T00:00:19.007854+0000","last_undegraded":"2023-07-11T00:00:19.007854+0000","last_fullsized":"2023-07-11T00:00:19.007854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008468+0000","last_change":"2023-07-11T00:00:17.388655+0000","last_active":"2023-07-11T00:00:19.008468+0000","last_peered":"2023-07-11T00:00:19.008468+0000","last_clean":"2023-07-11T00:00:19.008468+0000","last_became_active":"2023-07-11T00:00:17.388372+0000","last_became_peered":"2023-07-11T00:00:17.388372+0000","last_unstale":"2023-07-11T00:00:19.008468+0000","last_undegraded":"2023-07-11T00:00:19.008468+0000","last_fullsized":"2023-07-11T00:00:19.008468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:05.297107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008602+0000","last_change":"2023-07-11T00:00:17.394965+0000","last_active":"2023-07-11T00:00:19.008602+0000","last_peered":"2023-07-11T00:00:19.008602+0000","last_clean":"2023-07-11T00:00:19.008602+0000","last_became_active":"2023-07-11T00:00:17.394513+0000","last_became_peered":"2023-07-11T00:00:17.394513+0000","last_unstale":"2023-07-11T00:00:19.008602+0000","last_undegraded":"2023-07-11T00:00:19.008602+0000","last_fullsized":"2023-07-11T00:00:19.008602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:50.446972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373114+0000","last_change":"2023-07-11T00:00:17.384534+0000","last_active":"2023-07-11T00:00:18.373114+0000","last_peered":"2023-07-11T00:00:18.373114+0000","last_clean":"2023-07-11T00:00:18.373114+0000","last_became_active":"2023-07-11T00:00:17.382062+0000","last_became_peered":"2023-07-11T00:00:17.382062+0000","last_unstale":"2023-07-11T00:00:18.373114+0000","last_undegraded":"2023-07-11T00:00:18.373114+0000","last_fullsized":"2023-07-11T00:00:18.373114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:10:20.060069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":664594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":72536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":74066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:00:21.550 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:00:21.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.704+0000 7fc08714f700 1 Processor -- start 2023-07-11T00:00:21.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.704+0000 7fc08714f700 1 -- start start 2023-07-11T00:00:21.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.704+0000 7fc08714f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 0x7fc0800b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.704+0000 7fc08714f700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc08014aa40 0x7fc08014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.704+0000 7fc08714f700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc080070410 con 0x7fc0801444c0 2023-07-11T00:00:21.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.704+0000 7fc08714f700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0800b9590 con 0x7fc08014aa40 2023-07-11T00:00:21.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.705+0000 7fc08714f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08014b3d0 con 0x7fc08006b120 2023-07-11T00:00:21.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.705+0000 7fc084eeb700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 0x7fc0800b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.705+0000 7fc07ffff700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc08014aa40 0x7fc08014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.705+0000 7fc084eeb700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 0x7fc0800b8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42634/0 (socket says 172.21.15.38:42634) 2023-07-11T00:00:21.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.705+0000 7fc07ffff700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc08014aa40 0x7fc08014ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53166/0 (socket says 172.21.15.38:53166) 2023-07-11T00:00:21.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.705+0000 7fc084eeb700 1 -- 172.21.15.38:0/2350711675 learned_addr learned my addr 172.21.15.38:0/2350711675 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:21.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.705+0000 7fc084eeb700 1 -- 172.21.15.38:0/2350711675 >> v2:172.21.15.70:3300/0 conn(0x7fc08014aa40 msgr2=0x7fc08014ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:21.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.705+0000 7fc084eeb700 1 --2- 172.21.15.38:0/2350711675 >> v2:172.21.15.70:3300/0 conn(0x7fc08014aa40 0x7fc08014ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.705+0000 7fc084eeb700 1 -- 172.21.15.38:0/2350711675 >> v1:172.21.15.70:6789/0 conn(0x7fc0801444c0 legacy=0x7fc080144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.705+0000 7fc084eeb700 1 -- 172.21.15.38:0/2350711675 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08006ef60 con 0x7fc08006b120 2023-07-11T00:00:21.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.705+0000 7fc084eeb700 1 --2- 172.21.15.38:0/2350711675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 0x7fc0800b8cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc0740098f0 tx=0x7fc074009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd8a9305734dc3d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:21.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.706+0000 7fc07f7fe700 1 -- 172.21.15.38:0/2350711675 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074011830 con 0x7fc08006b120 2023-07-11T00:00:21.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.706+0000 7fc07f7fe700 1 -- 172.21.15.38:0/2350711675 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074011990 con 0x7fc08006b120 2023-07-11T00:00:21.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.706+0000 7fc07f7fe700 1 -- 172.21.15.38:0/2350711675 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074011d20 con 0x7fc08006b120 2023-07-11T00:00:21.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.706+0000 7fc08714f700 1 -- 172.21.15.38:0/2350711675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 msgr2=0x7fc0800b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.706+0000 7fc08714f700 1 --2- 172.21.15.38:0/2350711675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 0x7fc0800b8cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc0740098f0 tx=0x7fc074009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:21.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.706+0000 7fc08714f700 1 -- 172.21.15.38:0/2350711675 shutdown_connections 2023-07-11T00:00:21.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.706+0000 7fc08714f700 1 --2- 172.21.15.38:0/2350711675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 0x7fc0800b8cd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.706+0000 7fc08714f700 1 --2- 172.21.15.38:0/2350711675 >> v2:172.21.15.70:3300/0 conn(0x7fc08014aa40 0x7fc08014ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.706+0000 7fc08714f700 1 -- 172.21.15.38:0/2350711675 >> 172.21.15.38:0/2350711675 conn(0x7fc0800bd980 msgr2=0x7fc0800b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:21.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.706+0000 7fc08714f700 1 -- 172.21.15.38:0/2350711675 shutdown_connections 2023-07-11T00:00:21.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.706+0000 7fc08714f700 1 -- 172.21.15.38:0/2350711675 wait complete. 2023-07-11T00:00:21.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.707+0000 7fc08714f700 1 Processor -- start 2023-07-11T00:00:21.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.707+0000 7fc08714f700 1 -- start start 2023-07-11T00:00:21.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.708+0000 7fc08714f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 0x7fc08013a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.708+0000 7fc08714f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0801444c0 0x7fc0801e37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.708+0000 7fc08714f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08014aa40 0x7fc0801e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.708+0000 7fc08714f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800b4a90 con 0x7fc0801444c0 2023-07-11T00:00:21.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.708+0000 7fc08714f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08013fd50 con 0x7fc08014aa40 2023-07-11T00:00:21.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.708+0000 7fc08714f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc080148a10 con 0x7fc08006b120 2023-07-11T00:00:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.708+0000 7fc07ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0801444c0 0x7fc0801e37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.708+0000 7fc084eeb700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 0x7fc08013a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.708+0000 7fc07ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0801444c0 0x7fc0801e37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52670/0 (socket says 172.21.15.38:52670) 2023-07-11T00:00:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.708+0000 7fc07ffff700 1 -- 172.21.15.38:0/2286620386 learned_addr learned my addr 172.21.15.38:0/2286620386 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.708+0000 7fc0856ec700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08014aa40 0x7fc0801e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc084eeb700 1 -- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08014aa40 msgr2=0x7fc0801e3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc084eeb700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08014aa40 0x7fc0801e3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc084eeb700 1 -- 172.21.15.38:0/2286620386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0801444c0 msgr2=0x7fc0801e37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc084eeb700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0801444c0 0x7fc0801e37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc084eeb700 1 -- 172.21.15.38:0/2286620386 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc074009550 con 0x7fc08006b120 2023-07-11T00:00:21.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc0856ec700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08014aa40 0x7fc0801e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:21.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc084eeb700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 0x7fc08013a200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc074016000 tx=0x7fc074004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:21.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc07d7fa700 1 -- 172.21.15.38:0/2286620386 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074004450 con 0x7fc08006b120 2023-07-11T00:00:21.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc07d7fa700 1 -- 172.21.15.38:0/2286620386 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07401e070 con 0x7fc08006b120 2023-07-11T00:00:21.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc08714f700 1 -- 172.21.15.38:0/2286620386 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc080148cf0 con 0x7fc08006b120 2023-07-11T00:00:21.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc07d7fa700 1 -- 172.21.15.38:0/2286620386 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0740038e0 con 0x7fc08006b120 2023-07-11T00:00:21.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.709+0000 7fc08714f700 1 -- 172.21.15.38:0/2286620386 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0800b4050 con 0x7fc08006b120 2023-07-11T00:00:21.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.710+0000 7fc08714f700 1 -- 172.21.15.38:0/2286620386 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc080148ed0 con 0x7fc08006b120 2023-07-11T00:00:21.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.711+0000 7fc07d7fa700 1 -- 172.21.15.38:0/2286620386 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc074003a40 con 0x7fc08006b120 2023-07-11T00:00:21.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.711+0000 7fc07d7fa700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc06406ace0 0x7fc06406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:21.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.711+0000 7fc07d7fa700 1 -- 172.21.15.38:0/2286620386 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc07408a3f0 con 0x7fc08006b120 2023-07-11T00:00:21.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.711+0000 7fc07ffff700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc06406ace0 0x7fc06406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:21.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.712+0000 7fc07ffff700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc06406ace0 0x7fc06406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009ca0 tx=0x7fc06c009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:21.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.716+0000 7fc07d7fa700 1 -- 172.21.15.38:0/2286620386 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc0740554b0 con 0x7fc08006b120 2023-07-11T00:00:21.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.911+0000 7fc08714f700 1 -- 172.21.15.38:0/2286620386 --> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc080148890 con 0x7fc06406ace0 2023-07-11T00:00:21.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.920+0000 7fc07d7fa700 1 -- 172.21.15.38:0/2286620386 <== mgr.4105 v2:172.21.15.70:6832/2073477499 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286974 (secure 0 0 0) 0x7fc06c009de0 con 0x7fc06406ace0 2023-07-11T00:00:21.925 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:21.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 -- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc06406ace0 msgr2=0x7fc06406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc06406ace0 0x7fc06406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009ca0 tx=0x7fc06c009210 comp rx=0 tx=0).stop 2023-07-11T00:00:21.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 -- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 msgr2=0x7fc08013a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:21.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 0x7fc08013a200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc074016000 tx=0x7fc074004750 comp rx=0 tx=0).stop 2023-07-11T00:00:21.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 -- 172.21.15.38:0/2286620386 shutdown_connections 2023-07-11T00:00:21.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc06406ace0 0x7fc06406d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08014aa40 0x7fc0801e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc08006b120 0x7fc08013a200 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 --2- 172.21.15.38:0/2286620386 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0801444c0 0x7fc0801e37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:21.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 -- 172.21.15.38:0/2286620386 >> 172.21.15.38:0/2286620386 conn(0x7fc0800bd980 msgr2=0x7fc0800b96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:21.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 -- 172.21.15.38:0/2286620386 shutdown_connections 2023-07-11T00:00:21.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:21.923+0000 7fc08714f700 1 -- 172.21.15.38:0/2286620386 wait complete. 2023-07-11T00:00:21.928 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-07-11T00:00:21.937 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-07-11T00:00:19.949936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2860,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2928640,"data_stored":1784987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.589894"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008537+0000","last_change":"2023-07-11T00:00:17.397708+0000","last_active":"2023-07-11T00:00:19.008537+0000","last_peered":"2023-07-11T00:00:19.008537+0000","last_clean":"2023-07-11T00:00:19.008537+0000","last_became_active":"2023-07-11T00:00:17.397420+0000","last_became_peered":"2023-07-11T00:00:17.397420+0000","last_unstale":"2023-07-11T00:00:19.008537+0000","last_undegraded":"2023-07-11T00:00:19.008537+0000","last_fullsized":"2023-07-11T00:00:19.008537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:36:59.464113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373811+0000","last_change":"2023-07-11T00:00:17.397645+0000","last_active":"2023-07-11T00:00:18.373811+0000","last_peered":"2023-07-11T00:00:18.373811+0000","last_clean":"2023-07-11T00:00:18.373811+0000","last_became_active":"2023-07-11T00:00:17.397379+0000","last_became_peered":"2023-07-11T00:00:17.397379+0000","last_unstale":"2023-07-11T00:00:18.373811+0000","last_undegraded":"2023-07-11T00:00:18.373811+0000","last_fullsized":"2023-07-11T00:00:18.373811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009115+0000","last_change":"2023-07-11T00:00:17.383242+0000","last_active":"2023-07-11T00:00:19.009115+0000","last_peered":"2023-07-11T00:00:19.009115+0000","last_clean":"2023-07-11T00:00:19.009115+0000","last_became_active":"2023-07-11T00:00:17.382949+0000","last_became_peered":"2023-07-11T00:00:17.382949+0000","last_unstale":"2023-07-11T00:00:19.009115+0000","last_undegraded":"2023-07-11T00:00:19.009115+0000","last_fullsized":"2023-07-11T00:00:19.009115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:03.546582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374355+0000","last_change":"2023-07-11T00:00:17.382742+0000","last_active":"2023-07-11T00:00:18.374355+0000","last_peered":"2023-07-11T00:00:18.374355+0000","last_clean":"2023-07-11T00:00:18.374355+0000","last_became_active":"2023-07-11T00:00:17.382485+0000","last_became_peered":"2023-07-11T00:00:17.382485+0000","last_unstale":"2023-07-11T00:00:18.374355+0000","last_undegraded":"2023-07-11T00:00:18.374355+0000","last_fullsized":"2023-07-11T00:00:18.374355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:10:20.060069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506405+0000","last_change":"2023-07-11T00:00:17.397047+0000","last_active":"2023-07-11T00:00:18.506405+0000","last_peered":"2023-07-11T00:00:18.506405+0000","last_clean":"2023-07-11T00:00:18.506405+0000","last_became_active":"2023-07-11T00:00:17.396780+0000","last_became_peered":"2023-07-11T00:00:17.396780+0000","last_unstale":"2023-07-11T00:00:18.506405+0000","last_undegraded":"2023-07-11T00:00:18.506405+0000","last_fullsized":"2023-07-11T00:00:18.506405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:49.980328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007933+0000","last_change":"2023-07-11T00:00:17.383091+0000","last_active":"2023-07-11T00:00:19.007933+0000","last_peered":"2023-07-11T00:00:19.007933+0000","last_clean":"2023-07-11T00:00:19.007933+0000","last_became_active":"2023-07-11T00:00:17.382732+0000","last_became_peered":"2023-07-11T00:00:17.382732+0000","last_unstale":"2023-07-11T00:00:19.007933+0000","last_undegraded":"2023-07-11T00:00:19.007933+0000","last_fullsized":"2023-07-11T00:00:19.007933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007960+0000","last_change":"2023-07-11T00:00:17.398152+0000","last_active":"2023-07-11T00:00:19.007960+0000","last_peered":"2023-07-11T00:00:19.007960+0000","last_clean":"2023-07-11T00:00:19.007960+0000","last_became_active":"2023-07-11T00:00:17.397866+0000","last_became_peered":"2023-07-11T00:00:17.397866+0000","last_unstale":"2023-07-11T00:00:19.007960+0000","last_undegraded":"2023-07-11T00:00:19.007960+0000","last_fullsized":"2023-07-11T00:00:19.007960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:45.858410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373410+0000","last_change":"2023-07-11T00:00:17.388247+0000","last_active":"2023-07-11T00:00:18.373410+0000","last_peered":"2023-07-11T00:00:18.373410+0000","last_clean":"2023-07-11T00:00:18.373410+0000","last_became_active":"2023-07-11T00:00:17.387971+0000","last_became_peered":"2023-07-11T00:00:17.387971+0000","last_unstale":"2023-07-11T00:00:18.373410+0000","last_undegraded":"2023-07-11T00:00:18.373410+0000","last_fullsized":"2023-07-11T00:00:18.373410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:49.980328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506791+0000","last_change":"2023-07-11T00:00:17.399917+0000","last_active":"2023-07-11T00:00:18.506791+0000","last_peered":"2023-07-11T00:00:18.506791+0000","last_clean":"2023-07-11T00:00:18.506791+0000","last_became_active":"2023-07-11T00:00:17.399650+0000","last_became_peered":"2023-07-11T00:00:17.399650+0000","last_unstale":"2023-07-11T00:00:18.506791+0000","last_undegraded":"2023-07-11T00:00:18.506791+0000","last_fullsized":"2023-07-11T00:00:18.506791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:16.918740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374155+0000","last_change":"2023-07-11T00:00:17.391372+0000","last_active":"2023-07-11T00:00:18.374155+0000","last_peered":"2023-07-11T00:00:18.374155+0000","last_clean":"2023-07-11T00:00:18.374155+0000","last_became_active":"2023-07-11T00:00:17.391073+0000","last_became_peered":"2023-07-11T00:00:17.391073+0000","last_unstale":"2023-07-11T00:00:18.374155+0000","last_undegraded":"2023-07-11T00:00:18.374155+0000","last_fullsized":"2023-07-11T00:00:18.374155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:57.519021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009402+0000","last_change":"2023-07-11T00:00:17.386526+0000","last_active":"2023-07-11T00:00:19.009402+0000","last_peered":"2023-07-11T00:00:19.009402+0000","last_clean":"2023-07-11T00:00:19.009402+0000","last_became_active":"2023-07-11T00:00:17.386224+0000","last_became_peered":"2023-07-11T00:00:17.386224+0000","last_unstale":"2023-07-11T00:00:19.009402+0000","last_undegraded":"2023-07-11T00:00:19.009402+0000","last_fullsized":"2023-07-11T00:00:19.009402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:33.551132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008039+0000","last_change":"2023-07-11T00:00:17.391880+0000","last_active":"2023-07-11T00:00:19.008039+0000","last_peered":"2023-07-11T00:00:19.008039+0000","last_clean":"2023-07-11T00:00:19.008039+0000","last_became_active":"2023-07-11T00:00:17.391579+0000","last_became_peered":"2023-07-11T00:00:17.391579+0000","last_unstale":"2023-07-11T00:00:19.008039+0000","last_undegraded":"2023-07-11T00:00:19.008039+0000","last_fullsized":"2023-07-11T00:00:19.008039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:36.282927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008235+0000","last_change":"2023-07-11T00:00:17.395824+0000","last_active":"2023-07-11T00:00:19.008235+0000","last_peered":"2023-07-11T00:00:19.008235+0000","last_clean":"2023-07-11T00:00:19.008235+0000","last_became_active":"2023-07-11T00:00:17.395540+0000","last_became_peered":"2023-07-11T00:00:17.395540+0000","last_unstale":"2023-07-11T00:00:19.008235+0000","last_undegraded":"2023-07-11T00:00:19.008235+0000","last_fullsized":"2023-07-11T00:00:19.008235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:12:34.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373653+0000","last_change":"2023-07-11T00:00:17.392402+0000","last_active":"2023-07-11T00:00:18.373653+0000","last_peered":"2023-07-11T00:00:18.373653+0000","last_clean":"2023-07-11T00:00:18.373653+0000","last_became_active":"2023-07-11T00:00:17.392138+0000","last_became_peered":"2023-07-11T00:00:17.392138+0000","last_unstale":"2023-07-11T00:00:18.373653+0000","last_undegraded":"2023-07-11T00:00:18.373653+0000","last_fullsized":"2023-07-11T00:00:18.373653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008481+0000","last_change":"2023-07-11T00:00:17.398211+0000","last_active":"2023-07-11T00:00:19.008481+0000","last_peered":"2023-07-11T00:00:19.008481+0000","last_clean":"2023-07-11T00:00:19.008481+0000","last_became_active":"2023-07-11T00:00:17.397884+0000","last_became_peered":"2023-07-11T00:00:17.397884+0000","last_unstale":"2023-07-11T00:00:19.008481+0000","last_undegraded":"2023-07-11T00:00:19.008481+0000","last_fullsized":"2023-07-11T00:00:19.008481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:18:53.735358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008071+0000","last_change":"2023-07-11T00:00:17.383250+0000","last_active":"2023-07-11T00:00:19.008071+0000","last_peered":"2023-07-11T00:00:19.008071+0000","last_clean":"2023-07-11T00:00:19.008071+0000","last_became_active":"2023-07-11T00:00:17.382988+0000","last_became_peered":"2023-07-11T00:00:17.382988+0000","last_unstale":"2023-07-11T00:00:19.008071+0000","last_undegraded":"2023-07-11T00:00:19.008071+0000","last_fullsized":"2023-07-11T00:00:19.008071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:40.051389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506790+0000","last_change":"2023-07-11T00:00:17.395710+0000","last_active":"2023-07-11T00:00:18.506790+0000","last_peered":"2023-07-11T00:00:18.506790+0000","last_clean":"2023-07-11T00:00:18.506790+0000","last_became_active":"2023-07-11T00:00:17.395425+0000","last_became_peered":"2023-07-11T00:00:17.395425+0000","last_unstale":"2023-07-11T00:00:18.506790+0000","last_undegraded":"2023-07-11T00:00:18.506790+0000","last_fullsized":"2023-07-11T00:00:18.506790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:40.051389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009267+0000","last_change":"2023-07-11T00:00:17.392947+0000","last_active":"2023-07-11T00:00:19.009267+0000","last_peered":"2023-07-11T00:00:19.009267+0000","last_clean":"2023-07-11T00:00:19.009267+0000","last_became_active":"2023-07-11T00:00:17.392696+0000","last_became_peered":"2023-07-11T00:00:17.392696+0000","last_unstale":"2023-07-11T00:00:19.009267+0000","last_undegraded":"2023-07-11T00:00:19.009267+0000","last_fullsized":"2023-07-11T00:00:19.009267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:51:54.640593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008178+0000","last_change":"2023-07-11T00:00:17.399163+0000","last_active":"2023-07-11T00:00:19.008178+0000","last_peered":"2023-07-11T00:00:19.008178+0000","last_clean":"2023-07-11T00:00:19.008178+0000","last_became_active":"2023-07-11T00:00:17.398876+0000","last_became_peered":"2023-07-11T00:00:17.398876+0000","last_unstale":"2023-07-11T00:00:19.008178+0000","last_undegraded":"2023-07-11T00:00:19.008178+0000","last_fullsized":"2023-07-11T00:00:19.008178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:40:09.287884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009140+0000","last_change":"2023-07-11T00:00:17.385145+0000","last_active":"2023-07-11T00:00:19.009140+0000","last_peered":"2023-07-11T00:00:19.009140+0000","last_clean":"2023-07-11T00:00:19.009140+0000","last_became_active":"2023-07-11T00:00:17.384889+0000","last_became_peered":"2023-07-11T00:00:17.384889+0000","last_unstale":"2023-07-11T00:00:19.009140+0000","last_undegraded":"2023-07-11T00:00:19.009140+0000","last_fullsized":"2023-07-11T00:00:19.009140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:49.096105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008620+0000","last_change":"2023-07-11T00:00:17.396464+0000","last_active":"2023-07-11T00:00:19.008620+0000","last_peered":"2023-07-11T00:00:19.008620+0000","last_clean":"2023-07-11T00:00:19.008620+0000","last_became_active":"2023-07-11T00:00:17.396157+0000","last_became_peered":"2023-07-11T00:00:17.396157+0000","last_unstale":"2023-07-11T00:00:19.008620+0000","last_undegraded":"2023-07-11T00:00:19.008620+0000","last_fullsized":"2023-07-11T00:00:19.008620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:56:38.988691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506379+0000","last_change":"2023-07-11T00:00:17.400807+0000","last_active":"2023-07-11T00:00:18.506379+0000","last_peered":"2023-07-11T00:00:18.506379+0000","last_clean":"2023-07-11T00:00:18.506379+0000","last_became_active":"2023-07-11T00:00:17.400518+0000","last_became_peered":"2023-07-11T00:00:17.400518+0000","last_unstale":"2023-07-11T00:00:18.506379+0000","last_undegraded":"2023-07-11T00:00:18.506379+0000","last_fullsized":"2023-07-11T00:00:18.506379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:26.253992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007811+0000","last_change":"2023-07-11T00:00:17.393536+0000","last_active":"2023-07-11T00:00:19.007811+0000","last_peered":"2023-07-11T00:00:19.007811+0000","last_clean":"2023-07-11T00:00:19.007811+0000","last_became_active":"2023-07-11T00:00:17.393218+0000","last_became_peered":"2023-07-11T00:00:17.393218+0000","last_unstale":"2023-07-11T00:00:19.007811+0000","last_undegraded":"2023-07-11T00:00:19.007811+0000","last_fullsized":"2023-07-11T00:00:19.007811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008065+0000","last_change":"2023-07-11T00:00:17.394760+0000","last_active":"2023-07-11T00:00:19.008065+0000","last_peered":"2023-07-11T00:00:19.008065+0000","last_clean":"2023-07-11T00:00:19.008065+0000","last_became_active":"2023-07-11T00:00:17.394413+0000","last_became_peered":"2023-07-11T00:00:17.394413+0000","last_unstale":"2023-07-11T00:00:19.008065+0000","last_undegraded":"2023-07-11T00:00:19.008065+0000","last_fullsized":"2023-07-11T00:00:19.008065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373353+0000","last_change":"2023-07-11T00:00:17.392669+0000","last_active":"2023-07-11T00:00:18.373353+0000","last_peered":"2023-07-11T00:00:18.373353+0000","last_clean":"2023-07-11T00:00:18.373353+0000","last_became_active":"2023-07-11T00:00:17.392196+0000","last_became_peered":"2023-07-11T00:00:17.392196+0000","last_unstale":"2023-07-11T00:00:18.373353+0000","last_undegraded":"2023-07-11T00:00:18.373353+0000","last_fullsized":"2023-07-11T00:00:18.373353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373327+0000","last_change":"2023-07-11T00:00:17.393336+0000","last_active":"2023-07-11T00:00:18.373327+0000","last_peered":"2023-07-11T00:00:18.373327+0000","last_clean":"2023-07-11T00:00:18.373327+0000","last_became_active":"2023-07-11T00:00:17.393012+0000","last_became_peered":"2023-07-11T00:00:17.393012+0000","last_unstale":"2023-07-11T00:00:18.373327+0000","last_undegraded":"2023-07-11T00:00:18.373327+0000","last_fullsized":"2023-07-11T00:00:18.373327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373803+0000","last_change":"2023-07-11T00:00:17.391606+0000","last_active":"2023-07-11T00:00:18.373803+0000","last_peered":"2023-07-11T00:00:18.373803+0000","last_clean":"2023-07-11T00:00:18.373803+0000","last_became_active":"2023-07-11T00:00:17.391040+0000","last_became_peered":"2023-07-11T00:00:17.391040+0000","last_unstale":"2023-07-11T00:00:18.373803+0000","last_undegraded":"2023-07-11T00:00:18.373803+0000","last_fullsized":"2023-07-11T00:00:18.373803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008846+0000","last_change":"2023-07-11T00:00:16.382120+0000","last_active":"2023-07-11T00:00:19.008846+0000","last_peered":"2023-07-11T00:00:19.008846+0000","last_clean":"2023-07-11T00:00:19.008846+0000","last_became_active":"2023-07-11T00:00:16.381850+0000","last_became_peered":"2023-07-11T00:00:16.381850+0000","last_unstale":"2023-07-11T00:00:19.008846+0000","last_undegraded":"2023-07-11T00:00:19.008846+0000","last_fullsized":"2023-07-11T00:00:19.008846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:56.513606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008521+0000","last_change":"2023-07-11T00:00:17.399984+0000","last_active":"2023-07-11T00:00:19.008521+0000","last_peered":"2023-07-11T00:00:19.008521+0000","last_clean":"2023-07-11T00:00:19.008521+0000","last_became_active":"2023-07-11T00:00:17.399791+0000","last_became_peered":"2023-07-11T00:00:17.399791+0000","last_unstale":"2023-07-11T00:00:19.008521+0000","last_undegraded":"2023-07-11T00:00:19.008521+0000","last_fullsized":"2023-07-11T00:00:19.008521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372863+0000","last_change":"2023-07-11T00:00:16.386771+0000","last_active":"2023-07-11T00:00:18.372863+0000","last_peered":"2023-07-11T00:00:18.372863+0000","last_clean":"2023-07-11T00:00:18.372863+0000","last_became_active":"2023-07-11T00:00:16.386510+0000","last_became_peered":"2023-07-11T00:00:16.386510+0000","last_unstale":"2023-07-11T00:00:18.372863+0000","last_undegraded":"2023-07-11T00:00:18.372863+0000","last_fullsized":"2023-07-11T00:00:18.372863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:04:26.155667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506805+0000","last_change":"2023-07-11T00:00:17.382846+0000","last_active":"2023-07-11T00:00:18.506805+0000","last_peered":"2023-07-11T00:00:18.506805+0000","last_clean":"2023-07-11T00:00:18.506805+0000","last_became_active":"2023-07-11T00:00:17.382575+0000","last_became_peered":"2023-07-11T00:00:17.382575+0000","last_unstale":"2023-07-11T00:00:18.506805+0000","last_undegraded":"2023-07-11T00:00:18.506805+0000","last_fullsized":"2023-07-11T00:00:18.506805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:29.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008088+0000","last_change":"2023-07-11T00:00:16.385044+0000","last_active":"2023-07-11T00:00:19.008088+0000","last_peered":"2023-07-11T00:00:19.008088+0000","last_clean":"2023-07-11T00:00:19.008088+0000","last_became_active":"2023-07-11T00:00:16.384163+0000","last_became_peered":"2023-07-11T00:00:16.384163+0000","last_unstale":"2023-07-11T00:00:19.008088+0000","last_undegraded":"2023-07-11T00:00:19.008088+0000","last_fullsized":"2023-07-11T00:00:19.008088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:39.045974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374477+0000","last_change":"2023-07-11T00:00:17.386852+0000","last_active":"2023-07-11T00:00:18.374477+0000","last_peered":"2023-07-11T00:00:18.374477+0000","last_clean":"2023-07-11T00:00:18.374477+0000","last_became_active":"2023-07-11T00:00:17.386559+0000","last_became_peered":"2023-07-11T00:00:17.386559+0000","last_unstale":"2023-07-11T00:00:18.374477+0000","last_undegraded":"2023-07-11T00:00:18.374477+0000","last_fullsized":"2023-07-11T00:00:18.374477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:17.746982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506933+0000","last_change":"2023-07-11T00:00:16.386985+0000","last_active":"2023-07-11T00:00:18.506933+0000","last_peered":"2023-07-11T00:00:18.506933+0000","last_clean":"2023-07-11T00:00:18.506933+0000","last_became_active":"2023-07-11T00:00:16.386092+0000","last_became_peered":"2023-07-11T00:00:16.386092+0000","last_unstale":"2023-07-11T00:00:18.506933+0000","last_undegraded":"2023-07-11T00:00:18.506933+0000","last_fullsized":"2023-07-11T00:00:18.506933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:56.513606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007916+0000","last_change":"2023-07-11T00:00:17.400026+0000","last_active":"2023-07-11T00:00:19.007916+0000","last_peered":"2023-07-11T00:00:19.007916+0000","last_clean":"2023-07-11T00:00:19.007916+0000","last_became_active":"2023-07-11T00:00:17.399293+0000","last_became_peered":"2023-07-11T00:00:17.399293+0000","last_unstale":"2023-07-11T00:00:19.007916+0000","last_undegraded":"2023-07-11T00:00:19.007916+0000","last_fullsized":"2023-07-11T00:00:19.007916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374001+0000","last_change":"2023-07-11T00:00:16.384101+0000","last_active":"2023-07-11T00:00:18.374001+0000","last_peered":"2023-07-11T00:00:18.374001+0000","last_clean":"2023-07-11T00:00:18.374001+0000","last_became_active":"2023-07-11T00:00:16.383818+0000","last_became_peered":"2023-07-11T00:00:16.383818+0000","last_unstale":"2023-07-11T00:00:18.374001+0000","last_undegraded":"2023-07-11T00:00:18.374001+0000","last_fullsized":"2023-07-11T00:00:18.374001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:28.418665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008115+0000","last_change":"2023-07-11T00:00:17.389712+0000","last_active":"2023-07-11T00:00:19.008115+0000","last_peered":"2023-07-11T00:00:19.008115+0000","last_clean":"2023-07-11T00:00:19.008115+0000","last_became_active":"2023-07-11T00:00:17.389347+0000","last_became_peered":"2023-07-11T00:00:17.389347+0000","last_unstale":"2023-07-11T00:00:19.008115+0000","last_undegraded":"2023-07-11T00:00:19.008115+0000","last_fullsized":"2023-07-11T00:00:19.008115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:29.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008467+0000","last_change":"2023-07-11T00:00:16.389670+0000","last_active":"2023-07-11T00:00:19.008467+0000","last_peered":"2023-07-11T00:00:19.008467+0000","last_clean":"2023-07-11T00:00:19.008467+0000","last_became_active":"2023-07-11T00:00:16.389452+0000","last_became_peered":"2023-07-11T00:00:16.389452+0000","last_unstale":"2023-07-11T00:00:19.008467+0000","last_undegraded":"2023-07-11T00:00:19.008467+0000","last_fullsized":"2023-07-11T00:00:19.008467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:51:53.635178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372965+0000","last_change":"2023-07-11T00:00:17.395904+0000","last_active":"2023-07-11T00:00:18.372965+0000","last_peered":"2023-07-11T00:00:18.372965+0000","last_clean":"2023-07-11T00:00:18.372965+0000","last_became_active":"2023-07-11T00:00:17.392236+0000","last_became_peered":"2023-07-11T00:00:17.392236+0000","last_unstale":"2023-07-11T00:00:18.372965+0000","last_undegraded":"2023-07-11T00:00:18.372965+0000","last_fullsized":"2023-07-11T00:00:18.372965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:12:05.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009431+0000","last_change":"2023-07-11T00:00:16.382024+0000","last_active":"2023-07-11T00:00:19.009431+0000","last_peered":"2023-07-11T00:00:19.009431+0000","last_clean":"2023-07-11T00:00:19.009431+0000","last_became_active":"2023-07-11T00:00:16.380867+0000","last_became_peered":"2023-07-11T00:00:16.380867+0000","last_unstale":"2023-07-11T00:00:19.009431+0000","last_undegraded":"2023-07-11T00:00:19.009431+0000","last_fullsized":"2023-07-11T00:00:19.009431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:56:37.983275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009263+0000","last_change":"2023-07-11T00:00:17.378560+0000","last_active":"2023-07-11T00:00:19.009263+0000","last_peered":"2023-07-11T00:00:19.009263+0000","last_clean":"2023-07-11T00:00:19.009263+0000","last_became_active":"2023-07-11T00:00:17.378254+0000","last_became_peered":"2023-07-11T00:00:17.378254+0000","last_unstale":"2023-07-11T00:00:19.009263+0000","last_undegraded":"2023-07-11T00:00:19.009263+0000","last_fullsized":"2023-07-11T00:00:19.009263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:23.254269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008429+0000","last_change":"2023-07-11T00:00:16.384078+0000","last_active":"2023-07-11T00:00:19.008429+0000","last_peered":"2023-07-11T00:00:19.008429+0000","last_clean":"2023-07-11T00:00:19.008429+0000","last_became_active":"2023-07-11T00:00:16.383846+0000","last_became_peered":"2023-07-11T00:00:16.383846+0000","last_unstale":"2023-07-11T00:00:19.008429+0000","last_undegraded":"2023-07-11T00:00:19.008429+0000","last_fullsized":"2023-07-11T00:00:19.008429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:22.248854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008163+0000","last_change":"2023-07-11T00:00:17.399815+0000","last_active":"2023-07-11T00:00:19.008163+0000","last_peered":"2023-07-11T00:00:19.008163+0000","last_clean":"2023-07-11T00:00:19.008163+0000","last_became_active":"2023-07-11T00:00:17.399521+0000","last_became_peered":"2023-07-11T00:00:17.399521+0000","last_unstale":"2023-07-11T00:00:19.008163+0000","last_undegraded":"2023-07-11T00:00:19.008163+0000","last_fullsized":"2023-07-11T00:00:19.008163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:05.297107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506521+0000","last_change":"2023-07-11T00:00:16.380652+0000","last_active":"2023-07-11T00:00:18.506521+0000","last_peered":"2023-07-11T00:00:18.506521+0000","last_clean":"2023-07-11T00:00:18.506521+0000","last_became_active":"2023-07-11T00:00:16.380380+0000","last_became_peered":"2023-07-11T00:00:16.380380+0000","last_unstale":"2023-07-11T00:00:18.506521+0000","last_undegraded":"2023-07-11T00:00:18.506521+0000","last_fullsized":"2023-07-11T00:00:18.506521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:06.207909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373844+0000","last_change":"2023-07-11T00:00:17.390008+0000","last_active":"2023-07-11T00:00:18.373844+0000","last_peered":"2023-07-11T00:00:18.373844+0000","last_clean":"2023-07-11T00:00:18.373844+0000","last_became_active":"2023-07-11T00:00:17.389740+0000","last_became_peered":"2023-07-11T00:00:17.389740+0000","last_unstale":"2023-07-11T00:00:18.373844+0000","last_undegraded":"2023-07-11T00:00:18.373844+0000","last_fullsized":"2023-07-11T00:00:18.373844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008147+0000","last_change":"2023-07-11T00:00:16.383128+0000","last_active":"2023-07-11T00:00:19.008147+0000","last_peered":"2023-07-11T00:00:19.008147+0000","last_clean":"2023-07-11T00:00:19.008147+0000","last_became_active":"2023-07-11T00:00:16.382870+0000","last_became_peered":"2023-07-11T00:00:16.382870+0000","last_unstale":"2023-07-11T00:00:19.008147+0000","last_undegraded":"2023-07-11T00:00:19.008147+0000","last_fullsized":"2023-07-11T00:00:19.008147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:02.541167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506680+0000","last_change":"2023-07-11T00:00:17.394408+0000","last_active":"2023-07-11T00:00:18.506680+0000","last_peered":"2023-07-11T00:00:18.506680+0000","last_clean":"2023-07-11T00:00:18.506680+0000","last_became_active":"2023-07-11T00:00:17.394079+0000","last_became_peered":"2023-07-11T00:00:17.394079+0000","last_unstale":"2023-07-11T00:00:18.506680+0000","last_undegraded":"2023-07-11T00:00:18.506680+0000","last_fullsized":"2023-07-11T00:00:18.506680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373459+0000","last_change":"2023-07-11T00:00:16.380308+0000","last_active":"2023-07-11T00:00:18.373459+0000","last_peered":"2023-07-11T00:00:18.373459+0000","last_clean":"2023-07-11T00:00:18.373459+0000","last_became_active":"2023-07-11T00:00:16.380036+0000","last_became_peered":"2023-07-11T00:00:16.380036+0000","last_unstale":"2023-07-11T00:00:18.373459+0000","last_undegraded":"2023-07-11T00:00:18.373459+0000","last_fullsized":"2023-07-11T00:00:18.373459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:57:14.865203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008874+0000","last_change":"2023-07-11T00:00:17.396665+0000","last_active":"2023-07-11T00:00:19.008874+0000","last_peered":"2023-07-11T00:00:19.008874+0000","last_clean":"2023-07-11T00:00:19.008874+0000","last_became_active":"2023-07-11T00:00:17.396049+0000","last_became_peered":"2023-07-11T00:00:17.396049+0000","last_unstale":"2023-07-11T00:00:19.008874+0000","last_undegraded":"2023-07-11T00:00:19.008874+0000","last_fullsized":"2023-07-11T00:00:19.008874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:23.254269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008597+0000","last_change":"2023-07-11T00:00:16.382403+0000","last_active":"2023-07-11T00:00:19.008597+0000","last_peered":"2023-07-11T00:00:19.008597+0000","last_clean":"2023-07-11T00:00:19.008597+0000","last_became_active":"2023-07-11T00:00:16.382062+0000","last_became_peered":"2023-07-11T00:00:16.382062+0000","last_unstale":"2023-07-11T00:00:19.008597+0000","last_undegraded":"2023-07-11T00:00:19.008597+0000","last_fullsized":"2023-07-11T00:00:19.008597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:17:20.832645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373662+0000","last_change":"2023-07-11T00:00:17.384147+0000","last_active":"2023-07-11T00:00:18.373662+0000","last_peered":"2023-07-11T00:00:18.373662+0000","last_clean":"2023-07-11T00:00:18.373662+0000","last_became_active":"2023-07-11T00:00:17.383896+0000","last_became_peered":"2023-07-11T00:00:17.383896+0000","last_unstale":"2023-07-11T00:00:18.373662+0000","last_undegraded":"2023-07-11T00:00:18.373662+0000","last_fullsized":"2023-07-11T00:00:18.373662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008430+0000","last_change":"2023-07-11T00:00:16.384123+0000","last_active":"2023-07-11T00:00:19.008430+0000","last_peered":"2023-07-11T00:00:19.008430+0000","last_clean":"2023-07-11T00:00:19.008430+0000","last_became_active":"2023-07-11T00:00:16.383832+0000","last_became_peered":"2023-07-11T00:00:16.383832+0000","last_unstale":"2023-07-11T00:00:19.008430+0000","last_undegraded":"2023-07-11T00:00:19.008430+0000","last_fullsized":"2023-07-11T00:00:19.008430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:34:19.684185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008056+0000","last_change":"2023-07-11T00:00:17.387530+0000","last_active":"2023-07-11T00:00:19.008056+0000","last_peered":"2023-07-11T00:00:19.008056+0000","last_clean":"2023-07-11T00:00:19.008056+0000","last_became_active":"2023-07-11T00:00:17.387105+0000","last_became_peered":"2023-07-11T00:00:17.387105+0000","last_unstale":"2023-07-11T00:00:19.008056+0000","last_undegraded":"2023-07-11T00:00:19.008056+0000","last_fullsized":"2023-07-11T00:00:19.008056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008383+0000","last_change":"2023-07-11T00:00:16.385068+0000","last_active":"2023-07-11T00:00:19.008383+0000","last_peered":"2023-07-11T00:00:19.008383+0000","last_clean":"2023-07-11T00:00:19.008383+0000","last_became_active":"2023-07-11T00:00:16.384772+0000","last_became_peered":"2023-07-11T00:00:16.384772+0000","last_unstale":"2023-07-11T00:00:19.008383+0000","last_undegraded":"2023-07-11T00:00:19.008383+0000","last_fullsized":"2023-07-11T00:00:19.008383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:32.545716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374548+0000","last_change":"2023-07-11T00:00:17.383412+0000","last_active":"2023-07-11T00:00:18.374548+0000","last_peered":"2023-07-11T00:00:18.374548+0000","last_clean":"2023-07-11T00:00:18.374548+0000","last_became_active":"2023-07-11T00:00:17.383162+0000","last_became_peered":"2023-07-11T00:00:17.383162+0000","last_unstale":"2023-07-11T00:00:18.374548+0000","last_undegraded":"2023-07-11T00:00:18.374548+0000","last_fullsized":"2023-07-11T00:00:18.374548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373928+0000","last_change":"2023-07-11T00:00:16.386464+0000","last_active":"2023-07-11T00:00:18.373928+0000","last_peered":"2023-07-11T00:00:18.373928+0000","last_clean":"2023-07-11T00:00:18.373928+0000","last_became_active":"2023-07-11T00:00:16.385972+0000","last_became_peered":"2023-07-11T00:00:16.385972+0000","last_unstale":"2023-07-11T00:00:18.373928+0000","last_undegraded":"2023-07-11T00:00:18.373928+0000","last_fullsized":"2023-07-11T00:00:18.373928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:39.045974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506589+0000","last_change":"2023-07-11T00:00:17.397631+0000","last_active":"2023-07-11T00:00:18.506589+0000","last_peered":"2023-07-11T00:00:18.506589+0000","last_clean":"2023-07-11T00:00:18.506589+0000","last_became_active":"2023-07-11T00:00:17.397331+0000","last_became_peered":"2023-07-11T00:00:17.397331+0000","last_unstale":"2023-07-11T00:00:18.506589+0000","last_undegraded":"2023-07-11T00:00:18.506589+0000","last_fullsized":"2023-07-11T00:00:18.506589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008780+0000","last_change":"2023-07-11T00:00:16.385414+0000","last_active":"2023-07-11T00:00:19.008780+0000","last_peered":"2023-07-11T00:00:19.008780+0000","last_clean":"2023-07-11T00:00:19.008780+0000","last_became_active":"2023-07-11T00:00:16.385078+0000","last_became_peered":"2023-07-11T00:00:16.385078+0000","last_unstale":"2023-07-11T00:00:19.008780+0000","last_undegraded":"2023-07-11T00:00:19.008780+0000","last_fullsized":"2023-07-11T00:00:19.008780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:48.090690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009326+0000","last_change":"2023-07-11T00:00:17.394701+0000","last_active":"2023-07-11T00:00:19.009326+0000","last_peered":"2023-07-11T00:00:19.009326+0000","last_clean":"2023-07-11T00:00:19.009326+0000","last_became_active":"2023-07-11T00:00:17.394427+0000","last_became_peered":"2023-07-11T00:00:17.394427+0000","last_unstale":"2023-07-11T00:00:19.009326+0000","last_undegraded":"2023-07-11T00:00:19.009326+0000","last_fullsized":"2023-07-11T00:00:19.009326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:18:53.735358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374476+0000","last_change":"2023-07-11T00:00:16.379119+0000","last_active":"2023-07-11T00:00:18.374476+0000","last_peered":"2023-07-11T00:00:18.374476+0000","last_clean":"2023-07-11T00:00:18.374476+0000","last_became_active":"2023-07-11T00:00:16.378596+0000","last_became_peered":"2023-07-11T00:00:16.378596+0000","last_unstale":"2023-07-11T00:00:18.374476+0000","last_undegraded":"2023-07-11T00:00:18.374476+0000","last_fullsized":"2023-07-11T00:00:18.374476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:48.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009450+0000","last_change":"2023-07-11T00:00:17.392798+0000","last_active":"2023-07-11T00:00:19.009450+0000","last_peered":"2023-07-11T00:00:19.009450+0000","last_clean":"2023-07-11T00:00:19.009450+0000","last_became_active":"2023-07-11T00:00:17.392534+0000","last_became_peered":"2023-07-11T00:00:17.392534+0000","last_unstale":"2023-07-11T00:00:19.009450+0000","last_undegraded":"2023-07-11T00:00:19.009450+0000","last_fullsized":"2023-07-11T00:00:19.009450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:18.979975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008294+0000","last_change":"2023-07-11T00:00:16.381752+0000","last_active":"2023-07-11T00:00:19.008294+0000","last_peered":"2023-07-11T00:00:19.008294+0000","last_clean":"2023-07-11T00:00:19.008294+0000","last_became_active":"2023-07-11T00:00:16.381446+0000","last_became_peered":"2023-07-11T00:00:16.381446+0000","last_unstale":"2023-07-11T00:00:19.008294+0000","last_undegraded":"2023-07-11T00:00:19.008294+0000","last_fullsized":"2023-07-11T00:00:19.008294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:28.418665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009436+0000","last_change":"2023-07-11T00:00:17.381280+0000","last_active":"2023-07-11T00:00:19.009436+0000","last_peered":"2023-07-11T00:00:19.009436+0000","last_clean":"2023-07-11T00:00:19.009436+0000","last_became_active":"2023-07-11T00:00:17.380991+0000","last_became_peered":"2023-07-11T00:00:17.380991+0000","last_unstale":"2023-07-11T00:00:19.009436+0000","last_undegraded":"2023-07-11T00:00:19.009436+0000","last_fullsized":"2023-07-11T00:00:19.009436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:17:21.838060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008404+0000","last_change":"2023-07-11T00:00:16.385241+0000","last_active":"2023-07-11T00:00:19.008404+0000","last_peered":"2023-07-11T00:00:19.008404+0000","last_clean":"2023-07-11T00:00:19.008404+0000","last_became_active":"2023-07-11T00:00:16.384948+0000","last_became_peered":"2023-07-11T00:00:16.384948+0000","last_unstale":"2023-07-11T00:00:19.008404+0000","last_undegraded":"2023-07-11T00:00:19.008404+0000","last_fullsized":"2023-07-11T00:00:19.008404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:44.852995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373444+0000","last_change":"2023-07-11T00:00:17.394512+0000","last_active":"2023-07-11T00:00:18.373444+0000","last_peered":"2023-07-11T00:00:18.373444+0000","last_clean":"2023-07-11T00:00:18.373444+0000","last_became_active":"2023-07-11T00:00:17.394195+0000","last_became_peered":"2023-07-11T00:00:17.394195+0000","last_unstale":"2023-07-11T00:00:18.373444+0000","last_undegraded":"2023-07-11T00:00:18.373444+0000","last_fullsized":"2023-07-11T00:00:18.373444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008794+0000","last_change":"2023-07-11T00:00:16.385203+0000","last_active":"2023-07-11T00:00:19.008794+0000","last_peered":"2023-07-11T00:00:19.008794+0000","last_clean":"2023-07-11T00:00:19.008794+0000","last_became_active":"2023-07-11T00:00:16.384926+0000","last_became_peered":"2023-07-11T00:00:16.384926+0000","last_unstale":"2023-07-11T00:00:19.008794+0000","last_undegraded":"2023-07-11T00:00:19.008794+0000","last_fullsized":"2023-07-11T00:00:19.008794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:02.541167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009209+0000","last_change":"2023-07-11T00:00:11.737777+0000","last_active":"2023-07-11T00:00:19.009209+0000","last_peered":"2023-07-11T00:00:19.009209+0000","last_clean":"2023-07-11T00:00:19.009209+0000","last_became_active":"2023-07-11T00:00:11.737518+0000","last_became_peered":"2023-07-11T00:00:11.737518+0000","last_unstale":"2023-07-11T00:00:19.009209+0000","last_undegraded":"2023-07-11T00:00:19.009209+0000","last_fullsized":"2023-07-11T00:00:19.009209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:34:14.575826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007733+0000","last_change":"2023-07-11T00:00:17.392911+0000","last_active":"2023-07-11T00:00:19.007733+0000","last_peered":"2023-07-11T00:00:19.007733+0000","last_clean":"2023-07-11T00:00:19.007733+0000","last_became_active":"2023-07-11T00:00:17.392614+0000","last_became_peered":"2023-07-11T00:00:17.392614+0000","last_unstale":"2023-07-11T00:00:19.007733+0000","last_undegraded":"2023-07-11T00:00:19.007733+0000","last_fullsized":"2023-07-11T00:00:19.007733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008255+0000","last_change":"2023-07-11T00:00:11.270609+0000","last_active":"2023-07-11T00:00:19.008255+0000","last_peered":"2023-07-11T00:00:19.008255+0000","last_clean":"2023-07-11T00:00:19.008255+0000","last_became_active":"2023-07-11T00:00:11.270289+0000","last_became_peered":"2023-07-11T00:00:11.270289+0000","last_unstale":"2023-07-11T00:00:19.008255+0000","last_undegraded":"2023-07-11T00:00:19.008255+0000","last_fullsized":"2023-07-11T00:00:19.008255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:51.405247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506875+0000","last_change":"2023-07-11T00:00:16.381972+0000","last_active":"2023-07-11T00:00:18.506875+0000","last_peered":"2023-07-11T00:00:18.506875+0000","last_clean":"2023-07-11T00:00:18.506875+0000","last_became_active":"2023-07-11T00:00:16.381691+0000","last_became_peered":"2023-07-11T00:00:16.381691+0000","last_unstale":"2023-07-11T00:00:18.506875+0000","last_undegraded":"2023-07-11T00:00:18.506875+0000","last_fullsized":"2023-07-11T00:00:18.506875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:04.291692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008189+0000","last_change":"2023-07-11T00:00:17.380382+0000","last_active":"2023-07-11T00:00:19.008189+0000","last_peered":"2023-07-11T00:00:19.008189+0000","last_clean":"2023-07-11T00:00:19.008189+0000","last_became_active":"2023-07-11T00:00:17.380071+0000","last_became_peered":"2023-07-11T00:00:17.380071+0000","last_unstale":"2023-07-11T00:00:19.008189+0000","last_undegraded":"2023-07-11T00:00:19.008189+0000","last_fullsized":"2023-07-11T00:00:19.008189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:16.918740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372829+0000","last_change":"2023-07-11T00:00:11.269546+0000","last_active":"2023-07-11T00:00:18.372829+0000","last_peered":"2023-07-11T00:00:18.372829+0000","last_clean":"2023-07-11T00:00:18.372829+0000","last_became_active":"2023-07-11T00:00:11.269178+0000","last_became_peered":"2023-07-11T00:00:11.269178+0000","last_unstale":"2023-07-11T00:00:18.372829+0000","last_undegraded":"2023-07-11T00:00:18.372829+0000","last_fullsized":"2023-07-11T00:00:18.372829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:43.866553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008074+0000","last_change":"2023-07-11T00:00:11.270402+0000","last_active":"2023-07-11T00:00:19.008074+0000","last_peered":"2023-07-11T00:00:19.008074+0000","last_clean":"2023-07-11T00:00:19.008074+0000","last_became_active":"2023-07-11T00:00:11.270024+0000","last_became_peered":"2023-07-11T00:00:11.270024+0000","last_unstale":"2023-07-11T00:00:19.008074+0000","last_undegraded":"2023-07-11T00:00:19.008074+0000","last_fullsized":"2023-07-11T00:00:19.008074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:44.333198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506429+0000","last_change":"2023-07-11T00:00:16.384464+0000","last_active":"2023-07-11T00:00:18.506429+0000","last_peered":"2023-07-11T00:00:18.506429+0000","last_clean":"2023-07-11T00:00:18.506429+0000","last_became_active":"2023-07-11T00:00:16.384194+0000","last_became_peered":"2023-07-11T00:00:16.384194+0000","last_unstale":"2023-07-11T00:00:18.506429+0000","last_undegraded":"2023-07-11T00:00:18.506429+0000","last_fullsized":"2023-07-11T00:00:18.506429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:16.741566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506745+0000","last_change":"2023-07-11T00:00:17.398420+0000","last_active":"2023-07-11T00:00:18.506745+0000","last_peered":"2023-07-11T00:00:18.506745+0000","last_clean":"2023-07-11T00:00:18.506745+0000","last_became_active":"2023-07-11T00:00:17.398014+0000","last_became_peered":"2023-07-11T00:00:17.398014+0000","last_unstale":"2023-07-11T00:00:18.506745+0000","last_undegraded":"2023-07-11T00:00:18.506745+0000","last_fullsized":"2023-07-11T00:00:18.506745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008280+0000","last_change":"2023-07-11T00:00:11.518743+0000","last_active":"2023-07-11T00:00:19.008280+0000","last_peered":"2023-07-11T00:00:19.008280+0000","last_clean":"2023-07-11T00:00:19.008280+0000","last_became_active":"2023-07-11T00:00:11.518395+0000","last_became_peered":"2023-07-11T00:00:11.518395+0000","last_unstale":"2023-07-11T00:00:19.008280+0000","last_undegraded":"2023-07-11T00:00:19.008280+0000","last_fullsized":"2023-07-11T00:00:19.008280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:42.982331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372725+0000","last_change":"2023-07-11T00:00:16.379506+0000","last_active":"2023-07-11T00:00:18.372725+0000","last_peered":"2023-07-11T00:00:18.372725+0000","last_clean":"2023-07-11T00:00:18.372725+0000","last_became_active":"2023-07-11T00:00:16.379263+0000","last_became_peered":"2023-07-11T00:00:16.379263+0000","last_unstale":"2023-07-11T00:00:18.372725+0000","last_undegraded":"2023-07-11T00:00:18.372725+0000","last_fullsized":"2023-07-11T00:00:18.372725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:43:40.599156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373432+0000","last_change":"2023-07-11T00:00:17.387290+0000","last_active":"2023-07-11T00:00:18.373432+0000","last_peered":"2023-07-11T00:00:18.373432+0000","last_clean":"2023-07-11T00:00:18.373432+0000","last_became_active":"2023-07-11T00:00:17.386701+0000","last_became_peered":"2023-07-11T00:00:17.386701+0000","last_unstale":"2023-07-11T00:00:18.373432+0000","last_undegraded":"2023-07-11T00:00:18.373432+0000","last_fullsized":"2023-07-11T00:00:18.373432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007892+0000","last_change":"2023-07-11T00:00:11.518875+0000","last_active":"2023-07-11T00:00:19.007892+0000","last_peered":"2023-07-11T00:00:19.007892+0000","last_clean":"2023-07-11T00:00:19.007892+0000","last_became_active":"2023-07-11T00:00:11.518595+0000","last_became_peered":"2023-07-11T00:00:11.518595+0000","last_unstale":"2023-07-11T00:00:19.007892+0000","last_undegraded":"2023-07-11T00:00:19.007892+0000","last_fullsized":"2023-07-11T00:00:19.007892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:51.405247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008089+0000","last_change":"2023-07-11T00:00:16.384893+0000","last_active":"2023-07-11T00:00:19.008089+0000","last_peered":"2023-07-11T00:00:19.008089+0000","last_clean":"2023-07-11T00:00:19.008089+0000","last_became_active":"2023-07-11T00:00:16.384614+0000","last_became_peered":"2023-07-11T00:00:16.384614+0000","last_unstale":"2023-07-11T00:00:19.008089+0000","last_undegraded":"2023-07-11T00:00:19.008089+0000","last_fullsized":"2023-07-11T00:00:19.008089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:15.913324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374261+0000","last_change":"2023-07-11T00:00:17.381906+0000","last_active":"2023-07-11T00:00:18.374261+0000","last_peered":"2023-07-11T00:00:18.374261+0000","last_clean":"2023-07-11T00:00:18.374261+0000","last_became_active":"2023-07-11T00:00:17.381630+0000","last_became_peered":"2023-07-11T00:00:17.381630+0000","last_unstale":"2023-07-11T00:00:18.374261+0000","last_undegraded":"2023-07-11T00:00:18.374261+0000","last_fullsized":"2023-07-11T00:00:18.374261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:12:05.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373405+0000","last_change":"2023-07-11T00:00:11.518769+0000","last_active":"2023-07-11T00:00:18.373405+0000","last_peered":"2023-07-11T00:00:18.373405+0000","last_clean":"2023-07-11T00:00:18.373405+0000","last_became_active":"2023-07-11T00:00:11.518440+0000","last_became_peered":"2023-07-11T00:00:11.518440+0000","last_unstale":"2023-07-11T00:00:18.373405+0000","last_undegraded":"2023-07-11T00:00:18.373405+0000","last_fullsized":"2023-07-11T00:00:18.373405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:11.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009013+0000","last_change":"2023-07-11T00:00:16.384509+0000","last_active":"2023-07-11T00:00:19.009013+0000","last_peered":"2023-07-11T00:00:19.009013+0000","last_clean":"2023-07-11T00:00:19.009013+0000","last_became_active":"2023-07-11T00:00:16.384064+0000","last_became_peered":"2023-07-11T00:00:16.384064+0000","last_unstale":"2023-07-11T00:00:19.009013+0000","last_undegraded":"2023-07-11T00:00:19.009013+0000","last_fullsized":"2023-07-11T00:00:19.009013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:49.441556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373265+0000","last_change":"2023-07-11T00:00:17.393714+0000","last_active":"2023-07-11T00:00:18.373265+0000","last_peered":"2023-07-11T00:00:18.373265+0000","last_clean":"2023-07-11T00:00:18.373265+0000","last_became_active":"2023-07-11T00:00:17.392964+0000","last_became_peered":"2023-07-11T00:00:17.392964+0000","last_unstale":"2023-07-11T00:00:18.373265+0000","last_undegraded":"2023-07-11T00:00:18.373265+0000","last_fullsized":"2023-07-11T00:00:18.373265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:17.746982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374578+0000","last_change":"2023-07-11T00:00:11.518696+0000","last_active":"2023-07-11T00:00:18.374578+0000","last_peered":"2023-07-11T00:00:18.374578+0000","last_clean":"2023-07-11T00:00:18.374578+0000","last_became_active":"2023-07-11T00:00:11.518413+0000","last_became_peered":"2023-07-11T00:00:11.518413+0000","last_unstale":"2023-07-11T00:00:18.374578+0000","last_undegraded":"2023-07-11T00:00:18.374578+0000","last_fullsized":"2023-07-11T00:00:18.374578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:01.099550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373125+0000","last_change":"2023-07-11T00:00:16.379703+0000","last_active":"2023-07-11T00:00:18.373125+0000","last_peered":"2023-07-11T00:00:18.373125+0000","last_clean":"2023-07-11T00:00:18.373125+0000","last_became_active":"2023-07-11T00:00:16.379251+0000","last_became_peered":"2023-07-11T00:00:16.379251+0000","last_unstale":"2023-07-11T00:00:18.373125+0000","last_undegraded":"2023-07-11T00:00:18.373125+0000","last_fullsized":"2023-07-11T00:00:18.373125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:25.248576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506437+0000","last_change":"2023-07-11T00:00:17.390220+0000","last_active":"2023-07-11T00:00:18.506437+0000","last_peered":"2023-07-11T00:00:18.506437+0000","last_clean":"2023-07-11T00:00:18.506437+0000","last_became_active":"2023-07-11T00:00:17.389938+0000","last_became_peered":"2023-07-11T00:00:17.389938+0000","last_unstale":"2023-07-11T00:00:18.506437+0000","last_undegraded":"2023-07-11T00:00:18.506437+0000","last_fullsized":"2023-07-11T00:00:18.506437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374335+0000","last_change":"2023-07-11T00:00:11.269674+0000","last_active":"2023-07-11T00:00:18.374335+0000","last_peered":"2023-07-11T00:00:18.374335+0000","last_clean":"2023-07-11T00:00:18.374335+0000","last_became_active":"2023-07-11T00:00:11.269355+0000","last_became_peered":"2023-07-11T00:00:11.269355+0000","last_unstale":"2023-07-11T00:00:18.374335+0000","last_undegraded":"2023-07-11T00:00:18.374335+0000","last_fullsized":"2023-07-11T00:00:18.374335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:20.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373947+0000","last_change":"2023-07-11T00:00:16.386828+0000","last_active":"2023-07-11T00:00:18.373947+0000","last_peered":"2023-07-11T00:00:18.373947+0000","last_clean":"2023-07-11T00:00:18.373947+0000","last_became_active":"2023-07-11T00:00:16.386586+0000","last_became_peered":"2023-07-11T00:00:16.386586+0000","last_unstale":"2023-07-11T00:00:18.373947+0000","last_undegraded":"2023-07-11T00:00:18.373947+0000","last_fullsized":"2023-07-11T00:00:18.373947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:15.913324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372814+0000","last_change":"2023-07-11T00:00:17.393914+0000","last_active":"2023-07-11T00:00:18.372814+0000","last_peered":"2023-07-11T00:00:18.372814+0000","last_clean":"2023-07-11T00:00:18.372814+0000","last_became_active":"2023-07-11T00:00:17.392216+0000","last_became_peered":"2023-07-11T00:00:17.392216+0000","last_unstale":"2023-07-11T00:00:18.372814+0000","last_undegraded":"2023-07-11T00:00:18.372814+0000","last_fullsized":"2023-07-11T00:00:18.372814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:57:15.870619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506667+0000","last_change":"2023-07-11T00:00:16.383581+0000","last_active":"2023-07-11T00:00:18.506667+0000","last_peered":"2023-07-11T00:00:18.506667+0000","last_clean":"2023-07-11T00:00:18.506667+0000","last_became_active":"2023-07-11T00:00:16.383295+0000","last_became_peered":"2023-07-11T00:00:16.383295+0000","last_unstale":"2023-07-11T00:00:18.506667+0000","last_undegraded":"2023-07-11T00:00:18.506667+0000","last_fullsized":"2023-07-11T00:00:18.506667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:17.100187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008310+0000","last_change":"2023-07-11T00:00:17.398128+0000","last_active":"2023-07-11T00:00:19.008310+0000","last_peered":"2023-07-11T00:00:19.008310+0000","last_clean":"2023-07-11T00:00:19.008310+0000","last_became_active":"2023-07-11T00:00:17.397851+0000","last_became_peered":"2023-07-11T00:00:17.397851+0000","last_unstale":"2023-07-11T00:00:19.008310+0000","last_undegraded":"2023-07-11T00:00:19.008310+0000","last_fullsized":"2023-07-11T00:00:19.008310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:00:40.235957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373474+0000","last_change":"2023-07-11T00:00:16.382786+0000","last_active":"2023-07-11T00:00:18.373474+0000","last_peered":"2023-07-11T00:00:18.373474+0000","last_clean":"2023-07-11T00:00:18.373474+0000","last_became_active":"2023-07-11T00:00:16.382519+0000","last_became_peered":"2023-07-11T00:00:16.382519+0000","last_unstale":"2023-07-11T00:00:18.373474+0000","last_undegraded":"2023-07-11T00:00:18.373474+0000","last_fullsized":"2023-07-11T00:00:18.373474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:28.631488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008963+0000","last_change":"2023-07-11T00:00:17.396289+0000","last_active":"2023-07-11T00:00:19.008963+0000","last_peered":"2023-07-11T00:00:19.008963+0000","last_clean":"2023-07-11T00:00:19.008963+0000","last_became_active":"2023-07-11T00:00:17.395948+0000","last_became_peered":"2023-07-11T00:00:17.395948+0000","last_unstale":"2023-07-11T00:00:19.008963+0000","last_undegraded":"2023-07-11T00:00:19.008963+0000","last_fullsized":"2023-07-11T00:00:19.008963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373988+0000","last_change":"2023-07-11T00:00:16.381779+0000","last_active":"2023-07-11T00:00:18.373988+0000","last_peered":"2023-07-11T00:00:18.373988+0000","last_clean":"2023-07-11T00:00:18.373988+0000","last_became_active":"2023-07-11T00:00:16.381496+0000","last_became_peered":"2023-07-11T00:00:16.381496+0000","last_unstale":"2023-07-11T00:00:18.373988+0000","last_undegraded":"2023-07-11T00:00:18.373988+0000","last_fullsized":"2023-07-11T00:00:18.373988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:04.291692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008966+0000","last_change":"2023-07-11T00:00:17.392394+0000","last_active":"2023-07-11T00:00:19.008966+0000","last_peered":"2023-07-11T00:00:19.008966+0000","last_clean":"2023-07-11T00:00:19.008966+0000","last_became_active":"2023-07-11T00:00:17.391500+0000","last_became_peered":"2023-07-11T00:00:17.391500+0000","last_unstale":"2023-07-11T00:00:19.008966+0000","last_undegraded":"2023-07-11T00:00:19.008966+0000","last_fullsized":"2023-07-11T00:00:19.008966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:45.858410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008803+0000","last_change":"2023-07-11T00:00:16.384057+0000","last_active":"2023-07-11T00:00:19.008803+0000","last_peered":"2023-07-11T00:00:19.008803+0000","last_clean":"2023-07-11T00:00:19.008803+0000","last_became_active":"2023-07-11T00:00:16.383707+0000","last_became_peered":"2023-07-11T00:00:16.383707+0000","last_unstale":"2023-07-11T00:00:19.008803+0000","last_undegraded":"2023-07-11T00:00:19.008803+0000","last_fullsized":"2023-07-11T00:00:19.008803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:32.545716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007992+0000","last_change":"2023-07-11T00:00:17.393506+0000","last_active":"2023-07-11T00:00:19.007992+0000","last_peered":"2023-07-11T00:00:19.007992+0000","last_clean":"2023-07-11T00:00:19.007992+0000","last_became_active":"2023-07-11T00:00:17.392891+0000","last_became_peered":"2023-07-11T00:00:17.392891+0000","last_unstale":"2023-07-11T00:00:19.007992+0000","last_undegraded":"2023-07-11T00:00:19.007992+0000","last_fullsized":"2023-07-11T00:00:19.007992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506934+0000","last_change":"2023-07-11T00:00:16.386794+0000","last_active":"2023-07-11T00:00:18.506934+0000","last_peered":"2023-07-11T00:00:18.506934+0000","last_clean":"2023-07-11T00:00:18.506934+0000","last_became_active":"2023-07-11T00:00:16.386581+0000","last_became_peered":"2023-07-11T00:00:16.386581+0000","last_unstale":"2023-07-11T00:00:18.506934+0000","last_undegraded":"2023-07-11T00:00:18.506934+0000","last_fullsized":"2023-07-11T00:00:18.506934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:44.852995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007926+0000","last_change":"2023-07-11T00:00:17.383214+0000","last_active":"2023-07-11T00:00:19.007926+0000","last_peered":"2023-07-11T00:00:19.007926+0000","last_clean":"2023-07-11T00:00:19.007926+0000","last_became_active":"2023-07-11T00:00:17.381360+0000","last_became_peered":"2023-07-11T00:00:17.381360+0000","last_unstale":"2023-07-11T00:00:19.007926+0000","last_undegraded":"2023-07-11T00:00:19.007926+0000","last_fullsized":"2023-07-11T00:00:19.007926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373840+0000","last_change":"2023-07-11T00:00:17.392151+0000","last_active":"2023-07-11T00:00:18.373840+0000","last_peered":"2023-07-11T00:00:18.373840+0000","last_clean":"2023-07-11T00:00:18.373840+0000","last_became_active":"2023-07-11T00:00:17.391869+0000","last_became_peered":"2023-07-11T00:00:17.391869+0000","last_unstale":"2023-07-11T00:00:18.373840+0000","last_undegraded":"2023-07-11T00:00:18.373840+0000","last_fullsized":"2023-07-11T00:00:18.373840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:04:27.161083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007854+0000","last_change":"2023-07-11T00:00:17.400395+0000","last_active":"2023-07-11T00:00:19.007854+0000","last_peered":"2023-07-11T00:00:19.007854+0000","last_clean":"2023-07-11T00:00:19.007854+0000","last_became_active":"2023-07-11T00:00:17.400124+0000","last_became_peered":"2023-07-11T00:00:17.400124+0000","last_unstale":"2023-07-11T00:00:19.007854+0000","last_undegraded":"2023-07-11T00:00:19.007854+0000","last_fullsized":"2023-07-11T00:00:19.007854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008468+0000","last_change":"2023-07-11T00:00:17.388655+0000","last_active":"2023-07-11T00:00:19.008468+0000","last_peered":"2023-07-11T00:00:19.008468+0000","last_clean":"2023-07-11T00:00:19.008468+0000","last_became_active":"2023-07-11T00:00:17.388372+0000","last_became_peered":"2023-07-11T00:00:17.388372+0000","last_unstale":"2023-07-11T00:00:19.008468+0000","last_undegraded":"2023-07-11T00:00:19.008468+0000","last_fullsized":"2023-07-11T00:00:19.008468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:05.297107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008602+0000","last_change":"2023-07-11T00:00:17.394965+0000","last_active":"2023-07-11T00:00:19.008602+0000","last_peered":"2023-07-11T00:00:19.008602+0000","last_clean":"2023-07-11T00:00:19.008602+0000","last_became_active":"2023-07-11T00:00:17.394513+0000","last_became_peered":"2023-07-11T00:00:17.394513+0000","last_unstale":"2023-07-11T00:00:19.008602+0000","last_undegraded":"2023-07-11T00:00:19.008602+0000","last_fullsized":"2023-07-11T00:00:19.008602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:50.446972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373114+0000","last_change":"2023-07-11T00:00:17.384534+0000","last_active":"2023-07-11T00:00:18.373114+0000","last_peered":"2023-07-11T00:00:18.373114+0000","last_clean":"2023-07-11T00:00:18.373114+0000","last_became_active":"2023-07-11T00:00:17.382062+0000","last_became_peered":"2023-07-11T00:00:17.382062+0000","last_unstale":"2023-07-11T00:00:18.373114+0000","last_undegraded":"2023-07-11T00:00:18.373114+0000","last_fullsized":"2023-07-11T00:00:18.373114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:10:20.060069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":664594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":72536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":74066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:00:21.943 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-11T00:00:21.943 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-11T00:00:21.944 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-11T00:00:21.944 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-11T00:00:21.945 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-11T00:00:22.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.100+0000 7f8abdc2d700 1 Processor -- start 2023-07-11T00:00:22.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.100+0000 7f8abdc2d700 1 -- start start 2023-07-11T00:00:22.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.101+0000 7f8abdc2d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ab80b8d90 0x7f8ab806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.101+0000 7f8abdc2d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab80b8620 con 0x7f8ab81449d0 2023-07-11T00:00:22.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.101+0000 7f8abdc2d700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab80b8900 con 0x7f8ab80bc810 2023-07-11T00:00:22.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.101+0000 7f8abdc2d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80b97a0 con 0x7f8ab80b8d90 2023-07-11T00:00:22.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.101+0000 7f8ab77fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8ab81449d0 0x7f8ab814db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54412/0 (socket says 172.21.15.38:54412) 2023-07-11T00:00:22.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.101+0000 7f8ab77fe700 1 -- 172.21.15.38:0/4073970823 learned_addr learned my addr 172.21.15.38:0/4073970823 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:22.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.101+0000 7f8ab7fff700 1 --2- 172.21.15.38:0/4073970823 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ab80b8d90 0x7f8ab806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.101+0000 7f8ab67fc700 1 -- 172.21.15.38:0/4073970823 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111301649 0 0) 0x7f8ab80b8620 con 0x7f8ab81449d0 2023-07-11T00:00:22.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.102+0000 7f8ab67fc700 1 -- 172.21.15.38:0/4073970823 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa00035b0 con 0x7f8ab81449d0 2023-07-11T00:00:22.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.102+0000 7f8ab67fc700 1 -- 172.21.15.38:0/4073970823 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604971078 0 0) 0x7f8ab80b8900 con 0x7f8ab80bc810 2023-07-11T00:00:22.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.102+0000 7f8ab67fc700 1 -- 172.21.15.38:0/4073970823 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab80b8620 con 0x7f8ab80bc810 2023-07-11T00:00:22.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.102+0000 7f8ab7fff700 1 -- 172.21.15.38:0/4073970823 >> v1:172.21.15.70:6789/0 conn(0x7f8ab80bc810 legacy=0x7f8ab80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.102+0000 7f8ab67fc700 1 -- 172.21.15.38:0/4073970823 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3921058863 0 0) 0x7f8aa00035b0 con 0x7f8ab81449d0 2023-07-11T00:00:22.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.102+0000 7f8ab7fff700 1 -- 172.21.15.38:0/4073970823 >> v1:172.21.15.38:6789/0 conn(0x7f8ab81449d0 legacy=0x7f8ab814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.102+0000 7f8ab7fff700 1 -- 172.21.15.38:0/4073970823 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80bac40 con 0x7f8ab80b8d90 2023-07-11T00:00:22.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.102+0000 7f8ab7fff700 1 --2- 172.21.15.38:0/4073970823 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ab80b8d90 0x7f8ab806ade0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009dc0 tx=0x7f8ab000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d67a76b6aa4c42a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:22.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.102+0000 7f8ab67fc700 1 -- 172.21.15.38:0/4073970823 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000e070 con 0x7f8ab80b8d90 2023-07-11T00:00:22.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.102+0000 7f8ab67fc700 1 -- 172.21.15.38:0/4073970823 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab0003a20 con 0x7f8ab80b8d90 2023-07-11T00:00:22.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.102+0000 7f8ab67fc700 1 -- 172.21.15.38:0/4073970823 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8001670 con 0x7f8ab80b8d90 2023-07-11T00:00:22.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.103+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4073970823 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ab80b8d90 msgr2=0x7f8ab806ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.103+0000 7f8abdc2d700 1 --2- 172.21.15.38:0/4073970823 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ab80b8d90 0x7f8ab806ade0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009dc0 tx=0x7f8ab000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:22.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.103+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4073970823 shutdown_connections 2023-07-11T00:00:22.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.103+0000 7f8abdc2d700 1 --2- 172.21.15.38:0/4073970823 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ab80b8d90 0x7f8ab806ade0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.103+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4073970823 >> 172.21.15.38:0/4073970823 conn(0x7f8ab80c0860 msgr2=0x7f8ab80c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:22.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.103+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4073970823 shutdown_connections 2023-07-11T00:00:22.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.103+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4073970823 wait complete. 2023-07-11T00:00:22.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.104+0000 7f8abdc2d700 1 Processor -- start 2023-07-11T00:00:22.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.104+0000 7f8abdc2d700 1 -- start start 2023-07-11T00:00:22.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8abdc2d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab80b8d90 0x7f8ab80b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8abdc2d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ab80bc810 0x7f8ab81d5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8abdc2d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ab81449d0 0x7f8ab80a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8abdc2d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab81d61f0 con 0x7f8ab80b8d90 2023-07-11T00:00:22.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8abdc2d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80b3cf0 con 0x7f8ab80bc810 2023-07-11T00:00:22.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8abdc2d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80b3730 con 0x7f8ab81449d0 2023-07-11T00:00:22.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8ab77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab80b8d90 0x7f8ab80b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8ab77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab80b8d90 0x7f8ab80b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52676/0 (socket says 172.21.15.38:52676) 2023-07-11T00:00:22.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8ab77fe700 1 -- 172.21.15.38:0/4277787106 learned_addr learned my addr 172.21.15.38:0/4277787106 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:22.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8ab7fff700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ab81449d0 0x7f8ab80a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8ab6ffd700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ab80bc810 0x7f8ab81d5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8ab77fe700 1 -- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ab81449d0 msgr2=0x7f8ab80a61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8ab77fe700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ab81449d0 0x7f8ab80a61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8ab77fe700 1 -- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ab80bc810 msgr2=0x7f8ab81d5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8ab77fe700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ab80bc810 0x7f8ab81d5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8ab77fe700 1 -- 172.21.15.38:0/4277787106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab0009a70 con 0x7f8ab80b8d90 2023-07-11T00:00:22.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8ab77fe700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab80b8d90 0x7f8ab80b30b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c520 tx=0x7f8aa800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:22.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8a9ffff700 1 -- 172.21.15.38:0/4277787106 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8004c80 con 0x7f8ab80b8d90 2023-07-11T00:00:22.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8a9ffff700 1 -- 172.21.15.38:0/4277787106 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa8004de0 con 0x7f8ab80b8d90 2023-07-11T00:00:22.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4277787106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab80b3f90 con 0x7f8ab80b8d90 2023-07-11T00:00:22.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.105+0000 7f8a9ffff700 1 -- 172.21.15.38:0/4277787106 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8007310 con 0x7f8ab80b8d90 2023-07-11T00:00:22.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.106+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4277787106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab80b4550 con 0x7f8ab80b8d90 2023-07-11T00:00:22.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.107+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4277787106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab80b13c0 con 0x7f8ab80b8d90 2023-07-11T00:00:22.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.107+0000 7f8a9ffff700 1 -- 172.21.15.38:0/4277787106 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8aa8007470 con 0x7f8ab80b8d90 2023-07-11T00:00:22.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.107+0000 7f8a9ffff700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8aa406ace0 0x7f8aa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.107+0000 7f8a9ffff700 1 -- 172.21.15.38:0/4277787106 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8aa80891f0 con 0x7f8ab80b8d90 2023-07-11T00:00:22.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.107+0000 7f8ab6ffd700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8aa406ace0 0x7f8aa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.108+0000 7f8ab6ffd700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8aa406ace0 0x7f8aa406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80bba00 tx=0x7f8aac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:22.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.112+0000 7f8a9ffff700 1 -- 172.21.15.38:0/4277787106 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8aa80542a0 con 0x7f8ab80b8d90 2023-07-11T00:00:22.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.370+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4277787106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8ab8074360 con 0x7f8ab80b8d90 2023-07-11T00:00:22.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.373+0000 7f8a9ffff700 1 -- 172.21.15.38:0/4277787106 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170842 (secure 0 0 0) 0x7f8aa80578c0 con 0x7f8ab80b8d90 2023-07-11T00:00:22.376 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:22.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.375+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8aa406ace0 msgr2=0x7f8aa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.375+0000 7f8abdc2d700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8aa406ace0 0x7f8aa406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80bba00 tx=0x7f8aac009040 comp rx=0 tx=0).stop 2023-07-11T00:00:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.375+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4277787106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab80b8d90 msgr2=0x7f8ab80b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.375+0000 7f8abdc2d700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab80b8d90 0x7f8ab80b30b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c520 tx=0x7f8aa800c8e0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.375+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4277787106 shutdown_connections 2023-07-11T00:00:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.375+0000 7f8abdc2d700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8aa406ace0 0x7f8aa406d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.375+0000 7f8abdc2d700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ab81449d0 0x7f8ab80a61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.375+0000 7f8abdc2d700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab80b8d90 0x7f8ab80b30b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.375+0000 7f8abdc2d700 1 --2- 172.21.15.38:0/4277787106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ab80bc810 0x7f8ab81d5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.375+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4277787106 >> 172.21.15.38:0/4277787106 conn(0x7f8ab80c0860 msgr2=0x7f8ab80baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:22.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.375+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4277787106 shutdown_connections 2023-07-11T00:00:22.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.376+0000 7f8abdc2d700 1 -- 172.21.15.38:0/4277787106 wait complete. 2023-07-11T00:00:22.389 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2073477499},{"type":"v1","addr":"172.21.15.70:6833","nonce":2073477499}]},"active_addr":"172.21.15.70:6833/2073477499","active_change":"2023-07-11T00:00:03.936756+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3856916840}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3463301431}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2885929698}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1479494563}]}]} 2023-07-11T00:00:22.394 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-11T00:00:22.395 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-11T00:00:22.395 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:22.411 INFO:tasks.ceph.mds.c.smithi038.stderr:2023-07-11T00:00:22.409+0000 7f2d8a3a8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-11T00:00:22.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.519+0000 7f958b3be700 1 Processor -- start 2023-07-11T00:00:22.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.519+0000 7f958b3be700 1 -- start start 2023-07-11T00:00:22.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f958b3be700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9584071d20 0x7f95841458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f958b3be700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f95840709c0 0x7f9584145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f958b3be700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9584070130 con 0x7f958414bf30 2023-07-11T00:00:22.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f958b3be700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9584146330 con 0x7f9584071d20 2023-07-11T00:00:22.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f958b3be700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9584070f80 con 0x7f95840709c0 2023-07-11T00:00:22.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f9588959700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9584071d20 0x7f95841458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f958915a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f958414bf30 0x7f95840b8ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54428/0 (socket says 172.21.15.38:54428) 2023-07-11T00:00:22.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f958915a700 1 -- 172.21.15.38:0/2245274956 learned_addr learned my addr 172.21.15.38:0/2245274956 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:22.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f9588959700 1 -- 172.21.15.38:0/2245274956 >> v2:172.21.15.70:3300/0 conn(0x7f95840709c0 msgr2=0x7f9584145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:22.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f958995b700 1 --2- 172.21.15.38:0/2245274956 >> v2:172.21.15.70:3300/0 conn(0x7f95840709c0 0x7f9584145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f9588959700 1 --2- 172.21.15.38:0/2245274956 >> v2:172.21.15.70:3300/0 conn(0x7f95840709c0 0x7f9584145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f9588959700 1 -- 172.21.15.38:0/2245274956 >> v1:172.21.15.38:6789/0 conn(0x7f958414bf30 legacy=0x7f95840b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f957bfff700 1 -- 172.21.15.38:0/2245274956 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615445432 0 0) 0x7f9584070130 con 0x7f958414bf30 2023-07-11T00:00:22.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f9588959700 1 -- 172.21.15.38:0/2245274956 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584071260 con 0x7f9584071d20 2023-07-11T00:00:22.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f9588959700 1 --2- 172.21.15.38:0/2245274956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9584071d20 0x7f95841458b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f95840b1db0 tx=0x7f9574009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0fe2b7bd9d1638 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:22.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f957bfff700 1 -- 172.21.15.38:0/2245274956 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574011830 con 0x7f9584071d20 2023-07-11T00:00:22.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f957bfff700 1 -- 172.21.15.38:0/2245274956 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9574011990 con 0x7f9584071d20 2023-07-11T00:00:22.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.520+0000 7f957bfff700 1 -- 172.21.15.38:0/2245274956 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574011d20 con 0x7f9584071d20 2023-07-11T00:00:22.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.521+0000 7f958b3be700 1 -- 172.21.15.38:0/2245274956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9584071d20 msgr2=0x7f95841458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.521+0000 7f958b3be700 1 --2- 172.21.15.38:0/2245274956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9584071d20 0x7f95841458b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f95840b1db0 tx=0x7f9574009b20 comp rx=0 tx=0).stop 2023-07-11T00:00:22.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.521+0000 7f958b3be700 1 -- 172.21.15.38:0/2245274956 shutdown_connections 2023-07-11T00:00:22.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.521+0000 7f958b3be700 1 --2- 172.21.15.38:0/2245274956 >> v2:172.21.15.70:3300/0 conn(0x7f95840709c0 0x7f9584145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.521+0000 7f958b3be700 1 --2- 172.21.15.38:0/2245274956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9584071d20 0x7f95841458b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.521+0000 7f958b3be700 1 -- 172.21.15.38:0/2245274956 >> 172.21.15.38:0/2245274956 conn(0x7f95840be670 msgr2=0x7f95840bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:22.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.521+0000 7f958b3be700 1 -- 172.21.15.38:0/2245274956 shutdown_connections 2023-07-11T00:00:22.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.521+0000 7f958b3be700 1 -- 172.21.15.38:0/2245274956 wait complete. 2023-07-11T00:00:22.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.522+0000 7f958b3be700 1 Processor -- start 2023-07-11T00:00:22.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.522+0000 7f958b3be700 1 -- start start 2023-07-11T00:00:22.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958b3be700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95840709c0 0x7f9584140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958b3be700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9584071d20 0x7f95841d5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958b3be700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958414bf30 0x7f95841d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958b3be700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95841e3600 con 0x7f95840709c0 2023-07-11T00:00:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958b3be700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95841d4970 con 0x7f9584071d20 2023-07-11T00:00:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958b3be700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95841d43b0 con 0x7f958414bf30 2023-07-11T00:00:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958915a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95840709c0 0x7f9584140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958915a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95840709c0 0x7f9584140450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52692/0 (socket says 172.21.15.38:52692) 2023-07-11T00:00:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958915a700 1 -- 172.21.15.38:0/500708393 learned_addr learned my addr 172.21.15.38:0/500708393 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f9588959700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9584071d20 0x7f95841d5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958995b700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958414bf30 0x7f95841d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958915a700 1 -- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958414bf30 msgr2=0x7f95841d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958915a700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958414bf30 0x7f95841d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958915a700 1 -- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9584071d20 msgr2=0x7f95841d5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958915a700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9584071d20 0x7f95841d5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958915a700 1 -- 172.21.15.38:0/500708393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95740094a0 con 0x7f95840709c0 2023-07-11T00:00:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f9588959700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9584071d20 0x7f95841d5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958995b700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958414bf30 0x7f95841d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.523+0000 7f958915a700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95840709c0 0x7f9584140450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f958000c550 tx=0x7f958000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.524+0000 7f9579ffb700 1 -- 172.21.15.38:0/500708393 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580004c80 con 0x7f95840709c0 2023-07-11T00:00:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.524+0000 7f9579ffb700 1 -- 172.21.15.38:0/500708393 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9580004e00 con 0x7f95840709c0 2023-07-11T00:00:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.524+0000 7f958b3be700 1 -- 172.21.15.38:0/500708393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95841d4690 con 0x7f95840709c0 2023-07-11T00:00:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.524+0000 7f9579ffb700 1 -- 172.21.15.38:0/500708393 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580007310 con 0x7f95840709c0 2023-07-11T00:00:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.524+0000 7f958b3be700 1 -- 172.21.15.38:0/500708393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9584140990 con 0x7f95840709c0 2023-07-11T00:00:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.525+0000 7f958b3be700 1 -- 172.21.15.38:0/500708393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95841d1de0 con 0x7f95840709c0 2023-07-11T00:00:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.525+0000 7f9579ffb700 1 -- 172.21.15.38:0/500708393 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9580007470 con 0x7f95840709c0 2023-07-11T00:00:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.526+0000 7f9579ffb700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956806ace0 0x7f956806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.526+0000 7f9579ffb700 1 -- 172.21.15.38:0/500708393 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9580089150 con 0x7f95840709c0 2023-07-11T00:00:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.526+0000 7f9588959700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956806ace0 0x7f956806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.527+0000 7f9588959700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956806ace0 0x7f956806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f95740090b0 tx=0x7f9574008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:22.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.530+0000 7f9579ffb700 1 -- 172.21.15.38:0/500708393 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9580054290 con 0x7f95840709c0 2023-07-11T00:00:22.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.726+0000 7f958b3be700 1 -- 172.21.15.38:0/500708393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9584074360 con 0x7f95840709c0 2023-07-11T00:00:22.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.727+0000 7f9579ffb700 1 -- 172.21.15.38:0/500708393 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f95800578b0 con 0x7f95840709c0 2023-07-11T00:00:22.729 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:22.729 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:22.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 -- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956806ace0 msgr2=0x7f956806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956806ace0 0x7f956806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f95740090b0 tx=0x7f9574008030 comp rx=0 tx=0).stop 2023-07-11T00:00:22.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 -- 172.21.15.38:0/500708393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95840709c0 msgr2=0x7f9584140450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95840709c0 0x7f9584140450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f958000c550 tx=0x7f958000c910 comp rx=0 tx=0).stop 2023-07-11T00:00:22.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 -- 172.21.15.38:0/500708393 shutdown_connections 2023-07-11T00:00:22.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f956806ace0 0x7f956806d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f958414bf30 0x7f95841d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95840709c0 0x7f9584140450 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 --2- 172.21.15.38:0/500708393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9584071d20 0x7f95841d5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 -- 172.21.15.38:0/500708393 >> 172.21.15.38:0/500708393 conn(0x7f95840be670 msgr2=0x7f95840bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:22.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 -- 172.21.15.38:0/500708393 shutdown_connections 2023-07-11T00:00:22.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.729+0000 7f958b3be700 1 -- 172.21.15.38:0/500708393 wait complete. 2023-07-11T00:00:22.744 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-11T00:00:22.744 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.908+0000 7f1ffc0bf700 1 Processor -- start 2023-07-11T00:00:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.908+0000 7f1ffc0bf700 1 -- start start 2023-07-11T00:00:22.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.909+0000 7f1ffc0bf700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1ff406b120 0x7f1ff40b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.909+0000 7f1ffc0bf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ff414aa40 0x7f1ff414aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.909+0000 7f1ffc0bf700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff4070410 con 0x7f1ff41444c0 2023-07-11T00:00:22.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.909+0000 7f1ffc0bf700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff40b9590 con 0x7f1ff414aa40 2023-07-11T00:00:22.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.909+0000 7f1ffc0bf700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff414b400 con 0x7f1ff406b120 2023-07-11T00:00:22.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.909+0000 7f1ff965a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ff414aa40 0x7f1ff414aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.909+0000 7f1ff965a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ff414aa40 0x7f1ff414aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52704/0 (socket says 172.21.15.38:52704) 2023-07-11T00:00:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.909+0000 7f1ff9e5b700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1ff406b120 0x7f1ff40b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.909+0000 7f1ff965a700 1 -- 172.21.15.38:0/2010192502 learned_addr learned my addr 172.21.15.38:0/2010192502 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.909+0000 7f1ffa65c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1ff41444c0 0x7f1ff41448e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54430/0 (socket says 172.21.15.38:54430) 2023-07-11T00:00:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.910+0000 7f1ff965a700 1 -- 172.21.15.38:0/2010192502 >> v2:172.21.15.70:3300/0 conn(0x7f1ff406b120 msgr2=0x7f1ff40b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.910+0000 7f1ff965a700 1 --2- 172.21.15.38:0/2010192502 >> v2:172.21.15.70:3300/0 conn(0x7f1ff406b120 0x7f1ff40b8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.910+0000 7f1ff965a700 1 -- 172.21.15.38:0/2010192502 >> v1:172.21.15.38:6789/0 conn(0x7f1ff41444c0 legacy=0x7f1ff41448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.910+0000 7f1ff8e59700 1 -- 172.21.15.38:0/2010192502 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519246832 0 0) 0x7f1ff4070410 con 0x7f1ff41444c0 2023-07-11T00:00:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.910+0000 7f1ff965a700 1 -- 172.21.15.38:0/2010192502 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff406ef60 con 0x7f1ff414aa40 2023-07-11T00:00:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.910+0000 7f1ff965a700 1 --2- 172.21.15.38:0/2010192502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ff414aa40 0x7f1ff414aec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40672f0 tx=0x7f1fe4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded58047aa798b server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.910+0000 7f1ff8e59700 1 -- 172.21.15.38:0/2010192502 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4011830 con 0x7f1ff414aa40 2023-07-11T00:00:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.910+0000 7f1ff8e59700 1 -- 172.21.15.38:0/2010192502 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe4011990 con 0x7f1ff414aa40 2023-07-11T00:00:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.910+0000 7f1ff8e59700 1 -- 172.21.15.38:0/2010192502 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4011d20 con 0x7f1ff414aa40 2023-07-11T00:00:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.910+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2010192502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ff414aa40 msgr2=0x7f1ff414aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.910+0000 7f1ffc0bf700 1 --2- 172.21.15.38:0/2010192502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ff414aa40 0x7f1ff414aec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40672f0 tx=0x7f1fe4009bd0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.911+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2010192502 shutdown_connections 2023-07-11T00:00:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.911+0000 7f1ffc0bf700 1 --2- 172.21.15.38:0/2010192502 >> v2:172.21.15.70:3300/0 conn(0x7f1ff406b120 0x7f1ff40b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.911+0000 7f1ffc0bf700 1 --2- 172.21.15.38:0/2010192502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ff414aa40 0x7f1ff414aec0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.911+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2010192502 >> 172.21.15.38:0/2010192502 conn(0x7f1ff40bd980 msgr2=0x7f1ff40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.911+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2010192502 shutdown_connections 2023-07-11T00:00:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.911+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2010192502 wait complete. 2023-07-11T00:00:22.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.912+0000 7f1ffc0bf700 1 Processor -- start 2023-07-11T00:00:22.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.912+0000 7f1ffc0bf700 1 -- start start 2023-07-11T00:00:22.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ffc0bf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ff406b120 0x7f1ff40b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ffc0bf700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ff41444c0 0x7f1ff41470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ffc0bf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ff414aa40 0x7f1ff41475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ffc0bf700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40b5cd0 con 0x7f1ff406b120 2023-07-11T00:00:22.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ffc0bf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff41e3970 con 0x7f1ff414aa40 2023-07-11T00:00:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ffc0bf700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff41e2fd0 con 0x7f1ff41444c0 2023-07-11T00:00:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ff9e5b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ff406b120 0x7f1ff40b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ff9e5b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ff406b120 0x7f1ff40b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52714/0 (socket says 172.21.15.38:52714) 2023-07-11T00:00:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ff9e5b700 1 -- 172.21.15.38:0/2073798961 learned_addr learned my addr 172.21.15.38:0/2073798961 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ffa65c700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ff414aa40 0x7f1ff41475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ff965a700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ff41444c0 0x7f1ff41470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ff9e5b700 1 -- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ff41444c0 msgr2=0x7f1ff41470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ff9e5b700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ff41444c0 0x7f1ff41470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ff9e5b700 1 -- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ff414aa40 msgr2=0x7f1ff41475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ff9e5b700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ff414aa40 0x7f1ff41475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.913+0000 7f1ff9e5b700 1 -- 172.21.15.38:0/2073798961 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4009550 con 0x7f1ff406b120 2023-07-11T00:00:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.914+0000 7f1ff9e5b700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ff406b120 0x7f1ff40b3e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000e9b0 tx=0x7f1ff000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.914+0000 7f1fea7fc700 1 -- 172.21.15.38:0/2073798961 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0009710 con 0x7f1ff406b120 2023-07-11T00:00:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.914+0000 7f1fea7fc700 1 -- 172.21.15.38:0/2073798961 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff000c850 con 0x7f1ff406b120 2023-07-11T00:00:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.914+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2073798961 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff41e32b0 con 0x7f1ff406b120 2023-07-11T00:00:22.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.914+0000 7f1fea7fc700 1 -- 172.21.15.38:0/2073798961 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000cbc0 con 0x7f1ff406b120 2023-07-11T00:00:22.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.914+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2073798961 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff41438a0 con 0x7f1ff406b120 2023-07-11T00:00:22.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.915+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2073798961 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff4074360 con 0x7f1ff406b120 2023-07-11T00:00:22.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.915+0000 7f1fea7fc700 1 -- 172.21.15.38:0/2073798961 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ff000cd20 con 0x7f1ff406b120 2023-07-11T00:00:22.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.916+0000 7f1fea7fc700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1fd806ace0 0x7f1fd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:22.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.916+0000 7f1fea7fc700 1 -- 172.21.15.38:0/2073798961 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ff00894a0 con 0x7f1ff406b120 2023-07-11T00:00:22.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.916+0000 7f1ff965a700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1fd806ace0 0x7f1fd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:22.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.916+0000 7f1ff965a700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1fd806ace0 0x7f1fd806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4014040 tx=0x7f1fe4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:22.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:22.920+0000 7f1fea7fc700 1 -- 172.21.15.38:0/2073798961 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1ff0058070 con 0x7f1ff406b120 2023-07-11T00:00:23.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.118+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2073798961 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ff40700c0 con 0x7f1ff406b120 2023-07-11T00:00:23.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.120+0000 7f1fea7fc700 1 -- 172.21.15.38:0/2073798961 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f1ff0057c00 con 0x7f1ff406b120 2023-07-11T00:00:23.122 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:23.122 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:23.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1fd806ace0 msgr2=0x7f1fd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1fd806ace0 0x7f1fd806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4014040 tx=0x7f1fe4008030 comp rx=0 tx=0).stop 2023-07-11T00:00:23.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2073798961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ff406b120 msgr2=0x7f1ff40b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ff406b120 0x7f1ff40b3e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000e9b0 tx=0x7f1ff000ed70 comp rx=0 tx=0).stop 2023-07-11T00:00:23.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2073798961 shutdown_connections 2023-07-11T00:00:23.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1fd806ace0 0x7f1fd806d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ff414aa40 0x7f1ff41475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ff406b120 0x7f1ff40b3e10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 --2- 172.21.15.38:0/2073798961 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ff41444c0 0x7f1ff41470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2073798961 >> 172.21.15.38:0/2073798961 conn(0x7f1ff40bd980 msgr2=0x7f1ff40bbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2073798961 shutdown_connections 2023-07-11T00:00:23.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.122+0000 7f1ffc0bf700 1 -- 172.21.15.38:0/2073798961 wait complete. 2023-07-11T00:00:23.136 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-11T00:00:23.137 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-11T00:00:23.137 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-11T00:00:23.138 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-11T00:00:23.138 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-11T00:00:23.139 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-11T00:00:23.139 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-11T00:00:23.140 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-11T00:00:23.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.358+0000 7f6024ccf700 1 Processor -- start 2023-07-11T00:00:23.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.359+0000 7f6024ccf700 1 -- start start 2023-07-11T00:00:23.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.358+0000 7f9845f11700 1 Processor -- start 2023-07-11T00:00:23.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.358+0000 7f9845f11700 1 -- start start 2023-07-11T00:00:23.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f9845f11700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f98401573e0 0x7f98400b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f9845f11700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f98400b8690 0x7f98400b9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f9845f11700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98400b5ce0 con 0x7f9840089b10 2023-07-11T00:00:23.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f9845f11700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98401577b0 con 0x7f98401573e0 2023-07-11T00:00:23.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f9845f11700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98400b4d60 con 0x7f98400b8690 2023-07-11T00:00:23.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f6024ccf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6020148d50 0x7f602006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f6024ccf700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6020069f30 0x7f60201593d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f6024ccf700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6020072390 con 0x7f6020148980 2023-07-11T00:00:23.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f6024ccf700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60200b8af0 con 0x7f6020148d50 2023-07-11T00:00:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f6024ccf700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200712a0 con 0x7f6020069f30 2023-07-11T00:00:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f601dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6020148d50 0x7f602006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f601dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6020148d50 0x7f602006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52738/0 (socket says 172.21.15.38:52738) 2023-07-11T00:00:23.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f601dd9b700 1 -- 172.21.15.38:0/3626240148 learned_addr learned my addr 172.21.15.38:0/3626240148 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f983ffff700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9840089b10 0x7f98400b4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:57198/0 (socket says 172.21.15.38:57198) 2023-07-11T00:00:23.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f983ffff700 1 -- 172.21.15.38:0/1598134582 learned_addr learned my addr 172.21.15.38:0/1598134582 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:23.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f983effd700 1 --2- 172.21.15.38:0/1598134582 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f98400b8690 0x7f98400b9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f601ed9d700 1 --2- 172.21.15.38:0/3626240148 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6020069f30 0x7f60201593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f601dd9b700 1 -- 172.21.15.38:0/3626240148 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6020069f30 msgr2=0x7f60201593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f601dd9b700 1 --2- 172.21.15.38:0/3626240148 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6020069f30 0x7f60201593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f601dd9b700 1 -- 172.21.15.38:0/3626240148 >> v1:172.21.15.70:6789/0 conn(0x7f6020148980 legacy=0x7f60200b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.360+0000 7f601dd9b700 1 -- 172.21.15.38:0/3626240148 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6020071580 con 0x7f6020148d50 2023-07-11T00:00:23.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.361+0000 7f601dd9b700 1 --2- 172.21.15.38:0/3626240148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6020148d50 0x7f602006f5e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60100098f0 tx=0x7f6010009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c0c4e6907e46cc server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.361+0000 7f983f7fe700 1 --2- 172.21.15.38:0/1598134582 >> v2:172.21.15.38:3300/0 conn(0x7f98401573e0 0x7f98400b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.361+0000 7f983effd700 1 -- 172.21.15.38:0/1598134582 >> v2:172.21.15.38:3300/0 conn(0x7f98401573e0 msgr2=0x7f98400b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.361+0000 7f983effd700 1 --2- 172.21.15.38:0/1598134582 >> v2:172.21.15.38:3300/0 conn(0x7f98401573e0 0x7f98400b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.361+0000 7f983effd700 1 -- 172.21.15.38:0/1598134582 >> v1:172.21.15.70:6789/0 conn(0x7f9840089b10 legacy=0x7f98400b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.361+0000 7f983effd700 1 -- 172.21.15.38:0/1598134582 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98400b3990 con 0x7f98400b8690 2023-07-11T00:00:23.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.361+0000 7f983effd700 1 --2- 172.21.15.38:0/1598134582 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f98400b8690 0x7f98400b9270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9830009820 tx=0x7f9830009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6419d283a631d36f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.362+0000 7f03ec057700 1 Processor -- start 2023-07-11T00:00:23.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.362+0000 7f983e7fc700 1 -- 172.21.15.38:0/1598134582 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9830005e30 con 0x7f98400b8690 2023-07-11T00:00:23.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.362+0000 7f983e7fc700 1 -- 172.21.15.38:0/1598134582 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9830004030 con 0x7f98400b8690 2023-07-11T00:00:23.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.362+0000 7f983e7fc700 1 -- 172.21.15.38:0/1598134582 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98300043c0 con 0x7f98400b8690 2023-07-11T00:00:23.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.362+0000 7f601d59a700 1 -- 172.21.15.38:0/3626240148 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010004230 con 0x7f6020148d50 2023-07-11T00:00:23.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.362+0000 7f601d59a700 1 -- 172.21.15.38:0/3626240148 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6010004390 con 0x7f6020148d50 2023-07-11T00:00:23.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.362+0000 7f601d59a700 1 -- 172.21.15.38:0/3626240148 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60100036a0 con 0x7f6020148d50 2023-07-11T00:00:23.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.362+0000 7f149d16a700 1 Processor -- start 2023-07-11T00:00:23.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.363+0000 7f149d16a700 1 -- start start 2023-07-11T00:00:23.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.363+0000 7f6024ccf700 1 -- 172.21.15.38:0/3626240148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6020148d50 msgr2=0x7f602006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.363+0000 7f6024ccf700 1 --2- 172.21.15.38:0/3626240148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6020148d50 0x7f602006f5e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60100098f0 tx=0x7f6010009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:23.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.362+0000 7f03ec057700 1 -- start start 2023-07-11T00:00:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.363+0000 7f03ec057700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03e40b8700 0x7f03e40b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.363+0000 7f03ec057700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e40b46f0 con 0x7f03e4146ee0 2023-07-11T00:00:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.363+0000 7f03ec057700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e40b4940 con 0x7f03e40b93d0 2023-07-11T00:00:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.363+0000 7f03ec057700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e40b4c20 con 0x7f03e40b8700 2023-07-11T00:00:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.363+0000 7f03e9df3700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03e40b8700 0x7f03e40b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.363+0000 7f03e9df3700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03e40b8700 0x7f03e40b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53198/0 (socket says 172.21.15.38:53198) 2023-07-11T00:00:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.363+0000 7f03e9df3700 1 -- 172.21.15.38:0/3046860008 learned_addr learned my addr 172.21.15.38:0/3046860008 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f03e9df3700 1 -- 172.21.15.38:0/3046860008 >> v1:172.21.15.70:6789/0 conn(0x7f03e40b93d0 legacy=0x7f03e41467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f03e9df3700 1 -- 172.21.15.38:0/3046860008 >> v1:172.21.15.38:6789/0 conn(0x7f03e4146ee0 legacy=0x7f03e4140240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:00:23.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f03e9df3700 1 -- 172.21.15.38:0/3046860008 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e40b4f00 con 0x7f03e40b8700 2023-07-11T00:00:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f6024ccf700 1 -- 172.21.15.38:0/3626240148 shutdown_connections 2023-07-11T00:00:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f6024ccf700 1 --2- 172.21.15.38:0/3626240148 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6020069f30 0x7f60201593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f6024ccf700 1 --2- 172.21.15.38:0/3626240148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6020148d50 0x7f602006f5e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f6024ccf700 1 -- 172.21.15.38:0/3626240148 >> 172.21.15.38:0/3626240148 conn(0x7f602006d0e0 msgr2=0x7f602006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149d16a700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1498072160 0x7f1498144380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149d16a700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f14980b8b00 0x7f14981448c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149d16a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14980725f0 con 0x7f149806c5e0 2023-07-11T00:00:23.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149d16a700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14980b5740 con 0x7f14980b8b00 2023-07-11T00:00:23.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149d16a700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14980b4b60 con 0x7f1498072160 2023-07-11T00:00:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f9845f11700 1 -- 172.21.15.38:0/1598134582 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f98400b8690 msgr2=0x7f98400b9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f9845f11700 1 --2- 172.21.15.38:0/1598134582 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f98400b8690 0x7f98400b9270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9830009820 tx=0x7f9830009b30 comp rx=0 tx=0).stop 2023-07-11T00:00:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149659c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1498072160 0x7f1498144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149659c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1498072160 0x7f1498144380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42710/0 (socket says 172.21.15.38:42710) 2023-07-11T00:00:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149659c700 1 -- 172.21.15.38:0/2547198295 learned_addr learned my addr 172.21.15.38:0/2547198295 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149759e700 1 --2- 172.21.15.38:0/2547198295 >> v2:172.21.15.70:3300/0 conn(0x7f14980b8b00 0x7f14981448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f03e9df3700 1 --2- 172.21.15.38:0/3046860008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03e40b8700 0x7f03e40b3b00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009e50 tx=0x7f03dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e32d5e19e247fb08 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149659c700 1 -- 172.21.15.38:0/2547198295 >> v2:172.21.15.70:3300/0 conn(0x7f14980b8b00 msgr2=0x7f14981448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149659c700 1 --2- 172.21.15.38:0/2547198295 >> v2:172.21.15.70:3300/0 conn(0x7f14980b8b00 0x7f14981448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149659c700 1 -- 172.21.15.38:0/2547198295 >> v1:172.21.15.38:6789/0 conn(0x7f149806c5e0 legacy=0x7f14980b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f149659c700 1 -- 172.21.15.38:0/2547198295 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1498144e00 con 0x7f1498072160 2023-07-11T00:00:23.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f9845f11700 1 -- 172.21.15.38:0/1598134582 shutdown_connections 2023-07-11T00:00:23.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f9845f11700 1 --2- 172.21.15.38:0/1598134582 >> v2:172.21.15.38:3300/0 conn(0x7f98401573e0 0x7f98400b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f9845f11700 1 --2- 172.21.15.38:0/1598134582 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f98400b8690 0x7f98400b9270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.364+0000 7f9845f11700 1 -- 172.21.15.38:0/1598134582 >> 172.21.15.38:0/1598134582 conn(0x7f9840069f30 msgr2=0x7f984006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.365+0000 7f9845f11700 1 -- 172.21.15.38:0/1598134582 shutdown_connections 2023-07-11T00:00:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.365+0000 7fa94a023700 1 Processor -- start 2023-07-11T00:00:23.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.365+0000 7f9845f11700 1 -- 172.21.15.38:0/1598134582 wait complete. 2023-07-11T00:00:23.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.365+0000 7f03e8df1700 1 -- 172.21.15.38:0/3046860008 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc00e070 con 0x7f03e40b8700 2023-07-11T00:00:23.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.365+0000 7f03e8df1700 1 -- 172.21.15.38:0/3046860008 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc003a20 con 0x7f03e40b8700 2023-07-11T00:00:23.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.365+0000 7f03e8df1700 1 -- 172.21.15.38:0/3046860008 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc003dd0 con 0x7f03e40b8700 2023-07-11T00:00:23.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7f03ec057700 1 -- 172.21.15.38:0/3046860008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03e40b8700 msgr2=0x7f03e40b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7f03ec057700 1 --2- 172.21.15.38:0/3046860008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03e40b8700 0x7f03e40b3b00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009e50 tx=0x7f03dc00b330 comp rx=0 tx=0).stop 2023-07-11T00:00:23.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7f03ec057700 1 -- 172.21.15.38:0/3046860008 shutdown_connections 2023-07-11T00:00:23.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7f03ec057700 1 --2- 172.21.15.38:0/3046860008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03e40b8700 0x7f03e40b3b00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7f03ec057700 1 -- 172.21.15.38:0/3046860008 >> 172.21.15.38:0/3046860008 conn(0x7f03e4069f30 msgr2=0x7f03e406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7f03ec057700 1 -- 172.21.15.38:0/3046860008 shutdown_connections 2023-07-11T00:00:23.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7f03ec057700 1 -- 172.21.15.38:0/3046860008 wait complete. 2023-07-11T00:00:23.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.365+0000 7f6024ccf700 1 -- 172.21.15.38:0/3626240148 shutdown_connections 2023-07-11T00:00:23.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.365+0000 7f6024ccf700 1 -- 172.21.15.38:0/3626240148 wait complete. 2023-07-11T00:00:23.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7f9845f11700 1 Processor -- start 2023-07-11T00:00:23.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.365+0000 7fa94a023700 1 -- start start 2023-07-11T00:00:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7fa94a023700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa9440b93d0 0x7fa9441467d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7fa94a023700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9440b4210 con 0x7fa9440b8700 2023-07-11T00:00:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7fa94a023700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9440b46f0 con 0x7fa944146d10 2023-07-11T00:00:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.366+0000 7fa94a023700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9441471b0 con 0x7fa9440b93d0 2023-07-11T00:00:23.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7f6024ccf700 1 Processor -- start 2023-07-11T00:00:23.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7f149659c700 1 --2- 172.21.15.38:0/2547198295 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1498072160 0x7f1498144380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f148c0098f0 tx=0x7f148c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22fe3a8d3573baf3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7fa9437fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa9440b8700 0x7fa9440b3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54446/0 (socket says 172.21.15.38:54446) 2023-07-11T00:00:23.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7fa9437fe700 1 -- 172.21.15.38:0/3368039197 learned_addr learned my addr 172.21.15.38:0/3368039197 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:23.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7f1495d9b700 1 -- 172.21.15.38:0/2547198295 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c011830 con 0x7f1498072160 2023-07-11T00:00:23.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7f1495d9b700 1 -- 172.21.15.38:0/2547198295 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c011990 con 0x7f1498072160 2023-07-11T00:00:23.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7f1495d9b700 1 -- 172.21.15.38:0/2547198295 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c011d20 con 0x7f1498072160 2023-07-11T00:00:23.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266666655 0 0) 0x7fa9440b4210 con 0x7fa9440b8700 2023-07-11T00:00:23.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9300035b0 con 0x7fa9440b8700 2023-07-11T00:00:23.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7fa93bfff700 1 --2- 172.21.15.38:0/3368039197 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa9440b93d0 0x7fa9441467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3607911285 0 0) 0x7fa9300035b0 con 0x7fa9440b8700 2023-07-11T00:00:23.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa9440b93d0 msgr2=0x7fa9441467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7fa942ffd700 1 --2- 172.21.15.38:0/3368039197 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa9440b93d0 0x7fa9441467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 >> v1:172.21.15.70:6789/0 conn(0x7fa944146d10 legacy=0x7fa944140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9440b4940 con 0x7fa9440b8700 2023-07-11T00:00:23.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7fa934001670 con 0x7fa9440b8700 2023-07-11T00:00:23.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 >> v1:172.21.15.38:6789/0 conn(0x7fa9440b8700 legacy=0x7fa9440b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa942ffd700 1 --2- 172.21.15.38:0/3368039197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa930003a30 0x7fa930003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa942ffd700 1 --2- 172.21.15.38:0/3368039197 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa930004850 0x7fa930004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa942ffd700 1 --2- 172.21.15.38:0/3368039197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa930005200 0x7fa93000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9441471b0 con 0x7fa930003a30 2023-07-11T00:00:23.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93000c0e0 con 0x7fa930005200 2023-07-11T00:00:23.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93000c2a0 con 0x7fa930004850 2023-07-11T00:00:23.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f03ec057700 1 Processor -- start 2023-07-11T00:00:23.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7f6024ccf700 1 -- start start 2023-07-11T00:00:23.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f6024ccf700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6020069f30 0x7f6020151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.367+0000 7f9845f11700 1 -- start start 2023-07-11T00:00:23.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f9845f11700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9840089b10 0x7f98400b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f9845f11700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f98400b8690 0x7f984015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f9845f11700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98401573e0 0x7f9840153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f9845f11700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9840071a90 con 0x7f98401573e0 2023-07-11T00:00:23.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f9845f11700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98400bb170 con 0x7f9840089b10 2023-07-11T00:00:23.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f9845f11700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9840071180 con 0x7f98400b8690 2023-07-11T00:00:23.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f6024ccf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6020148980 0x7f6020150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f6024ccf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6020148d50 0x7f60201425f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f6024ccf700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602013da50 con 0x7f6020148980 2023-07-11T00:00:23.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f6024ccf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020142b30 con 0x7f6020148d50 2023-07-11T00:00:23.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f6024ccf700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6020151270 con 0x7f6020069f30 2023-07-11T00:00:23.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f601e59c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6020069f30 0x7f6020151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f983ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98401573e0 0x7f9840153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f983ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98401573e0 0x7f9840153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52754/0 (socket says 172.21.15.38:52754) 2023-07-11T00:00:23.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f983ffff700 1 -- 172.21.15.38:0/3122221100 learned_addr learned my addr 172.21.15.38:0/3122221100 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f601ed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6020148d50 0x7f60201425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f601ed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6020148d50 0x7f60201425f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53230/0 (socket says 172.21.15.38:53230) 2023-07-11T00:00:23.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f601ed9d700 1 -- 172.21.15.38:0/2259206795 learned_addr learned my addr 172.21.15.38:0/2259206795 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f601dd9b700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6020148980 0x7f6020150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa67e64f700 1 Processor -- start 2023-07-11T00:00:23.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f03ec057700 1 -- start start 2023-07-11T00:00:23.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f149d16a700 1 -- 172.21.15.38:0/2547198295 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1498072160 msgr2=0x7f1498144380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7f149d16a700 1 --2- 172.21.15.38:0/2547198295 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1498072160 0x7f1498144380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f148c0098f0 tx=0x7f148c009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:23.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03ec057700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03e40b8700 0x7f03e40702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03ec057700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03e40b93d0 0x7f03e41e3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03ec057700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03e4146ee0 0x7f03e41d70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03ec057700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e41d7610 con 0x7f03e4146ee0 2023-07-11T00:00:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03ec057700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e40725f0 con 0x7f03e40b8700 2023-07-11T00:00:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03ec057700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e406fe10 con 0x7f03e40b93d0 2023-07-11T00:00:23.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f149d16a700 1 -- 172.21.15.38:0/2547198295 shutdown_connections 2023-07-11T00:00:23.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f149d16a700 1 --2- 172.21.15.38:0/2547198295 >> v2:172.21.15.70:3300/0 conn(0x7f14980b8b00 0x7f14981448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f149d16a700 1 --2- 172.21.15.38:0/2547198295 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1498072160 0x7f1498144380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f149d16a700 1 -- 172.21.15.38:0/2547198295 >> 172.21.15.38:0/2547198295 conn(0x7f14980bc880 msgr2=0x7f14980bcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f601ed9d700 1 -- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6020069f30 msgr2=0x7f6020151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f601ed9d700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6020069f30 0x7f6020151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f149d16a700 1 -- 172.21.15.38:0/2547198295 shutdown_connections 2023-07-11T00:00:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f601ed9d700 1 -- 172.21.15.38:0/2259206795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6020148980 msgr2=0x7f6020150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f601ed9d700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6020148980 0x7f6020150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f601ed9d700 1 -- 172.21.15.38:0/2259206795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010009550 con 0x7f6020148d50 2023-07-11T00:00:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f601dd9b700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6020148980 0x7f6020150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f601e59c700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6020069f30 0x7f6020151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f983ffff700 1 -- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f98400b8690 msgr2=0x7f984015aff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-11T00:00:23.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f983ffff700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f98400b8690 0x7f984015aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03e9df3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03e40b8700 0x7f03e40702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03e9df3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03e40b8700 0x7f03e40702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53238/0 (socket says 172.21.15.38:53238) 2023-07-11T00:00:23.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f983ffff700 1 -- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9840089b10 msgr2=0x7f98400b2cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-11T00:00:23.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f983ffff700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9840089b10 0x7f98400b2cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03e9df3700 1 -- 172.21.15.38:0/1490185481 learned_addr learned my addr 172.21.15.38:0/1490185481 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f983ffff700 1 -- 172.21.15.38:0/3122221100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9830009430 con 0x7f98401573e0 2023-07-11T00:00:23.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.368+0000 7fa9437fe700 1 --2- 172.21.15.38:0/3368039197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa930003a30 0x7fa930003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f149d16a700 1 -- 172.21.15.38:0/2547198295 wait complete. 2023-07-11T00:00:23.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03e95f2700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03e40b93d0 0x7f03e41e3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7fa9437fe700 1 -- 172.21.15.38:0/3368039197 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa930004850 msgr2=0x7fa930004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:00:23.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7fa9437fe700 1 --2- 172.21.15.38:0/3368039197 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa930004850 0x7fa930004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7fa9437fe700 1 -- 172.21.15.38:0/3368039197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa930005200 msgr2=0x7fa93000ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:00:23.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7fa9437fe700 1 --2- 172.21.15.38:0/3368039197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa930005200 0x7fa93000ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7fa9437fe700 1 -- 172.21.15.38:0/3368039197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9440b4940 con 0x7fa930003a30 2023-07-11T00:00:23.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7fa9437fe700 1 --2- 172.21.15.38:0/3368039197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa930003a30 0x7fa930003e40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa93400d350 tx=0x7fa930005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384fdb26a43b0b56 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.370+0000 7f983ffff700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98401573e0 0x7f9840153790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f983800caf0 tx=0x7f983800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.370+0000 7f9827fff700 1 -- 172.21.15.38:0/3122221100 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800aad0 con 0x7f98401573e0 2023-07-11T00:00:23.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.370+0000 7f9827fff700 1 -- 172.21.15.38:0/3122221100 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983800ac30 con 0x7f98401573e0 2023-07-11T00:00:23.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.370+0000 7f9827fff700 1 -- 172.21.15.38:0/3122221100 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838012400 con 0x7f98401573e0 2023-07-11T00:00:23.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.370+0000 7f9845f11700 1 -- 172.21.15.38:0/3122221100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9840071d00 con 0x7f98401573e0 2023-07-11T00:00:23.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.370+0000 7f9845f11700 1 -- 172.21.15.38:0/3122221100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984015b530 con 0x7f98401573e0 2023-07-11T00:00:23.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.371+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93400f400 con 0x7fa930003a30 2023-07-11T00:00:23.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.371+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93400f560 con 0x7fa930003a30 2023-07-11T00:00:23.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.371+0000 7fa942ffd700 1 -- 172.21.15.38:0/3368039197 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93400f8d0 con 0x7fa930003a30 2023-07-11T00:00:23.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7fa67e64f700 1 -- start start 2023-07-11T00:00:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.370+0000 7fa67e64f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa6780b3ad0 0x7fa67814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.370+0000 7fa67e64f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa678149060 0x7fa6780b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.371+0000 7fa67e64f700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6781521a0 con 0x7fa6780b4670 2023-07-11T00:00:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.371+0000 7fa67e64f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa678152480 con 0x7fa6780b3ad0 2023-07-11T00:00:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.371+0000 7fa67e64f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa678152760 con 0x7fa678149060 2023-07-11T00:00:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.371+0000 7f9845f11700 1 -- 172.21.15.38:0/3122221100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98400b5f50 con 0x7f98401573e0 2023-07-11T00:00:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.371+0000 7f149d16a700 1 Processor -- start 2023-07-11T00:00:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.371+0000 7f149d16a700 1 -- start start 2023-07-11T00:00:23.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f601ed9d700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6020148d50 0x7f60201425f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6018009dd0 tx=0x7f601800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f600effd700 1 -- 172.21.15.38:0/2259206795 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018009c40 con 0x7f6020148d50 2023-07-11T00:00:23.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f600effd700 1 -- 172.21.15.38:0/2259206795 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601800f040 con 0x7f6020148d50 2023-07-11T00:00:23.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f600effd700 1 -- 172.21.15.38:0/2259206795 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800ceb0 con 0x7f6020148d50 2023-07-11T00:00:23.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f6024ccf700 1 -- 172.21.15.38:0/2259206795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602013fe40 con 0x7f6020148d50 2023-07-11T00:00:23.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.370+0000 7f6024ccf700 1 -- 172.21.15.38:0/2259206795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6020150260 con 0x7f6020148d50 2023-07-11T00:00:23.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.371+0000 7f6024ccf700 1 -- 172.21.15.38:0/2259206795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6004000fc0 con 0x7f6020148d50 2023-07-11T00:00:23.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03e9df3700 1 -- 172.21.15.38:0/1490185481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03e40b93d0 msgr2=0x7f03e41e3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03e9df3700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03e40b93d0 0x7f03e41e3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03e9df3700 1 -- 172.21.15.38:0/1490185481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03e4146ee0 msgr2=0x7f03e41d70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03e9df3700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03e4146ee0 0x7f03e41d70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.369+0000 7f03e9df3700 1 -- 172.21.15.38:0/1490185481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc009b30 con 0x7f03e40b8700 2023-07-11T00:00:23.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7fa94a023700 1 -- 172.21.15.38:0/3368039197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa930003a30 msgr2=0x7fa930003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7fa94a023700 1 --2- 172.21.15.38:0/3368039197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa930003a30 0x7fa930003e40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa93400d350 tx=0x7fa930005880 comp rx=0 tx=0).stop 2023-07-11T00:00:23.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f149d16a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f149806c5e0 0x7f14981d2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f149d16a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1498072160 0x7f14981d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f149d16a700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14980b8b00 0x7f14981df620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f149d16a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14981d1730 con 0x7f1498072160 2023-07-11T00:00:23.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f149d16a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14981d2360 con 0x7f149806c5e0 2023-07-11T00:00:23.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f149d16a700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1498070150 con 0x7f14980b8b00 2023-07-11T00:00:23.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7fa677fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa6780b3ad0 0x7fa67814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7fa677fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa6780b3ad0 0x7fa67814eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52796/0 (socket says 172.21.15.38:52796) 2023-07-11T00:00:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7fa677fff700 1 -- 172.21.15.38:0/2566172729 learned_addr learned my addr 172.21.15.38:0/2566172729 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f149759e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14980b8b00 0x7f14981df620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f03e9df3700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03e40b8700 0x7f03e40702a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f03e406e0c0 tx=0x7f03dc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f149759e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14980b8b00 0x7f14981df620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42748/0 (socket says 172.21.15.38:42748) 2023-07-11T00:00:23.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f149759e700 1 -- 172.21.15.38:0/4030619905 learned_addr learned my addr 172.21.15.38:0/4030619905 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f1496d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f149806c5e0 0x7f14981d2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7fa677fff700 1 -- 172.21.15.38:0/2566172729 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa678149060 msgr2=0x7fa6780b4ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:00:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7fa677fff700 1 --2- 172.21.15.38:0/2566172729 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa678149060 0x7fa6780b4ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7fa677fff700 1 -- 172.21.15.38:0/2566172729 >> v1:172.21.15.70:6789/0 conn(0x7fa6780b4670 legacy=0x7fa678148950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:00:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f149659c700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1498072160 0x7f14981d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7f149759e700 1 -- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f149806c5e0 msgr2=0x7f14981d2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f149759e700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f149806c5e0 0x7f14981d2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f149759e700 1 -- 172.21.15.38:0/4030619905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1498072160 msgr2=0x7f14981d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f149759e700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1498072160 0x7f14981d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f149759e700 1 -- 172.21.15.38:0/4030619905 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c009550 con 0x7f14980b8b00 2023-07-11T00:00:23.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7fa943fff700 1 -- 172.21.15.38:0/3368039197 reap_dead start 2023-07-11T00:00:23.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.372+0000 7fa677fff700 1 -- 172.21.15.38:0/2566172729 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678152a40 con 0x7fa6780b3ad0 2023-07-11T00:00:23.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f9827fff700 1 -- 172.21.15.38:0/3122221100 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9838012560 con 0x7f98401573e0 2023-07-11T00:00:23.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f8420733700 1 Processor -- start 2023-07-11T00:00:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f149759e700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14980b8b00 0x7f14981df620 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f149000efc0 tx=0x7f149000c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7fa677fff700 1 --2- 172.21.15.38:0/2566172729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6780b3ad0 0x7fa67814eb50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa6680098f0 tx=0x7fa668009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9281273770691e5d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f9827fff700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f982c06ace0 0x7f982c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f9827fff700 1 -- 172.21.15.38:0/3122221100 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f983808a2d0 con 0x7f98401573e0 2023-07-11T00:00:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f983f7fe700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f982c06ace0 0x7f982c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f9827fff700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:6824/2098956368,v1:172.21.15.70:6825/2098956368] conn(0x7f982c073510 0x7f982c075920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f9827fff700 1 -- 172.21.15.38:0/3122221100 --> [v2:172.21.15.70:6824/2098956368,v1:172.21.15.70:6825/2098956368] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f982c075fd0 con 0x7f982c073510 2023-07-11T00:00:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f9827fff700 1 -- 172.21.15.38:0/3122221100 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f983808a720 con 0x7f98401573e0 2023-07-11T00:00:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f983effd700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:6824/2098956368,v1:172.21.15.70:6825/2098956368] conn(0x7f982c073510 0x7f982c075920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f983f7fe700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f982c06ace0 0x7f982c06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f983400bb70 tx=0x7f983400b420 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f147f7fe700 1 -- 172.21.15.38:0/4030619905 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000cad0 con 0x7f14980b8b00 2023-07-11T00:00:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f147f7fe700 1 -- 172.21.15.38:0/4030619905 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149000f040 con 0x7f14980b8b00 2023-07-11T00:00:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f147f7fe700 1 -- 172.21.15.38:0/4030619905 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000ce70 con 0x7f14980b8b00 2023-07-11T00:00:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f149d16a700 1 -- 172.21.15.38:0/4030619905 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1498071590 con 0x7f14980b8b00 2023-07-11T00:00:23.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f149d16a700 1 -- 172.21.15.38:0/4030619905 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14981d1350 con 0x7f14980b8b00 2023-07-11T00:00:23.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f149d16a700 1 -- 172.21.15.38:0/4030619905 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1478000fc0 con 0x7f14980b8b00 2023-07-11T00:00:23.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f983effd700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:6824/2098956368,v1:172.21.15.70:6825/2098956368] conn(0x7f982c073510 0x7f982c075920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7f8420733700 1 -- start start 2023-07-11T00:00:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f8420733700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84180b4670 0x7f84180b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f8420733700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8418148950 0x7f8418148db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f8420733700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84181492f0 con 0x7f84180b3ad0 2023-07-11T00:00:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f8420733700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841814f260 con 0x7f8418148950 2023-07-11T00:00:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f8420733700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84181521a0 con 0x7f84180b4670 2023-07-11T00:00:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7fa676ffd700 1 -- 172.21.15.38:0/2566172729 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668004230 con 0x7fa6780b3ad0 2023-07-11T00:00:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7fa676ffd700 1 -- 172.21.15.38:0/2566172729 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa668004390 con 0x7fa6780b3ad0 2023-07-11T00:00:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.373+0000 7fa676ffd700 1 -- 172.21.15.38:0/2566172729 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6680036a0 con 0x7fa6780b3ad0 2023-07-11T00:00:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f841ecd0700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8418148950 0x7f8418148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f841ecd0700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8418148950 0x7f8418148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53260/0 (socket says 172.21.15.38:53260) 2023-07-11T00:00:23.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f841ecd0700 1 -- 172.21.15.38:0/1771250208 learned_addr learned my addr 172.21.15.38:0/1771250208 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7fa94a023700 1 -- 172.21.15.38:0/3368039197 shutdown_connections 2023-07-11T00:00:23.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7fa94a023700 1 -- 172.21.15.38:0/3368039197 >> 172.21.15.38:0/3368039197 conn(0x7fa944069f30 msgr2=0x7fa94406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f841d4cd700 1 -- 172.21.15.38:0/1771250208 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866462145 0 0) 0x7f84181492f0 con 0x7f84180b3ad0 2023-07-11T00:00:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f841d4cd700 1 -- 172.21.15.38:0/1771250208 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84040035b0 con 0x7f84180b3ad0 2023-07-11T00:00:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f841ecd0700 1 -- 172.21.15.38:0/1771250208 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84180b4670 msgr2=0x7f84180b4ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:00:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f841ecd0700 1 --2- 172.21.15.38:0/1771250208 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84180b4670 0x7f84180b4ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f841ecd0700 1 -- 172.21.15.38:0/1771250208 >> v1:172.21.15.38:6789/0 conn(0x7f84180b3ad0 legacy=0x7f841814eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f9827fff700 1 -- 172.21.15.38:0/3122221100 <== osd.6 v2:172.21.15.70:6824/2098956368 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f982c075fd0 con 0x7f982c073510 2023-07-11T00:00:23.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f841ecd0700 1 -- 172.21.15.38:0/1771250208 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8418152480 con 0x7f8418148950 2023-07-11T00:00:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.376+0000 7fa67e64f700 1 -- 172.21.15.38:0/2566172729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6780b3ad0 msgr2=0x7fa67814eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.376+0000 7fa67e64f700 1 --2- 172.21.15.38:0/2566172729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6780b3ad0 0x7fa67814eb50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa6680098f0 tx=0x7fa668009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:23.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f600effd700 1 -- 172.21.15.38:0/2259206795 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6018014480 con 0x7f6020148d50 2023-07-11T00:00:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.374+0000 7f600effd700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f600006ace0 0x7f600006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f601e59c700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f600006ace0 0x7f600006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f600effd700 1 -- 172.21.15.38:0/2259206795 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f601808a3f0 con 0x7f6020148d50 2023-07-11T00:00:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f600effd700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:6800/3020490369,v1:172.21.15.70:6801/3020490369] conn(0x7f6000073590 0x7f60000759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f600effd700 1 -- 172.21.15.38:0/2259206795 --> [v2:172.21.15.70:6800/3020490369,v1:172.21.15.70:6801/3020490369] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6000076050 con 0x7f6000073590 2023-07-11T00:00:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f600effd700 1 -- 172.21.15.38:0/2259206795 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f601808a7a0 con 0x7f6020148d50 2023-07-11T00:00:23.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f601e59c700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f600006ace0 0x7f600006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6014007fd0 tx=0x7f6014009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f03da7fc700 1 -- 172.21.15.38:0/1490185481 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc0092e0 con 0x7f03e40b8700 2023-07-11T00:00:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f03da7fc700 1 -- 172.21.15.38:0/1490185481 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc004240 con 0x7f03e40b8700 2023-07-11T00:00:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f03ec057700 1 -- 172.21.15.38:0/1490185481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e4072030 con 0x7f03e40b8700 2023-07-11T00:00:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.375+0000 7f03ec057700 1 -- 172.21.15.38:0/1490185481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e4143500 con 0x7f03e40b8700 2023-07-11T00:00:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.376+0000 7f03da7fc700 1 -- 172.21.15.38:0/1490185481 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc0045f0 con 0x7f03e40b8700 2023-07-11T00:00:23.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.376+0000 7f03ec057700 1 -- 172.21.15.38:0/1490185481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03cc000fc0 con 0x7f03e40b8700 2023-07-11T00:00:23.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f841ecd0700 1 --2- 172.21.15.38:0/1771250208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8418148950 0x7f8418148db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8410009e50 tx=0x7f841000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d53b2db7eb83ca66 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f147f7fe700 1 -- 172.21.15.38:0/4030619905 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1490014480 con 0x7f14980b8b00 2023-07-11T00:00:23.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7fa94a023700 1 -- 172.21.15.38:0/3368039197 shutdown_connections 2023-07-11T00:00:23.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f601dd9b700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:6800/3020490369,v1:172.21.15.70:6801/3020490369] conn(0x7f6000073590 0x7f60000759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7fa67e64f700 1 -- 172.21.15.38:0/2566172729 shutdown_connections 2023-07-11T00:00:23.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7fa67e64f700 1 --2- 172.21.15.38:0/2566172729 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa678149060 0x7fa6780b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7fa67e64f700 1 --2- 172.21.15.38:0/2566172729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6780b3ad0 0x7fa67814eb50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7fa67e64f700 1 -- 172.21.15.38:0/2566172729 >> 172.21.15.38:0/2566172729 conn(0x7fa678069f30 msgr2=0x7fa67806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7fa94a023700 1 -- 172.21.15.38:0/3368039197 wait complete. 2023-07-11T00:00:23.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f841d4cd700 1 -- 172.21.15.38:0/1771250208 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000e070 con 0x7f8418148950 2023-07-11T00:00:23.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f147f7fe700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f148406adb0 0x7f148406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f841d4cd700 1 -- 172.21.15.38:0/1771250208 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8410003a20 con 0x7f8418148950 2023-07-11T00:00:23.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f841d4cd700 1 -- 172.21.15.38:0/1771250208 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410003dd0 con 0x7f8418148950 2023-07-11T00:00:23.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f147f7fe700 1 -- 172.21.15.38:0/4030619905 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f149008a290 con 0x7f14980b8b00 2023-07-11T00:00:23.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7fa67e64f700 1 -- 172.21.15.38:0/2566172729 shutdown_connections 2023-07-11T00:00:23.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f147f7fe700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:6808/3665672607,v1:172.21.15.70:6809/3665672607] conn(0x7f1484073660 0x7f1484075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f147f7fe700 1 -- 172.21.15.38:0/4030619905 --> [v2:172.21.15.70:6808/3665672607,v1:172.21.15.70:6809/3665672607] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1484076120 con 0x7f1484073660 2023-07-11T00:00:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f1496d9d700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f148406adb0 0x7f148406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7f147f7fe700 1 -- 172.21.15.38:0/4030619905 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f149008a640 con 0x7f14980b8b00 2023-07-11T00:00:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.378+0000 7f149659c700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:6808/3665672607,v1:172.21.15.70:6809/3665672607] conn(0x7f1484073660 0x7f1484075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.378+0000 7f8420733700 1 -- 172.21.15.38:0/1771250208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8418148950 msgr2=0x7f8418148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.378+0000 7f8420733700 1 --2- 172.21.15.38:0/1771250208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8418148950 0x7f8418148db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8410009e50 tx=0x7f841000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.378+0000 7f149659c700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:6808/3665672607,v1:172.21.15.70:6809/3665672607] conn(0x7f1484073660 0x7f1484075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.378+0000 7f8420733700 1 -- 172.21.15.38:0/1771250208 shutdown_connections 2023-07-11T00:00:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.378+0000 7f8420733700 1 --2- 172.21.15.38:0/1771250208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8418148950 0x7f8418148db0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.378+0000 7f8420733700 1 --2- 172.21.15.38:0/1771250208 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84180b4670 0x7f84180b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.378+0000 7f8420733700 1 -- 172.21.15.38:0/1771250208 >> 172.21.15.38:0/1771250208 conn(0x7f8418069f30 msgr2=0x7f841806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.378+0000 7f1496d9d700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f148406adb0 0x7f148406d260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1488007fd0 tx=0x7f1488009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.377+0000 7fa67e64f700 1 -- 172.21.15.38:0/2566172729 wait complete. 2023-07-11T00:00:23.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.379+0000 7fa67e64f700 1 Processor -- start 2023-07-11T00:00:23.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.379+0000 7fa94a023700 1 Processor -- start 2023-07-11T00:00:23.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.379+0000 7f147f7fe700 1 -- 172.21.15.38:0/4030619905 <== osd.5 v2:172.21.15.70:6808/3665672607 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1484076120 con 0x7f1484073660 2023-07-11T00:00:23.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.379+0000 7fa67e64f700 1 -- start start 2023-07-11T00:00:23.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.380+0000 7fa67e64f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6780b3ad0 0x7fa678132c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.380+0000 7fa67e64f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6780b4670 0x7fa6781500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.380+0000 7fa67e64f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa678149060 0x7fa6781505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.380+0000 7fa67e64f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa678133160 con 0x7fa6780b3ad0 2023-07-11T00:00:23.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.380+0000 7fa67e64f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa678141020 con 0x7fa678149060 2023-07-11T00:00:23.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.380+0000 7fa67e64f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa678141270 con 0x7fa6780b4670 2023-07-11T00:00:23.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.380+0000 7fa94a023700 1 -- start start 2023-07-11T00:00:23.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7fa94a023700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9441cd450 0x7fa9441dee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7fa94a023700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa944141050 0x7fa9441df340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7fa94a023700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa944072340 0x7fa94413cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7fa94a023700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa944142eb0 con 0x7fa944141050 2023-07-11T00:00:23.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7fa94a023700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa944143190 con 0x7fa9441cd450 2023-07-11T00:00:23.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7fa94a023700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa944143470 con 0x7fa944072340 2023-07-11T00:00:23.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7fa943fff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa944072340 0x7fa94413cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7fa943fff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa944072340 0x7fa94413cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42772/0 (socket says 172.21.15.38:42772) 2023-07-11T00:00:23.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7fa943fff700 1 -- 172.21.15.38:0/602597134 learned_addr learned my addr 172.21.15.38:0/602597134 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7fa9437fe700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9441cd450 0x7fa9441dee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa677fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6780b3ad0 0x7fa678132c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa677fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6780b3ad0 0x7fa678132c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52812/0 (socket says 172.21.15.38:52812) 2023-07-11T00:00:23.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa677fff700 1 -- 172.21.15.38:0/1367708329 learned_addr learned my addr 172.21.15.38:0/1367708329 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa9437fe700 1 -- 172.21.15.38:0/602597134 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa944072340 msgr2=0x7fa94413cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa9437fe700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa944072340 0x7fa94413cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa9437fe700 1 -- 172.21.15.38:0/602597134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa944141050 msgr2=0x7fa9441df340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa9437fe700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa944141050 0x7fa9441df340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa9437fe700 1 -- 172.21.15.38:0/602597134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa944143750 con 0x7fa9441cd450 2023-07-11T00:00:23.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa677fff700 1 -- 172.21.15.38:0/1367708329 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6780b4670 msgr2=0x7fa6781500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa677fff700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6780b4670 0x7fa6781500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa677fff700 1 -- 172.21.15.38:0/1367708329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa678149060 msgr2=0x7fa6781505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa677fff700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa678149060 0x7fa6781505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa677fff700 1 -- 172.21.15.38:0/1367708329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa668009550 con 0x7fa6780b3ad0 2023-07-11T00:00:23.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa9437fe700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9441cd450 0x7fa9441dee00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa934015000 tx=0x7fa934001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.380+0000 7f03da7fc700 1 -- 172.21.15.38:0/1490185481 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03dc019070 con 0x7f03e40b8700 2023-07-11T00:00:23.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa677fff700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6780b3ad0 0x7fa678132c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa67806ccd0 tx=0x7fa668004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.380+0000 7f03da7fc700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f03c806ad60 0x7f03c806d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7f03da7fc700 1 -- 172.21.15.38:0/1490185481 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03dc08a840 con 0x7f03e40b8700 2023-07-11T00:00:23.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7f03e95f2700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f03c806ad60 0x7f03c806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7f03da7fc700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.38:6808/3299763585,v1:172.21.15.38:6809/3299763585] conn(0x7f03c8073610 0x7f03c8075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7f03da7fc700 1 -- 172.21.15.38:0/1490185481 --> [v2:172.21.15.38:6808/3299763585,v1:172.21.15.38:6809/3299763585] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03c80760d0 con 0x7f03c8073610 2023-07-11T00:00:23.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7f03da7fc700 1 -- 172.21.15.38:0/1490185481 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03dc08ace0 con 0x7f03e40b8700 2023-07-11T00:00:23.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.381+0000 7f03e95f2700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f03c806ad60 0x7f03c806d210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f03e4143ef0 tx=0x7f03e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7f03ea5f4700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.38:6808/3299763585,v1:172.21.15.38:6809/3299763585] conn(0x7f03c8073610 0x7f03c8075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7f03ea5f4700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.38:6808/3299763585,v1:172.21.15.38:6809/3299763585] conn(0x7f03c8073610 0x7f03c8075a20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.380+0000 7f8420733700 1 -- 172.21.15.38:0/1771250208 shutdown_connections 2023-07-11T00:00:23.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7fa940ff9700 1 -- 172.21.15.38:0/602597134 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93400f400 con 0x7fa9441cd450 2023-07-11T00:00:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.383+0000 7fa940ff9700 1 -- 172.21.15.38:0/602597134 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934001630 con 0x7fa9441cd450 2023-07-11T00:00:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.383+0000 7fa940ff9700 1 -- 172.21.15.38:0/602597134 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340266a0 con 0x7fa9441cd450 2023-07-11T00:00:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.383+0000 7fa94a023700 1 -- 172.21.15.38:0/602597134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9441cd820 con 0x7fa9441cd450 2023-07-11T00:00:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.383+0000 7fa94a023700 1 -- 172.21.15.38:0/602597134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94413d290 con 0x7fa9441cd450 2023-07-11T00:00:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.383+0000 7fa94a023700 1 -- 172.21.15.38:0/602597134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9441dea40 con 0x7fa9441cd450 2023-07-11T00:00:23.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.383+0000 7f03da7fc700 1 -- 172.21.15.38:0/1490185481 <== osd.2 v2:172.21.15.38:6808/3299763585 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f03c80760d0 con 0x7f03c8073610 2023-07-11T00:00:23.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.380+0000 7f601dd9b700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:6800/3020490369,v1:172.21.15.70:6801/3020490369] conn(0x7f6000073590 0x7f60000759a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.382+0000 7f600effd700 1 -- 172.21.15.38:0/2259206795 <== osd.4 v2:172.21.15.70:6800/3020490369 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6000076050 con 0x7f6000073590 2023-07-11T00:00:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.384+0000 7f53f1da1700 1 Processor -- start 2023-07-11T00:00:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.384+0000 7f8420733700 1 -- 172.21.15.38:0/1771250208 wait complete. 2023-07-11T00:00:23.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.384+0000 7f53f1da1700 1 -- start start 2023-07-11T00:00:23.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53f1da1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53ec14f320 0x7f53ec070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53f1da1700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f53ec071380 0x7f53ec1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53f1da1700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ec06ef40 con 0x7f53ec06b120 2023-07-11T00:00:23.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53f1da1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ec06f220 con 0x7f53ec14f320 2023-07-11T00:00:23.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53f1da1700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ec070300 con 0x7f53ec071380 2023-07-11T00:00:23.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53eaffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53ec14f320 0x7f53ec070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7fa940ff9700 1 -- 172.21.15.38:0/602597134 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa93400a030 con 0x7fa9441cd450 2023-07-11T00:00:23.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f8420733700 1 Processor -- start 2023-07-11T00:00:23.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53eaffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53ec14f320 0x7f53ec070e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52834/0 (socket says 172.21.15.38:52834) 2023-07-11T00:00:23.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53eaffd700 1 -- 172.21.15.38:0/16930931 learned_addr learned my addr 172.21.15.38:0/16930931 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53eaffd700 1 -- 172.21.15.38:0/16930931 >> v2:172.21.15.70:3300/0 conn(0x7f53ec071380 msgr2=0x7f53ec1593d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:00:23.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53eaffd700 1 --2- 172.21.15.38:0/16930931 >> v2:172.21.15.70:3300/0 conn(0x7f53ec071380 0x7f53ec1593d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53eaffd700 1 -- 172.21.15.38:0/16930931 >> v1:172.21.15.70:6789/0 conn(0x7f53ec06b120 legacy=0x7f53ec0b9f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:00:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53eaffd700 1 -- 172.21.15.38:0/16930931 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec14eb50 con 0x7f53ec14f320 2023-07-11T00:00:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.385+0000 7f53eaffd700 1 --2- 172.21.15.38:0/16930931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53ec14f320 0x7f53ec070e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f53ec073ad0 tx=0x7f53dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725cd4b78fb12118 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7f53ea7fc700 1 -- 172.21.15.38:0/16930931 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc004230 con 0x7f53ec14f320 2023-07-11T00:00:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7f53ea7fc700 1 -- 172.21.15.38:0/16930931 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc004390 con 0x7f53ec14f320 2023-07-11T00:00:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7f53ea7fc700 1 -- 172.21.15.38:0/16930931 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0036a0 con 0x7f53ec14f320 2023-07-11T00:00:23.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7f8420733700 1 -- start start 2023-07-11T00:00:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7f53f1da1700 1 -- 172.21.15.38:0/16930931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53ec14f320 msgr2=0x7f53ec070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7f53f1da1700 1 --2- 172.21.15.38:0/16930931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53ec14f320 0x7f53ec070e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f53ec073ad0 tx=0x7f53dc009bd0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7fa940ff9700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa92406ad30 0x7fa92406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7fa940ff9700 1 -- 172.21.15.38:0/602597134 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa93408be70 con 0x7fa9441cd450 2023-07-11T00:00:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7fa940ff9700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.38:6800/724039367,v1:172.21.15.38:6801/724039367] conn(0x7fa9240735e0 0x7fa9240759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7fa940ff9700 1 -- 172.21.15.38:0/602597134 --> [v2:172.21.15.38:6800/724039367,v1:172.21.15.38:6801/724039367] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9240760a0 con 0x7fa9240735e0 2023-07-11T00:00:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7fa940ff9700 1 -- 172.21.15.38:0/602597134 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa93408c310 con 0x7fa9441cd450 2023-07-11T00:00:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.386+0000 7fa943fff700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.38:6800/724039367,v1:172.21.15.38:6801/724039367] conn(0x7fa9240735e0 0x7fa9240759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f53f1da1700 1 -- 172.21.15.38:0/16930931 shutdown_connections 2023-07-11T00:00:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f53f1da1700 1 --2- 172.21.15.38:0/16930931 >> v2:172.21.15.70:3300/0 conn(0x7f53ec071380 0x7f53ec1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f53f1da1700 1 --2- 172.21.15.38:0/16930931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53ec14f320 0x7f53ec070e40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f53f1da1700 1 -- 172.21.15.38:0/16930931 >> 172.21.15.38:0/16930931 conn(0x7f53ec0bd980 msgr2=0x7f53ec0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7fa93bfff700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa92406ad30 0x7fa92406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7fa943fff700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.38:6800/724039367,v1:172.21.15.38:6801/724039367] conn(0x7fa9240735e0 0x7fa9240759f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7fa93bfff700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa92406ad30 0x7fa92406d1e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa92c006eb0 tx=0x7fa92c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f8420733700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84180b3ad0 0x7f841814b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f8420733700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84180b4670 0x7f8418133880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f8420733700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8418148950 0x7f8418149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f8420733700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84181420c0 con 0x7f84180b3ad0 2023-07-11T00:00:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f8420733700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8418151aa0 con 0x7f8418148950 2023-07-11T00:00:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f8420733700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8418149860 con 0x7f84180b4670 2023-07-11T00:00:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f841e4cf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84180b3ad0 0x7f841814b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f841e4cf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84180b3ad0 0x7f841814b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52838/0 (socket says 172.21.15.38:52838) 2023-07-11T00:00:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f841e4cf700 1 -- 172.21.15.38:0/2895354060 learned_addr learned my addr 172.21.15.38:0/2895354060 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f841e4cf700 1 -- 172.21.15.38:0/2895354060 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84180b4670 msgr2=0x7f8418133880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-11T00:00:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f841e4cf700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84180b4670 0x7f8418133880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f841e4cf700 1 -- 172.21.15.38:0/2895354060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8418148950 msgr2=0x7f8418149cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-11T00:00:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f841e4cf700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8418148950 0x7f8418149cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.387+0000 7f841e4cf700 1 -- 172.21.15.38:0/2895354060 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8410009b30 con 0x7f84180b3ad0 2023-07-11T00:00:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.388+0000 7f841e4cf700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84180b3ad0 0x7f841814b030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f840800c520 tx=0x7f840800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.388+0000 7f840effd700 1 -- 172.21.15.38:0/2895354060 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408003680 con 0x7f84180b3ad0 2023-07-11T00:00:23.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.388+0000 7f8420733700 1 -- 172.21.15.38:0/2895354060 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84181425b0 con 0x7f84180b3ad0 2023-07-11T00:00:23.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.388+0000 7f8420733700 1 -- 172.21.15.38:0/2895354060 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8418124540 con 0x7f84180b3ad0 2023-07-11T00:00:23.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.388+0000 7f53f1da1700 1 -- 172.21.15.38:0/16930931 shutdown_connections 2023-07-11T00:00:23.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.388+0000 7f840effd700 1 -- 172.21.15.38:0/2895354060 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84080037e0 con 0x7f84180b3ad0 2023-07-11T00:00:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.388+0000 7f840effd700 1 -- 172.21.15.38:0/2895354060 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408003b50 con 0x7f84180b3ad0 2023-07-11T00:00:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.388+0000 7f53f1da1700 1 -- 172.21.15.38:0/16930931 wait complete. 2023-07-11T00:00:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.389+0000 7f53f1da1700 1 Processor -- start 2023-07-11T00:00:23.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.389+0000 7f53f1da1700 1 -- start start 2023-07-11T00:00:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.389+0000 7f840effd700 1 -- 172.21.15.38:0/2895354060 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8408003cb0 con 0x7f84180b3ad0 2023-07-11T00:00:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f840effd700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f83fc06ace0 0x7f83fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f840effd700 1 -- 172.21.15.38:0/2895354060 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8408088950 con 0x7f84180b3ad0 2023-07-11T00:00:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f53f1da1700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53ec06b120 0x7f53ec0bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f53f1da1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53ec071380 0x7f53ec0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f53f1da1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53ec14f320 0x7f53ec14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f53f1da1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec12c820 con 0x7f53ec14f320 2023-07-11T00:00:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f53f1da1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec148db0 con 0x7f53ec071380 2023-07-11T00:00:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f53f1da1700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec145070 con 0x7f53ec06b120 2023-07-11T00:00:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f53eaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53ec071380 0x7f53ec0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f53eaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53ec071380 0x7f53ec0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53292/0 (socket says 172.21.15.38:53292) 2023-07-11T00:00:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f53eaffd700 1 -- 172.21.15.38:0/4283891362 learned_addr learned my addr 172.21.15.38:0/4283891362 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f53eb7fe700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53ec06b120 0x7f53ec0bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.390+0000 7f53ebfff700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53ec14f320 0x7f53ec14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f53eb7fe700 1 -- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53ec071380 msgr2=0x7f53ec0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f53eb7fe700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53ec071380 0x7f53ec0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f53eb7fe700 1 -- 172.21.15.38:0/4283891362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53ec14f320 msgr2=0x7f53ec14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f53eb7fe700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53ec14f320 0x7f53ec14b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f53eb7fe700 1 -- 172.21.15.38:0/4283891362 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc009550 con 0x7f53ec06b120 2023-07-11T00:00:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f53ebfff700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53ec14f320 0x7f53ec14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f53eb7fe700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53ec06b120 0x7f53ec0bb2a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006fd0 tx=0x7f53d400b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f53e3fff700 1 -- 172.21.15.38:0/4283891362 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4011830 con 0x7f53ec06b120 2023-07-11T00:00:23.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f8420733700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.38:6816/1181787803,v1:172.21.15.38:6817/1181787803] conn(0x7f84000015e0 0x7f8400003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f8420733700 1 -- 172.21.15.38:0/2895354060 --> [v2:172.21.15.38:6816/1181787803,v1:172.21.15.38:6817/1181787803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8400006bc0 con 0x7f84000015e0 2023-07-11T00:00:23.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f53e3fff700 1 -- 172.21.15.38:0/4283891362 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d40119b0 con 0x7f53ec06b120 2023-07-11T00:00:23.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7f53e3fff700 1 -- 172.21.15.38:0/4283891362 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4011d60 con 0x7f53ec06b120 2023-07-11T00:00:23.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.393+0000 7f841dcce700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f83fc06ace0 0x7f83fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.393+0000 7f53f1da1700 1 -- 172.21.15.38:0/4283891362 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ec12c260 con 0x7f53ec06b120 2023-07-11T00:00:23.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.393+0000 7f53f1da1700 1 -- 172.21.15.38:0/4283891362 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ec124b40 con 0x7f53ec06b120 2023-07-11T00:00:23.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.393+0000 7f841dcce700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f83fc06ace0 0x7f83fc06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8418139b40 tx=0x7f8414006c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.383+0000 7fa674ff9700 1 -- 172.21.15.38:0/1367708329 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668003e30 con 0x7fa6780b3ad0 2023-07-11T00:00:23.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.383+0000 7fa674ff9700 1 -- 172.21.15.38:0/1367708329 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66801f070 con 0x7fa6780b3ad0 2023-07-11T00:00:23.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.383+0000 7fa674ff9700 1 -- 172.21.15.38:0/1367708329 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66800b860 con 0x7fa6780b3ad0 2023-07-11T00:00:23.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.391+0000 7fa67e64f700 1 -- 172.21.15.38:0/1367708329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa678141550 con 0x7fa6780b3ad0 2023-07-11T00:00:23.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.392+0000 7fa67e64f700 1 -- 172.21.15.38:0/1367708329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa678133850 con 0x7fa6780b3ad0 2023-07-11T00:00:23.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.392+0000 7fa67e64f700 1 -- 172.21.15.38:0/1367708329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa678152f60 con 0x7fa6780b3ad0 2023-07-11T00:00:23.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.393+0000 7fa674ff9700 1 -- 172.21.15.38:0/1367708329 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa668021030 con 0x7fa6780b3ad0 2023-07-11T00:00:23.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.393+0000 7fa674ff9700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa66406ace0 0x7fa66406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.394+0000 7fa674ff9700 1 -- 172.21.15.38:0/1367708329 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa66808ab60 con 0x7fa6780b3ad0 2023-07-11T00:00:23.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.394+0000 7fa674ff9700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.38:6824/415471262,v1:172.21.15.38:6825/415471262] conn(0x7fa664073590 0x7fa6640759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.394+0000 7fa674ff9700 1 -- 172.21.15.38:0/1367708329 --> [v2:172.21.15.38:6824/415471262,v1:172.21.15.38:6825/415471262] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa664076050 con 0x7fa664073590 2023-07-11T00:00:23.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.394+0000 7fa674ff9700 1 -- 172.21.15.38:0/1367708329 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa66808f2a0 con 0x7fa6780b3ad0 2023-07-11T00:00:23.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.395+0000 7fa940ff9700 1 -- 172.21.15.38:0/602597134 <== osd.0 v2:172.21.15.38:6800/724039367 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa9240760a0 con 0x7fa9240735e0 2023-07-11T00:00:23.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.394+0000 7fa67cbec700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.38:6824/415471262,v1:172.21.15.38:6825/415471262] conn(0x7fa664073590 0x7fa6640759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.395+0000 7fa67cbec700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.38:6824/415471262,v1:172.21.15.38:6825/415471262] conn(0x7fa664073590 0x7fa6640759a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.402+0000 7fa6777fe700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa66406ace0 0x7fa66406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.402+0000 7fa6777fe700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa66406ace0 0x7fa66406d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa67814eb90 tx=0x7fa670009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.403+0000 7fa674ff9700 1 -- 172.21.15.38:0/1367708329 <== osd.1 v2:172.21.15.38:6824/415471262 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa664076050 con 0x7fa664073590 2023-07-11T00:00:23.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.403+0000 7f841ecd0700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.38:6816/1181787803,v1:172.21.15.38:6817/1181787803] conn(0x7f84000015e0 0x7f8400003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.397+0000 7f9845f11700 1 -- 172.21.15.38:0/3122221100 --> [v2:172.21.15.70:6824/2098956368,v1:172.21.15.70:6825/2098956368] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98400b3c70 con 0x7f982c073510 2023-07-11T00:00:23.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.398+0000 7f9827fff700 1 -- 172.21.15.38:0/3122221100 <== osd.6 v2:172.21.15.70:6824/2098956368 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9830006c00 con 0x7f982c073510 2023-07-11T00:00:23.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.398+0000 7f9845f11700 1 -- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:6824/2098956368,v1:172.21.15.70:6825/2098956368] conn(0x7f982c073510 msgr2=0x7f982c075920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.398+0000 7f9845f11700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:6824/2098956368,v1:172.21.15.70:6825/2098956368] conn(0x7f982c073510 0x7f982c075920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.398+0000 7f9845f11700 1 -- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f982c06ace0 msgr2=0x7f982c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.398+0000 7f9845f11700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f982c06ace0 0x7f982c06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f983400bb70 tx=0x7f983400b420 comp rx=0 tx=0).stop 2023-07-11T00:00:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.398+0000 7f9845f11700 1 -- 172.21.15.38:0/3122221100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98401573e0 msgr2=0x7f9840153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.398+0000 7f9845f11700 1 --2- 172.21.15.38:0/3122221100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98401573e0 0x7f9840153790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f983800caf0 tx=0x7f983800ceb0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.398+0000 7f983ffff700 1 -- 172.21.15.38:0/3122221100 reap_dead start 2023-07-11T00:00:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.398+0000 7f9845f11700 1 -- 172.21.15.38:0/3122221100 shutdown_connections 2023-07-11T00:00:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.398+0000 7f9845f11700 1 -- 172.21.15.38:0/3122221100 >> 172.21.15.38:0/3122221100 conn(0x7f9840069f30 msgr2=0x7f9840088130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.398+0000 7f9845f11700 1 -- 172.21.15.38:0/3122221100 shutdown_connections 2023-07-11T00:00:23.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.399+0000 7f9845f11700 1 -- 172.21.15.38:0/3122221100 wait complete. 2023-07-11T00:00:23.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.396+0000 7f53e3fff700 1 -- 172.21.15.38:0/4283891362 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53d401a400 con 0x7f53ec06b120 2023-07-11T00:00:23.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.396+0000 7f53e3fff700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f53cc06ace0 0x7f53cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.397+0000 7f53e3fff700 1 -- 172.21.15.38:0/4283891362 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53d4089330 con 0x7f53ec06b120 2023-07-11T00:00:23.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.397+0000 7f53eaffd700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f53cc06ace0 0x7f53cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.397+0000 7f53eaffd700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f53cc06ace0 0x7f53cc06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53ec124a70 tx=0x7f53dc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.403+0000 7f53f1da1700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:6816/3720879556,v1:172.21.15.70:6817/3720879556] conn(0x7f53ec148920 0x7f53ec0baad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.403+0000 7f53f1da1700 1 -- 172.21.15.38:0/4283891362 --> [v2:172.21.15.70:6816/3720879556,v1:172.21.15.70:6817/3720879556] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53ec06fff0 con 0x7f53ec148920 2023-07-11T00:00:23.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.407+0000 7f53ebfff700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:6816/3720879556,v1:172.21.15.70:6817/3720879556] conn(0x7f53ec148920 0x7f53ec0baad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.407+0000 7f841ecd0700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.38:6816/1181787803,v1:172.21.15.38:6817/1181787803] conn(0x7f84000015e0 0x7f8400003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.408+0000 7f840effd700 1 -- 172.21.15.38:0/2895354060 <== osd.3 v2:172.21.15.38:6816/1181787803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8400006bc0 con 0x7f84000015e0 2023-07-11T00:00:23.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.410+0000 7f53ebfff700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:6816/3720879556,v1:172.21.15.70:6817/3720879556] conn(0x7f53ec148920 0x7f53ec0baad0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.412+0000 7f53e3fff700 1 -- 172.21.15.38:0/4283891362 <== osd.7 v2:172.21.15.70:6816/3720879556 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f53e400a400 con 0x7f53ec148920 2023-07-11T00:00:23.484 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-07-11T00:00:23.485 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-11T00:00:23.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.415+0000 7f6024ccf700 1 -- 172.21.15.38:0/2259206795 --> [v2:172.21.15.70:6800/3020490369,v1:172.21.15.70:6801/3020490369] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6004002d40 con 0x7f6000073590 2023-07-11T00:00:23.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.425+0000 7f600effd700 1 -- 172.21.15.38:0/2259206795 <== osd.4 v2:172.21.15.70:6800/3020490369 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6004002d40 con 0x7f6000073590 2023-07-11T00:00:23.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.425+0000 7f149d16a700 1 -- 172.21.15.38:0/4030619905 --> [v2:172.21.15.70:6808/3665672607,v1:172.21.15.70:6809/3665672607] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1478002d40 con 0x7f1484073660 2023-07-11T00:00:23.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.425+0000 7f03ec057700 1 -- 172.21.15.38:0/1490185481 --> [v2:172.21.15.38:6808/3299763585,v1:172.21.15.38:6809/3299763585] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f03cc002d40 con 0x7f03c8073610 2023-07-11T00:00:23.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.426+0000 7f03da7fc700 1 -- 172.21.15.38:0/1490185481 <== osd.2 v2:172.21.15.38:6808/3299763585 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f03cc002d40 con 0x7f03c8073610 2023-07-11T00:00:23.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.426+0000 7f03ec057700 1 -- 172.21.15.38:0/1490185481 >> [v2:172.21.15.38:6808/3299763585,v1:172.21.15.38:6809/3299763585] conn(0x7f03c8073610 msgr2=0x7f03c8075a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.426+0000 7f03ec057700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.38:6808/3299763585,v1:172.21.15.38:6809/3299763585] conn(0x7f03c8073610 0x7f03c8075a20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.426+0000 7f03ec057700 1 -- 172.21.15.38:0/1490185481 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f03c806ad60 msgr2=0x7f03c806d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.426+0000 7f03ec057700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f03c806ad60 0x7f03c806d210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f03e4143ef0 tx=0x7f03e0009040 comp rx=0 tx=0).stop 2023-07-11T00:00:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.426+0000 7f03ec057700 1 -- 172.21.15.38:0/1490185481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03e40b8700 msgr2=0x7f03e40702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.426+0000 7f03ec057700 1 --2- 172.21.15.38:0/1490185481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03e40b8700 0x7f03e40702a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f03e406e0c0 tx=0x7f03dc004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.426+0000 7f03ea5f4700 1 -- 172.21.15.38:0/1490185481 reap_dead start 2023-07-11T00:00:23.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.427+0000 7f03ec057700 1 -- 172.21.15.38:0/1490185481 shutdown_connections 2023-07-11T00:00:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.427+0000 7f03ec057700 1 -- 172.21.15.38:0/1490185481 >> 172.21.15.38:0/1490185481 conn(0x7f03e4069f30 msgr2=0x7f03e413d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.427+0000 7f6024ccf700 1 -- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:6800/3020490369,v1:172.21.15.70:6801/3020490369] conn(0x7f6000073590 msgr2=0x7f60000759a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.427+0000 7f6024ccf700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:6800/3020490369,v1:172.21.15.70:6801/3020490369] conn(0x7f6000073590 0x7f60000759a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.427+0000 7f6024ccf700 1 -- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f600006ace0 msgr2=0x7f600006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.426+0000 7f147f7fe700 1 -- 172.21.15.38:0/4030619905 <== osd.5 v2:172.21.15.70:6808/3665672607 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1478002d40 con 0x7f1484073660 2023-07-11T00:00:23.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.427+0000 7f6024ccf700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f600006ace0 0x7f600006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6014007fd0 tx=0x7f6014009040 comp rx=0 tx=0).stop 2023-07-11T00:00:23.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.427+0000 7f6024ccf700 1 -- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6020148d50 msgr2=0x7f60201425f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.427+0000 7f6024ccf700 1 --2- 172.21.15.38:0/2259206795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6020148d50 0x7f60201425f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6018009dd0 tx=0x7f601800c3a0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.427+0000 7f601ed9d700 1 -- 172.21.15.38:0/2259206795 reap_dead start 2023-07-11T00:00:23.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7f149d16a700 1 -- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:6808/3665672607,v1:172.21.15.70:6809/3665672607] conn(0x7f1484073660 msgr2=0x7f1484075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7f149d16a700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:6808/3665672607,v1:172.21.15.70:6809/3665672607] conn(0x7f1484073660 0x7f1484075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7f149d16a700 1 -- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f148406adb0 msgr2=0x7f148406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7f149d16a700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f148406adb0 0x7f148406d260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1488007fd0 tx=0x7f1488009040 comp rx=0 tx=0).stop 2023-07-11T00:00:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7f149d16a700 1 -- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14980b8b00 msgr2=0x7f14981df620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7f149d16a700 1 --2- 172.21.15.38:0/4030619905 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14980b8b00 0x7f14981df620 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f149000efc0 tx=0x7f149000c0c0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7f149759e700 1 -- 172.21.15.38:0/4030619905 reap_dead start 2023-07-11T00:00:23.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7fa94a023700 1 -- 172.21.15.38:0/602597134 --> [v2:172.21.15.38:6800/724039367,v1:172.21.15.38:6801/724039367] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9440b4f00 con 0x7fa9240735e0 2023-07-11T00:00:23.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7f03ec057700 1 -- 172.21.15.38:0/1490185481 shutdown_connections 2023-07-11T00:00:23.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7f03ec057700 1 -- 172.21.15.38:0/1490185481 wait complete. 2023-07-11T00:00:23.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7fa940ff9700 1 -- 172.21.15.38:0/602597134 <== osd.0 v2:172.21.15.38:6800/724039367 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa93c001f90 con 0x7fa9240735e0 2023-07-11T00:00:23.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7fa67e64f700 1 -- 172.21.15.38:0/1367708329 --> [v2:172.21.15.38:6824/415471262,v1:172.21.15.38:6825/415471262] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa678141a70 con 0x7fa664073590 2023-07-11T00:00:23.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7f6024ccf700 1 -- 172.21.15.38:0/2259206795 shutdown_connections 2023-07-11T00:00:23.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.428+0000 7f6024ccf700 1 -- 172.21.15.38:0/2259206795 >> 172.21.15.38:0/2259206795 conn(0x7f602006d0e0 msgr2=0x7f60201461a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7fa674ff9700 1 -- 172.21.15.38:0/1367708329 <== osd.1 v2:172.21.15.38:6824/415471262 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa678141a70 con 0x7fa664073590 2023-07-11T00:00:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7f6024ccf700 1 -- 172.21.15.38:0/2259206795 shutdown_connections 2023-07-11T00:00:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7f6024ccf700 1 -- 172.21.15.38:0/2259206795 wait complete. 2023-07-11T00:00:23.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7f149d16a700 1 -- 172.21.15.38:0/4030619905 shutdown_connections 2023-07-11T00:00:23.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7f149d16a700 1 -- 172.21.15.38:0/4030619905 >> 172.21.15.38:0/4030619905 conn(0x7f14980bc880 msgr2=0x7f14981438e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7f149d16a700 1 -- 172.21.15.38:0/4030619905 shutdown_connections 2023-07-11T00:00:23.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7f149d16a700 1 -- 172.21.15.38:0/4030619905 wait complete. 2023-07-11T00:00:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7fa94a023700 1 -- 172.21.15.38:0/602597134 >> [v2:172.21.15.38:6800/724039367,v1:172.21.15.38:6801/724039367] conn(0x7fa9240735e0 msgr2=0x7fa9240759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7fa94a023700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.38:6800/724039367,v1:172.21.15.38:6801/724039367] conn(0x7fa9240735e0 0x7fa9240759f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7fa94a023700 1 -- 172.21.15.38:0/602597134 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa92406ad30 msgr2=0x7fa92406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7fa94a023700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa92406ad30 0x7fa92406d1e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa92c006eb0 tx=0x7fa92c008040 comp rx=0 tx=0).stop 2023-07-11T00:00:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7fa94a023700 1 -- 172.21.15.38:0/602597134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9441cd450 msgr2=0x7fa9441dee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7fa94a023700 1 --2- 172.21.15.38:0/602597134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9441cd450 0x7fa9441dee00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa934015000 tx=0x7fa934001930 comp rx=0 tx=0).stop 2023-07-11T00:00:23.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.429+0000 7fa943fff700 1 -- 172.21.15.38:0/602597134 reap_dead start 2023-07-11T00:00:23.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.430+0000 7fa94a023700 1 -- 172.21.15.38:0/602597134 shutdown_connections 2023-07-11T00:00:23.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.430+0000 7fa94a023700 1 -- 172.21.15.38:0/602597134 >> 172.21.15.38:0/602597134 conn(0x7fa944069f30 msgr2=0x7fa9440b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.430+0000 7fa94a023700 1 -- 172.21.15.38:0/602597134 shutdown_connections 2023-07-11T00:00:23.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.431+0000 7fa94a023700 1 -- 172.21.15.38:0/602597134 wait complete. 2023-07-11T00:00:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.431+0000 7fa67e64f700 1 -- 172.21.15.38:0/1367708329 >> [v2:172.21.15.38:6824/415471262,v1:172.21.15.38:6825/415471262] conn(0x7fa664073590 msgr2=0x7fa6640759a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.431+0000 7fa67e64f700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.38:6824/415471262,v1:172.21.15.38:6825/415471262] conn(0x7fa664073590 0x7fa6640759a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.431+0000 7fa67e64f700 1 -- 172.21.15.38:0/1367708329 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa66406ace0 msgr2=0x7fa66406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.431+0000 7fa67e64f700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa66406ace0 0x7fa66406d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa67814eb90 tx=0x7fa670009250 comp rx=0 tx=0).stop 2023-07-11T00:00:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.431+0000 7fa67e64f700 1 -- 172.21.15.38:0/1367708329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6780b3ad0 msgr2=0x7fa678132c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.431+0000 7fa67e64f700 1 --2- 172.21.15.38:0/1367708329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6780b3ad0 0x7fa678132c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa67806ccd0 tx=0x7fa668004750 comp rx=0 tx=0).stop 2023-07-11T00:00:23.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.431+0000 7fa67cbec700 1 -- 172.21.15.38:0/1367708329 reap_dead start 2023-07-11T00:00:23.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.431+0000 7fa67e64f700 1 -- 172.21.15.38:0/1367708329 shutdown_connections 2023-07-11T00:00:23.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.431+0000 7fa67e64f700 1 -- 172.21.15.38:0/1367708329 >> 172.21.15.38:0/1367708329 conn(0x7fa678069f30 msgr2=0x7fa678147e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.436+0000 7fa67e64f700 1 -- 172.21.15.38:0/1367708329 shutdown_connections 2023-07-11T00:00:23.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.436+0000 7fa67e64f700 1 -- 172.21.15.38:0/1367708329 wait complete. 2023-07-11T00:00:23.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.444+0000 7f53f1da1700 1 -- 172.21.15.38:0/4283891362 --> [v2:172.21.15.70:6816/3720879556,v1:172.21.15.70:6817/3720879556] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53ec06b4f0 con 0x7f53ec148920 2023-07-11T00:00:23.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.445+0000 7f53e3fff700 1 -- 172.21.15.38:0/4283891362 <== osd.7 v2:172.21.15.70:6816/3720879556 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f53e400a830 con 0x7f53ec148920 2023-07-11T00:00:23.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.446+0000 7f8420733700 1 -- 172.21.15.38:0/2895354060 --> [v2:172.21.15.38:6816/1181787803,v1:172.21.15.38:6817/1181787803] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8400005c40 con 0x7f84000015e0 2023-07-11T00:00:23.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.446+0000 7f53f1da1700 1 -- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:6816/3720879556,v1:172.21.15.70:6817/3720879556] conn(0x7f53ec148920 msgr2=0x7f53ec0baad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.446+0000 7f53f1da1700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:6816/3720879556,v1:172.21.15.70:6817/3720879556] conn(0x7f53ec148920 0x7f53ec0baad0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.446+0000 7f840effd700 1 -- 172.21.15.38:0/2895354060 <== osd.3 v2:172.21.15.38:6816/1181787803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8400005c40 con 0x7f84000015e0 2023-07-11T00:00:23.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.446+0000 7f53f1da1700 1 -- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f53cc06ace0 msgr2=0x7f53cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.446+0000 7f53f1da1700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f53cc06ace0 0x7f53cc06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53ec124a70 tx=0x7f53dc008030 comp rx=0 tx=0).stop 2023-07-11T00:00:23.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.446+0000 7f53f1da1700 1 -- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53ec06b120 msgr2=0x7f53ec0bb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.446+0000 7f53f1da1700 1 --2- 172.21.15.38:0/4283891362 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53ec06b120 0x7f53ec0bb2a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006fd0 tx=0x7f53d400b730 comp rx=0 tx=0).stop 2023-07-11T00:00:23.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.446+0000 7f53ebfff700 1 -- 172.21.15.38:0/4283891362 reap_dead start 2023-07-11T00:00:23.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.446+0000 7f53f1da1700 1 -- 172.21.15.38:0/4283891362 shutdown_connections 2023-07-11T00:00:23.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.446+0000 7f53f1da1700 1 -- 172.21.15.38:0/4283891362 >> 172.21.15.38:0/4283891362 conn(0x7f53ec0bd980 msgr2=0x7f53ec14c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.447+0000 7f53f1da1700 1 -- 172.21.15.38:0/4283891362 shutdown_connections 2023-07-11T00:00:23.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.447+0000 7f8420733700 1 -- 172.21.15.38:0/2895354060 >> [v2:172.21.15.38:6816/1181787803,v1:172.21.15.38:6817/1181787803] conn(0x7f84000015e0 msgr2=0x7f8400003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.447+0000 7f8420733700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.38:6816/1181787803,v1:172.21.15.38:6817/1181787803] conn(0x7f84000015e0 0x7f8400003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.448+0000 7f8420733700 1 -- 172.21.15.38:0/2895354060 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f83fc06ace0 msgr2=0x7f83fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.448+0000 7f8420733700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f83fc06ace0 0x7f83fc06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8418139b40 tx=0x7f8414006c60 comp rx=0 tx=0).stop 2023-07-11T00:00:23.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.448+0000 7f8420733700 1 -- 172.21.15.38:0/2895354060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84180b3ad0 msgr2=0x7f841814b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.448+0000 7f8420733700 1 --2- 172.21.15.38:0/2895354060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84180b3ad0 0x7f841814b030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f840800c520 tx=0x7f840800c8e0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.448+0000 7f841ecd0700 1 -- 172.21.15.38:0/2895354060 reap_dead start 2023-07-11T00:00:23.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.448+0000 7f8420733700 1 -- 172.21.15.38:0/2895354060 shutdown_connections 2023-07-11T00:00:23.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.448+0000 7f8420733700 1 -- 172.21.15.38:0/2895354060 >> 172.21.15.38:0/2895354060 conn(0x7f8418069f30 msgr2=0x7f84180b7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.449+0000 7f53f1da1700 1 -- 172.21.15.38:0/4283891362 wait complete. 2023-07-11T00:00:23.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.450+0000 7f8420733700 1 -- 172.21.15.38:0/2895354060 shutdown_connections 2023-07-11T00:00:23.509 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-07-11T00:00:23.510 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-11T00:00:23.511 INFO:teuthology.orchestra.run.smithi038.stdout:55834574852 2023-07-11T00:00:23.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-11T00:00:23.512 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-07-11T00:00:23.513 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-11T00:00:23.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.450+0000 7f8420733700 1 -- 172.21.15.38:0/2895354060 wait complete. 2023-07-11T00:00:23.514 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-07-11T00:00:23.514 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-11T00:00:23.515 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-07-11T00:00:23.515 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-11T00:00:23.516 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-07-11T00:00:23.517 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-11T00:00:23.517 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-07-11T00:00:23.518 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-11T00:00:23.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.756+0000 7f00fb2ec700 1 Processor -- start 2023-07-11T00:00:23.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.757+0000 7f00fb2ec700 1 -- start start 2023-07-11T00:00:23.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.758+0000 7f00fb2ec700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f00f406b120 0x7f00f40b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.758+0000 7f00fb2ec700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f00f414f320 0x7f00f4070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.758+0000 7f00fb2ec700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f4071380 0x7f00f41520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.758+0000 7f00fb2ec700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f406ef40 con 0x7f00f414f320 2023-07-11T00:00:23.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.758+0000 7f00fb2ec700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f406f220 con 0x7f00f406b120 2023-07-11T00:00:23.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.758+0000 7f00fb2ec700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f4070300 con 0x7f00f4071380 2023-07-11T00:00:23.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.758+0000 7f00f9088700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f00f406b120 0x7f00f40b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.758+0000 7f00f9088700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f00f406b120 0x7f00f40b9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53306/0 (socket says 172.21.15.38:53306) 2023-07-11T00:00:23.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.758+0000 7f00f9088700 1 -- 172.21.15.38:0/1405745859 learned_addr learned my addr 172.21.15.38:0/1405745859 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.758+0000 7f00f9889700 1 --2- 172.21.15.38:0/1405745859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f4071380 0x7f00f41520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.759+0000 7f00f9088700 1 -- 172.21.15.38:0/1405745859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f4071380 msgr2=0x7f00f41520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.759+0000 7f00f9088700 1 --2- 172.21.15.38:0/1405745859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f4071380 0x7f00f41520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.759+0000 7f00f9088700 1 -- 172.21.15.38:0/1405745859 >> v2:172.21.15.38:3300/0 conn(0x7f00f414f320 msgr2=0x7f00f4070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.759+0000 7f00f9088700 1 --2- 172.21.15.38:0/1405745859 >> v2:172.21.15.38:3300/0 conn(0x7f00f414f320 0x7f00f4070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.759+0000 7f00f9088700 1 -- 172.21.15.38:0/1405745859 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f414eb50 con 0x7f00f406b120 2023-07-11T00:00:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.764+0000 7f00f9088700 1 --2- 172.21.15.38:0/1405745859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f406b120 0x7f00f40b9f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00f406b860 tx=0x7f00f0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c8ff10c29f6db21 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.765+0000 7f00ebfff700 1 -- 172.21.15.38:0/1405745859 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0011830 con 0x7f00f406b120 2023-07-11T00:00:23.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.765+0000 7f00ebfff700 1 -- 172.21.15.38:0/1405745859 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f0011990 con 0x7f00f406b120 2023-07-11T00:00:23.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.765+0000 7f00ebfff700 1 -- 172.21.15.38:0/1405745859 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0011d20 con 0x7f00f406b120 2023-07-11T00:00:23.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.766+0000 7f00fb2ec700 1 -- 172.21.15.38:0/1405745859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f406b120 msgr2=0x7f00f40b9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.766+0000 7f00fb2ec700 1 --2- 172.21.15.38:0/1405745859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f406b120 0x7f00f40b9f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00f406b860 tx=0x7f00f0009bd0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.766+0000 7f00fb2ec700 1 -- 172.21.15.38:0/1405745859 shutdown_connections 2023-07-11T00:00:23.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.766+0000 7f00fb2ec700 1 --2- 172.21.15.38:0/1405745859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f4071380 0x7f00f41520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.766+0000 7f00fb2ec700 1 --2- 172.21.15.38:0/1405745859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f406b120 0x7f00f40b9f50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.766+0000 7f00fb2ec700 1 --2- 172.21.15.38:0/1405745859 >> v2:172.21.15.38:3300/0 conn(0x7f00f414f320 0x7f00f4070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.766+0000 7f00fb2ec700 1 -- 172.21.15.38:0/1405745859 >> 172.21.15.38:0/1405745859 conn(0x7f00f40bd980 msgr2=0x7f00f40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.766+0000 7f00fb2ec700 1 -- 172.21.15.38:0/1405745859 shutdown_connections 2023-07-11T00:00:23.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.766+0000 7f00fb2ec700 1 -- 172.21.15.38:0/1405745859 wait complete. 2023-07-11T00:00:23.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.768+0000 7f00fb2ec700 1 Processor -- start 2023-07-11T00:00:23.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.768+0000 7f00fb2ec700 1 -- start start 2023-07-11T00:00:23.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.769+0000 7f00fb2ec700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f406b120 0x7f00f40b6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.769+0000 7f00fb2ec700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f4071380 0x7f00f41d4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.769+0000 7f00fb2ec700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f414f320 0x7f00f41e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.769+0000 7f00fb2ec700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40b6e90 con 0x7f00f406b120 2023-07-11T00:00:23.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.769+0000 7f00fb2ec700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f414d5a0 con 0x7f00f4071380 2023-07-11T00:00:23.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.769+0000 7f00fb2ec700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f41d53b0 con 0x7f00f414f320 2023-07-11T00:00:23.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.770+0000 7f00f9889700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f414f320 0x7f00f41e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.770+0000 7f00f9889700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f414f320 0x7f00f41e7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42796/0 (socket says 172.21.15.38:42796) 2023-07-11T00:00:23.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.770+0000 7f00f9889700 1 -- 172.21.15.38:0/815934086 learned_addr learned my addr 172.21.15.38:0/815934086 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.770+0000 7f00f8887700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f4071380 0x7f00f41d4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.770+0000 7f349ffb3700 1 Processor -- start 2023-07-11T00:00:23.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.770+0000 7f349ffb3700 1 -- start start 2023-07-11T00:00:23.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.771+0000 7f00f9889700 1 -- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f4071380 msgr2=0x7f00f41d4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.771+0000 7f00f9889700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f4071380 0x7f00f41d4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.771+0000 7f00f9889700 1 -- 172.21.15.38:0/815934086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f406b120 msgr2=0x7f00f40b6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.771+0000 7f00f9889700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f406b120 0x7f00f40b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.771+0000 7f00f9889700 1 -- 172.21.15.38:0/815934086 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f0009550 con 0x7f00f414f320 2023-07-11T00:00:23.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349ffb3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3498147dc0 0x7f34980721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349ffb3700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3498069f30 0x7f3498071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349ffb3700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349806f680 con 0x7f349806a380 2023-07-11T00:00:23.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349ffb3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3498070950 con 0x7f3498147dc0 2023-07-11T00:00:23.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349ffb3700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349806f920 con 0x7f3498069f30 2023-07-11T00:00:23.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349d54e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3498069f30 0x7f3498071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349d54e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3498069f30 0x7f3498071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42808/0 (socket says 172.21.15.38:42808) 2023-07-11T00:00:23.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349d54e700 1 -- 172.21.15.38:0/1382088629 learned_addr learned my addr 172.21.15.38:0/1382088629 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349dd4f700 1 --2- 172.21.15.38:0/1382088629 >> v2:172.21.15.38:3300/0 conn(0x7f3498147dc0 0x7f34980721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f00f9889700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f414f320 0x7f00f41e7500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00efc0 tx=0x7f00ec00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349dd4f700 1 -- 172.21.15.38:0/1382088629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3498069f30 msgr2=0x7f3498071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349dd4f700 1 --2- 172.21.15.38:0/1382088629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3498069f30 0x7f3498071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349dd4f700 1 -- 172.21.15.38:0/1382088629 >> v1:172.21.15.70:6789/0 conn(0x7f349806a380 legacy=0x7f349814dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.772+0000 7f349dd4f700 1 -- 172.21.15.38:0/1382088629 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34980b9660 con 0x7f3498147dc0 2023-07-11T00:00:23.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.773+0000 7f00e9ffb700 1 -- 172.21.15.38:0/815934086 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec009ea0 con 0x7f00f414f320 2023-07-11T00:00:23.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.773+0000 7f349dd4f700 1 --2- 172.21.15.38:0/1382088629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3498147dc0 0x7f34980721e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3488009840 tx=0x7f3488009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc36edd403981020 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.773+0000 7f349cd4d700 1 -- 172.21.15.38:0/1382088629 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488004230 con 0x7f3498147dc0 2023-07-11T00:00:23.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.773+0000 7f349cd4d700 1 -- 172.21.15.38:0/1382088629 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3488004390 con 0x7f3498147dc0 2023-07-11T00:00:23.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.773+0000 7f349cd4d700 1 -- 172.21.15.38:0/1382088629 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880036a0 con 0x7f3498147dc0 2023-07-11T00:00:23.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.773+0000 7f51438d5700 1 Processor -- start 2023-07-11T00:00:23.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.773+0000 7f00e9ffb700 1 -- 172.21.15.38:0/815934086 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec00f040 con 0x7f00f414f320 2023-07-11T00:00:23.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.773+0000 7f00e9ffb700 1 -- 172.21.15.38:0/815934086 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec014480 con 0x7f00f414f320 2023-07-11T00:00:23.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.774+0000 7f349ffb3700 1 -- 172.21.15.38:0/1382088629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3498147dc0 msgr2=0x7f34980721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.774+0000 7f349ffb3700 1 --2- 172.21.15.38:0/1382088629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3498147dc0 0x7f34980721e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3488009840 tx=0x7f3488009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:23.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.774+0000 7f00fb2ec700 1 -- 172.21.15.38:0/815934086 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f414cc70 con 0x7f00f414f320 2023-07-11T00:00:23.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.774+0000 7f00fb2ec700 1 -- 172.21.15.38:0/815934086 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f4148b60 con 0x7f00f414f320 2023-07-11T00:00:23.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.774+0000 7f349ffb3700 1 -- 172.21.15.38:0/1382088629 shutdown_connections 2023-07-11T00:00:23.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.774+0000 7f349ffb3700 1 --2- 172.21.15.38:0/1382088629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3498147dc0 0x7f34980721e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.774+0000 7f349ffb3700 1 --2- 172.21.15.38:0/1382088629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3498069f30 0x7f3498071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.774+0000 7f349ffb3700 1 -- 172.21.15.38:0/1382088629 >> 172.21.15.38:0/1382088629 conn(0x7f349806d0e0 msgr2=0x7f349806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.774+0000 7f349ffb3700 1 -- 172.21.15.38:0/1382088629 shutdown_connections 2023-07-11T00:00:23.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.774+0000 7f349ffb3700 1 -- 172.21.15.38:0/1382088629 wait complete. 2023-07-11T00:00:23.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.774+0000 7f51438d5700 1 -- start start 2023-07-11T00:00:23.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.775+0000 7f51438d5700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f513c0b8700 0x7f513c0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.775+0000 7f51438d5700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f513c146ee0 0x7f513c140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.775+0000 7f51438d5700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513c0b46f0 con 0x7f513c0b93d0 2023-07-11T00:00:23.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.775+0000 7f51438d5700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513c0b4940 con 0x7f513c146ee0 2023-07-11T00:00:23.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.775+0000 7f51438d5700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0b4c20 con 0x7f513c0b8700 2023-07-11T00:00:23.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.776+0000 7f349ffb3700 1 Processor -- start 2023-07-11T00:00:23.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.776+0000 7f5140e70700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f513c0b93d0 0x7f513c1467d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54450/0 (socket says 172.21.15.38:54450) 2023-07-11T00:00:23.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.776+0000 7f5140e70700 1 -- 172.21.15.38:0/1736870965 learned_addr learned my addr 172.21.15.38:0/1736870965 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:23.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.776+0000 7f5141e72700 1 --2- 172.21.15.38:0/1736870965 >> v2:172.21.15.70:3300/0 conn(0x7f513c146ee0 0x7f513c140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f5133fff700 1 -- 172.21.15.38:0/1736870965 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175874467 0 0) 0x7f513c0b46f0 con 0x7f513c0b93d0 2023-07-11T00:00:23.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f5133fff700 1 -- 172.21.15.38:0/1736870965 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51280079c0 con 0x7f513c0b93d0 2023-07-11T00:00:23.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.776+0000 7f00e9ffb700 1 -- 172.21.15.38:0/815934086 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00ec0145e0 con 0x7f00f414f320 2023-07-11T00:00:23.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f00fb2ec700 1 -- 172.21.15.38:0/815934086 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f406e2e0 con 0x7f00f414f320 2023-07-11T00:00:23.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f00e9ffb700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f00d806adb0 0x7f00d806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f00e9ffb700 1 -- 172.21.15.38:0/815934086 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00ec089fb0 con 0x7f00f414f320 2023-07-11T00:00:23.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.776+0000 7f349ffb3700 1 -- start start 2023-07-11T00:00:23.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f349ffb3700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3498069f30 0x7f3498149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f349ffb3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f349806a380 0x7f34981e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f349ffb3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3498147dc0 0x7f3498142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f349ffb3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3498149eb0 con 0x7f349806a380 2023-07-11T00:00:23.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f349ffb3700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34980b73b0 con 0x7f3498147dc0 2023-07-11T00:00:23.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f349ffb3700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3498149000 con 0x7f3498069f30 2023-07-11T00:00:23.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f00f9088700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f00d806adb0 0x7f00d806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f5141e72700 1 -- 172.21.15.38:0/1736870965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f513c0b8700 msgr2=0x7f513c0b3b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:00:23.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f5141e72700 1 --2- 172.21.15.38:0/1736870965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f513c0b8700 0x7f513c0b3b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f5141e72700 1 -- 172.21.15.38:0/1736870965 >> v1:172.21.15.38:6789/0 conn(0x7f513c0b93d0 legacy=0x7f513c1467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f5141e72700 1 -- 172.21.15.38:0/1736870965 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c0b4f00 con 0x7f513c146ee0 2023-07-11T00:00:23.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.777+0000 7f5141e72700 1 --2- 172.21.15.38:0/1736870965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c146ee0 0x7f513c140240 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f513400bd20 tx=0x7f513400a2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51598978553e929 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f349d54e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f349806a380 0x7f34981e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f349d54e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f349806a380 0x7f34981e3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52886/0 (socket says 172.21.15.38:52886) 2023-07-11T00:00:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f349d54e700 1 -- 172.21.15.38:0/561746349 learned_addr learned my addr 172.21.15.38:0/561746349 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f5133fff700 1 -- 172.21.15.38:0/1736870965 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400ca90 con 0x7f513c146ee0 2023-07-11T00:00:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f5133fff700 1 -- 172.21.15.38:0/1736870965 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513400cbf0 con 0x7f513c146ee0 2023-07-11T00:00:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f5133fff700 1 -- 172.21.15.38:0/1736870965 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134013420 con 0x7f513c146ee0 2023-07-11T00:00:23.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f00f9088700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f00d806adb0 0x7f00d806d260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009fd0 tx=0x7f00f0010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f349d54e700 1 -- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3498069f30 msgr2=0x7f3498149970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-11T00:00:23.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f349d54e700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3498069f30 0x7f3498149970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f349d54e700 1 -- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3498147dc0 msgr2=0x7f3498142530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-11T00:00:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f349d54e700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3498147dc0 0x7f3498142530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f349d54e700 1 -- 172.21.15.38:0/561746349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34880094a0 con 0x7f349806a380 2023-07-11T00:00:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.778+0000 7f349d54e700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f349806a380 0x7f34981e3e20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f349400e810 tx=0x7f349400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.779+0000 7f348e7fc700 1 -- 172.21.15.38:0/561746349 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494013610 con 0x7f349806a380 2023-07-11T00:00:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.779+0000 7f51438d5700 1 -- 172.21.15.38:0/1736870965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c146ee0 msgr2=0x7f513c140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.779+0000 7f51438d5700 1 --2- 172.21.15.38:0/1736870965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c146ee0 0x7f513c140240 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f513400bd20 tx=0x7f513400a2f0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.779+0000 7f348e7fc700 1 -- 172.21.15.38:0/561746349 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494013770 con 0x7f349806a380 2023-07-11T00:00:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.779+0000 7f348e7fc700 1 -- 172.21.15.38:0/561746349 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494013b00 con 0x7f349806a380 2023-07-11T00:00:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.779+0000 7fc8e1c2e700 1 Processor -- start 2023-07-11T00:00:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.779+0000 7f51438d5700 1 -- 172.21.15.38:0/1736870965 shutdown_connections 2023-07-11T00:00:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.779+0000 7f51438d5700 1 --2- 172.21.15.38:0/1736870965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c146ee0 0x7f513c140240 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.779+0000 7f51438d5700 1 --2- 172.21.15.38:0/1736870965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f513c0b8700 0x7f513c0b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.779+0000 7f51438d5700 1 -- 172.21.15.38:0/1736870965 >> 172.21.15.38:0/1736870965 conn(0x7f513c069f30 msgr2=0x7f513c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.780+0000 7f534c1d9700 1 Processor -- start 2023-07-11T00:00:23.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.780+0000 7f349ffb3700 1 -- 172.21.15.38:0/561746349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3498149490 con 0x7f349806a380 2023-07-11T00:00:23.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.780+0000 7f51438d5700 1 -- 172.21.15.38:0/1736870965 shutdown_connections 2023-07-11T00:00:23.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.780+0000 7f349ffb3700 1 -- 172.21.15.38:0/561746349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349814ad50 con 0x7f349806a380 2023-07-11T00:00:23.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.779+0000 7fc8e1c2e700 1 -- start start 2023-07-11T00:00:23.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.780+0000 7fc8e1c2e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc8dc0b3ad0 0x7fc8dc14eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.780+0000 7fc8e1c2e700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc8dc0b4670 0x7fc8dc0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.780+0000 7fc8e1c2e700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc1521a0 con 0x7fc8dc148950 2023-07-11T00:00:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.780+0000 7fc8e1c2e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc152480 con 0x7fc8dc0b3ad0 2023-07-11T00:00:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.780+0000 7fc8e1c2e700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc152760 con 0x7fc8dc0b4670 2023-07-11T00:00:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.781+0000 7fc8db7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc8dc0b3ad0 0x7fc8dc14eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.781+0000 7fc8db7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc8dc0b3ad0 0x7fc8dc14eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52896/0 (socket says 172.21.15.38:52896) 2023-07-11T00:00:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.781+0000 7fc8db7fe700 1 -- 172.21.15.38:0/1773870844 learned_addr learned my addr 172.21.15.38:0/1773870844 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.781+0000 7fc8db7fe700 1 -- 172.21.15.38:0/1773870844 >> v2:172.21.15.70:3300/0 conn(0x7fc8dc0b4670 msgr2=0x7fc8dc0b4ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:00:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.781+0000 7fc8db7fe700 1 --2- 172.21.15.38:0/1773870844 >> v2:172.21.15.70:3300/0 conn(0x7fc8dc0b4670 0x7fc8dc0b4ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.781+0000 7fc8db7fe700 1 -- 172.21.15.38:0/1773870844 >> v1:172.21.15.70:6789/0 conn(0x7fc8dc148950 legacy=0x7fc8dc0b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.781+0000 7fc8db7fe700 1 -- 172.21.15.38:0/1773870844 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc152a40 con 0x7fc8dc0b3ad0 2023-07-11T00:00:23.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.780+0000 7f51438d5700 1 -- 172.21.15.38:0/1736870965 wait complete. 2023-07-11T00:00:23.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.781+0000 7fc8db7fe700 1 --2- 172.21.15.38:0/1773870844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8dc0b3ad0 0x7fc8dc14eb50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc06c900 tx=0x7fc8d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8799b0ee57f9456e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.782+0000 7f349ffb3700 1 -- 172.21.15.38:0/561746349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34981492e0 con 0x7f349806a380 2023-07-11T00:00:23.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.781+0000 7f51438d5700 1 Processor -- start 2023-07-11T00:00:23.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.781+0000 7f51438d5700 1 -- start start 2023-07-11T00:00:23.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f534c1d9700 1 -- start start 2023-07-11T00:00:23.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f51438d5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c0b93d0 0x7f513c0bcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f51438d5700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f513c146ee0 0x7f513c1e3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f51438d5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f513c0b2b90 0x7f513c139540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f51438d5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0bd0e0 con 0x7f513c0b2b90 2023-07-11T00:00:23.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f51438d5700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c1e7360 con 0x7f513c0b93d0 2023-07-11T00:00:23.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f51438d5700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c1e75b0 con 0x7f513c146ee0 2023-07-11T00:00:23.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f5141671700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c0b93d0 0x7f513c0bcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f5141671700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c0b93d0 0x7f513c0bcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53350/0 (socket says 172.21.15.38:53350) 2023-07-11T00:00:23.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f5141671700 1 -- 172.21.15.38:0/3358600130 learned_addr learned my addr 172.21.15.38:0/3358600130 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f5140e70700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f513c146ee0 0x7f513c1e3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7f00e9ffb700 1 -- 172.21.15.38:0/815934086 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f00ec0550d0 con 0x7f00f414f320 2023-07-11T00:00:23.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f348e7fc700 1 -- 172.21.15.38:0/561746349 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3494013c60 con 0x7f349806a380 2023-07-11T00:00:23.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.782+0000 7fc8da7fc700 1 -- 172.21.15.38:0/1773870844 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400e070 con 0x7fc8dc0b3ad0 2023-07-11T00:00:23.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7fc8da7fc700 1 -- 172.21.15.38:0/1773870844 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d400b9c0 con 0x7fc8dc0b3ad0 2023-07-11T00:00:23.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.783+0000 7fc8da7fc700 1 -- 172.21.15.38:0/1773870844 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400bd70 con 0x7fc8dc0b3ad0 2023-07-11T00:00:23.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/1773870844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8dc0b3ad0 msgr2=0x7fc8dc14eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7fc8e1c2e700 1 --2- 172.21.15.38:0/1773870844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8dc0b3ad0 0x7fc8dc14eb50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc06c900 tx=0x7fc8d400b330 comp rx=0 tx=0).stop 2023-07-11T00:00:23.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f534c1d9700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5344071910 0x7f5344070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f534c1d9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f534414b510 0x7f534406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f534c1d9700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534406c220 con 0x7f534406c770 2023-07-11T00:00:23.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f534c1d9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53440701a0 con 0x7f534414b510 2023-07-11T00:00:23.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f534c1d9700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534414b940 con 0x7f5344071910 2023-07-11T00:00:23.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f5141671700 1 -- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f513c146ee0 msgr2=0x7f513c1e3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f5141671700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f513c146ee0 0x7f513c1e3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f5141671700 1 -- 172.21.15.38:0/3358600130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f513c0b2b90 msgr2=0x7f513c139540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f5141671700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f513c0b2b90 0x7f513c139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f5141671700 1 -- 172.21.15.38:0/3358600130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513400b980 con 0x7f513c0b93d0 2023-07-11T00:00:23.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f348e7fc700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f347c06ace0 0x7f347c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7f348e7fc700 1 -- 172.21.15.38:0/561746349 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3494089630 con 0x7f349806a380 2023-07-11T00:00:23.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/1773870844 shutdown_connections 2023-07-11T00:00:23.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7fc8e1c2e700 1 --2- 172.21.15.38:0/1773870844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8dc0b3ad0 0x7fc8dc14eb50 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc06c900 tx=0x7fc8d400b330 comp rx=0 tx=0).stop 2023-07-11T00:00:23.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7fc8e1c2e700 1 --2- 172.21.15.38:0/1773870844 >> v2:172.21.15.70:3300/0 conn(0x7fc8dc0b4670 0x7fc8dc0b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.784+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/1773870844 >> 172.21.15.38:0/1773870844 conn(0x7fc8dc069f30 msgr2=0x7fc8dc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.785+0000 7f5141671700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c0b93d0 0x7f513c0bcba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f513800b500 tx=0x7f513800b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.785+0000 7f534a776700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f534406c770 0x7f534414df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54452/0 (socket says 172.21.15.38:54452) 2023-07-11T00:00:23.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.785+0000 7f534a776700 1 -- 172.21.15.38:0/3741319408 learned_addr learned my addr 172.21.15.38:0/3741319408 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:23.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.785+0000 7f5349774700 1 --2- 172.21.15.38:0/3741319408 >> v2:172.21.15.38:3300/0 conn(0x7f534414b510 0x7f534406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.785+0000 7f349dd4f700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f347c06ace0 0x7f347c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.785+0000 7f5349774700 1 -- 172.21.15.38:0/3741319408 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5344071910 msgr2=0x7f5344070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.785+0000 7f5349774700 1 --2- 172.21.15.38:0/3741319408 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5344071910 0x7f5344070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.785+0000 7f5349774700 1 -- 172.21.15.38:0/3741319408 >> v1:172.21.15.38:6789/0 conn(0x7f534406c770 legacy=0x7f534414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.785+0000 7f5349774700 1 -- 172.21.15.38:0/3741319408 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53440713d0 con 0x7f534414b510 2023-07-11T00:00:23.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.785+0000 7fe25ea34700 1 Processor -- start 2023-07-11T00:00:23.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.786+0000 7f5349774700 1 --2- 172.21.15.38:0/3741319408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534414b510 0x7f534406bce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5340009840 tx=0x7f5340009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efa5b1650fca27f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.787+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/1773870844 shutdown_connections 2023-07-11T00:00:23.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.786+0000 7fe25ea34700 1 -- start start 2023-07-11T00:00:23.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.787+0000 7fe25ea34700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe2580b8700 0x7fe2580b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.787+0000 7fe25ea34700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2580b46f0 con 0x7fe2580b93d0 2023-07-11T00:00:23.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.787+0000 7fe25ea34700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2580b4940 con 0x7fe258146ee0 2023-07-11T00:00:23.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.787+0000 7fe25ea34700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2580b4c20 con 0x7fe2580b8700 2023-07-11T00:00:23.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.787+0000 7fe2577fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe2580b93d0 0x7fe2581467d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54454/0 (socket says 172.21.15.38:54454) 2023-07-11T00:00:23.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.787+0000 7fe2577fe700 1 -- 172.21.15.38:0/2845435937 learned_addr learned my addr 172.21.15.38:0/2845435937 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:23.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.787+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/1773870844 wait complete. 2023-07-11T00:00:23.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fc8e1c2e700 1 Processor -- start 2023-07-11T00:00:23.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796676556 0 0) 0x7fe2580b4940 con 0x7fe258146ee0 2023-07-11T00:00:23.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2400035b0 con 0x7fe258146ee0 2023-07-11T00:00:23.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 <== mon.1 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4188380091 0 0) 0x7fe2400035b0 con 0x7fe258146ee0 2023-07-11T00:00:23.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 >> v2:172.21.15.70:3300/0 conn(0x7fe2580b8700 msgr2=0x7fe2580b3b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:00:23.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 --2- 172.21.15.38:0/2845435937 >> v2:172.21.15.70:3300/0 conn(0x7fe2580b8700 0x7fe2580b3b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 >> v1:172.21.15.38:6789/0 conn(0x7fe2580b93d0 legacy=0x7fe2581467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2580b4f00 con 0x7fe258146ee0 2023-07-11T00:00:23.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 <== mon.1 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7fe248001670 con 0x7fe258146ee0 2023-07-11T00:00:23.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 >> v1:172.21.15.70:6789/0 conn(0x7fe258146ee0 legacy=0x7fe258140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 --2- 172.21.15.38:0/2845435937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe240003a50 0x7fe240003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 --2- 172.21.15.38:0/2845435937 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe240004850 0x7fe240004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 --2- 172.21.15.38:0/2845435937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe240005320 0x7fe24000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580b4c20 con 0x7fe240005320 2023-07-11T00:00:23.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24000c240 con 0x7fe240003a50 2023-07-11T00:00:23.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24000c400 con 0x7fe240004850 2023-07-11T00:00:23.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.788+0000 7fe25cfd1700 1 --2- 172.21.15.38:0/2845435937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe240005320 0x7fe24000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fe25cfd1700 1 -- 172.21.15.38:0/2845435937 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe240004850 msgr2=0x7fe240004cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:00:23.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fe25cfd1700 1 --2- 172.21.15.38:0/2845435937 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe240004850 0x7fe240004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fe25cfd1700 1 -- 172.21.15.38:0/2845435937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe240003a50 msgr2=0x7fe240003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fe257fff700 1 --2- 172.21.15.38:0/2845435937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe240003a50 0x7fe240003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fe25cfd1700 1 --2- 172.21.15.38:0/2845435937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe240003a50 0x7fe240003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fe25cfd1700 1 -- 172.21.15.38:0/2845435937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2400035b0 con 0x7fe240005320 2023-07-11T00:00:23.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fe257fff700 1 --2- 172.21.15.38:0/2845435937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe240003a50 0x7fe240003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:23.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fe25cfd1700 1 -- 172.21.15.38:0/2845435937 reap_dead start 2023-07-11T00:00:23.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fe25cfd1700 1 --2- 172.21.15.38:0/2845435937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe240005320 0x7fe24000ba10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe248007f90 tx=0x7fe240005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee39efea82a3d1d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fc8e1c2e700 1 -- start start 2023-07-11T00:00:23.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fc8e1c2e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8dc0b4670 0x7fc8dc148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fc8e1c2e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc8dc148950 0x7fc8dc1323a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fc8e1c2e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8dc14b960 0x7fc8dc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fc8e1c2e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc070fb0 con 0x7fc8dc0b4670 2023-07-11T00:00:23.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fc8e1c2e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc1318e0 con 0x7fc8dc14b960 2023-07-11T00:00:23.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7fc8e1c2e700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc072160 con 0x7fc8dc148950 2023-07-11T00:00:23.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.789+0000 7f5131ffb700 1 -- 172.21.15.38:0/3358600130 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138011830 con 0x7f513c0b93d0 2023-07-11T00:00:23.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.790+0000 7f5131ffb700 1 -- 172.21.15.38:0/3358600130 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138011990 con 0x7f513c0b93d0 2023-07-11T00:00:23.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.790+0000 7f5131ffb700 1 -- 172.21.15.38:0/3358600130 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138011d20 con 0x7f513c0b93d0 2023-07-11T00:00:23.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.790+0000 7f5348f73700 1 -- 172.21.15.38:0/3741319408 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340011830 con 0x7f534414b510 2023-07-11T00:00:23.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.790+0000 7f5348f73700 1 -- 172.21.15.38:0/3741319408 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340011990 con 0x7f534414b510 2023-07-11T00:00:23.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.790+0000 7f5348f73700 1 -- 172.21.15.38:0/3741319408 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340011d00 con 0x7f534414b510 2023-07-11T00:00:23.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.790+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248016070 con 0x7fe240005320 2023-07-11T00:00:23.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.790+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe248007a00 con 0x7fe240005320 2023-07-11T00:00:23.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.790+0000 7fe256ffd700 1 -- 172.21.15.38:0/2845435937 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800cc10 con 0x7fe240005320 2023-07-11T00:00:23.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.790+0000 7f348e7fc700 1 -- 172.21.15.38:0/561746349 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f34940546d0 con 0x7f349806a380 2023-07-11T00:00:23.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7fe25ea34700 1 -- 172.21.15.38:0/2845435937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe240005320 msgr2=0x7fe24000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7fe25ea34700 1 --2- 172.21.15.38:0/2845435937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe240005320 0x7fe24000ba10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe248007f90 tx=0x7fe240005880 comp rx=0 tx=0).stop 2023-07-11T00:00:23.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7fe25ea34700 1 -- 172.21.15.38:0/2845435937 shutdown_connections 2023-07-11T00:00:23.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7fe25ea34700 1 --2- 172.21.15.38:0/2845435937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe240005320 0x7fe24000ba10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7fe25ea34700 1 -- 172.21.15.38:0/2845435937 >> 172.21.15.38:0/2845435937 conn(0x7fe258069f30 msgr2=0x7fe25806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.790+0000 7f51438d5700 1 -- 172.21.15.38:0/3358600130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c1e7890 con 0x7f513c0b93d0 2023-07-11T00:00:23.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.790+0000 7f51438d5700 1 -- 172.21.15.38:0/3358600130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c1e4320 con 0x7f513c0b93d0 2023-07-11T00:00:23.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7fc8db7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8dc0b4670 0x7fc8dc148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7fc8db7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8dc0b4670 0x7fc8dc148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52924/0 (socket says 172.21.15.38:52924) 2023-07-11T00:00:23.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7fc8db7fe700 1 -- 172.21.15.38:0/2221616963 learned_addr learned my addr 172.21.15.38:0/2221616963 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7fc8daffd700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc8dc148950 0x7fc8dc1323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7fc8dbfff700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8dc14b960 0x7fc8dc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7f534c1d9700 1 -- 172.21.15.38:0/3741319408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534414b510 msgr2=0x7f534406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.791+0000 7f534c1d9700 1 --2- 172.21.15.38:0/3741319408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534414b510 0x7f534406bce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5340009840 tx=0x7f5340009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:23.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7fc8db7fe700 1 -- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc8dc148950 msgr2=0x7fc8dc1323a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7fc8db7fe700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc8dc148950 0x7fc8dc1323a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7fc8db7fe700 1 -- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8dc14b960 msgr2=0x7fc8dc071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7fc8db7fe700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8dc14b960 0x7fc8dc071940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7fc8db7fe700 1 -- 172.21.15.38:0/2221616963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d4009b30 con 0x7fc8dc0b4670 2023-07-11T00:00:23.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7fc8daffd700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc8dc148950 0x7fc8dc1323a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:23.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7fc8db7fe700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8dc0b4670 0x7fc8dc148ed0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4012000 tx=0x7fc8d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7f51438d5700 1 -- 172.21.15.38:0/3358600130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c1e7db0 con 0x7f513c0b93d0 2023-07-11T00:00:23.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7f534c1d9700 1 -- 172.21.15.38:0/3741319408 shutdown_connections 2023-07-11T00:00:23.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7f534c1d9700 1 --2- 172.21.15.38:0/3741319408 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5344071910 0x7f5344070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7f534c1d9700 1 --2- 172.21.15.38:0/3741319408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534414b510 0x7f534406bce0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7f534c1d9700 1 -- 172.21.15.38:0/3741319408 >> 172.21.15.38:0/3741319408 conn(0x7f53440be670 msgr2=0x7f53440bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7fe25ea34700 1 -- 172.21.15.38:0/2845435937 shutdown_connections 2023-07-11T00:00:23.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7f534c1d9700 1 -- 172.21.15.38:0/3741319408 shutdown_connections 2023-07-11T00:00:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.793+0000 7f355b7a5700 1 Processor -- start 2023-07-11T00:00:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7fc8c3fff700 1 -- 172.21.15.38:0/2221616963 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4004250 con 0x7fc8dc0b4670 2023-07-11T00:00:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.793+0000 7fc8c3fff700 1 -- 172.21.15.38:0/2221616963 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d40043b0 con 0x7fc8dc0b4670 2023-07-11T00:00:23.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.793+0000 7fc8c3fff700 1 -- 172.21.15.38:0/2221616963 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4004760 con 0x7fc8dc0b4670 2023-07-11T00:00:23.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.793+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/2221616963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc131ba0 con 0x7fc8dc0b4670 2023-07-11T00:00:23.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.793+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/2221616963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc0711b0 con 0x7fc8dc0b4670 2023-07-11T00:00:23.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7fe25ea34700 1 -- 172.21.15.38:0/2845435937 wait complete. 2023-07-11T00:00:23.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.792+0000 7f534c1d9700 1 -- 172.21.15.38:0/3741319408 wait complete. 2023-07-11T00:00:23.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.794+0000 7fe25ea34700 1 Processor -- start 2023-07-11T00:00:23.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.794+0000 7f534c1d9700 1 Processor -- start 2023-07-11T00:00:23.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.794+0000 7f534c1d9700 1 -- start start 2023-07-11T00:00:23.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7f534c1d9700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f534406c770 0x7f53441d6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7f534c1d9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344071910 0x7f53440b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7f534c1d9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534414b510 0x7f53440b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7f534c1d9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53441d7b60 con 0x7f534414b510 2023-07-11T00:00:23.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7f534c1d9700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53440b19c0 con 0x7f5344071910 2023-07-11T00:00:23.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7f534c1d9700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53440b2c20 con 0x7f534406c770 2023-07-11T00:00:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.794+0000 7fe25ea34700 1 -- start start 2023-07-11T00:00:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7fe25ea34700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe240005320 0x7fe25813b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7fe25ea34700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2581dc190 0x7fe2581deaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7fe25ea34700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe258134c90 0x7fe2581433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7fe25ea34700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe258141a70 con 0x7fe258134c90 2023-07-11T00:00:23.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7fe25ea34700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25813bcc0 con 0x7fe240005320 2023-07-11T00:00:23.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7fe25ea34700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2581db6b0 con 0x7fe2581dc190 2023-07-11T00:00:23.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7fe2577fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2581dc190 0x7fe2581deaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7fe257fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe240005320 0x7fe25813b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7fe2577fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2581dc190 0x7fe2581deaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42870/0 (socket says 172.21.15.38:42870) 2023-07-11T00:00:23.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7fe2577fe700 1 -- 172.21.15.38:0/1921884920 learned_addr learned my addr 172.21.15.38:0/1921884920 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7f5131ffb700 1 -- 172.21.15.38:0/3358600130 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f513801a400 con 0x7f513c0b93d0 2023-07-11T00:00:23.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7f355b7a5700 1 -- start start 2023-07-11T00:00:23.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.794+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/2221616963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc074360 con 0x7fc8dc0b4670 2023-07-11T00:00:23.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.795+0000 7fc8c3fff700 1 -- 172.21.15.38:0/2221616963 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8d401c440 con 0x7fc8dc0b4670 2023-07-11T00:00:23.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7fc8c3fff700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc8c806ace0 0x7fc8c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7fc8c3fff700 1 -- 172.21.15.38:0/2221616963 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8d408aa20 con 0x7fc8dc0b4670 2023-07-11T00:00:23.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7f355b7a5700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f35540b8700 0x7f35540b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7f534a776700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534414b510 0x7f53440b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f534a776700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534414b510 0x7f53440b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52940/0 (socket says 172.21.15.38:52940) 2023-07-11T00:00:23.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f534a776700 1 -- 172.21.15.38:0/296130413 learned_addr learned my addr 172.21.15.38:0/296130413 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7fe2577fe700 1 -- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe240005320 msgr2=0x7fe25813b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7fe2577fe700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe240005320 0x7fe25813b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7fe2577fe700 1 -- 172.21.15.38:0/1921884920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe258134c90 msgr2=0x7fe2581433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7fe2577fe700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe258134c90 0x7fe2581433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7fe2577fe700 1 -- 172.21.15.38:0/1921884920 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2581db990 con 0x7fe2581dc190 2023-07-11T00:00:23.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7fe2577fe700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2581dc190 0x7fe2581deaa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe250001c00 tx=0x7fe25000ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7f5131ffb700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f512006adb0 0x7f512006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f5131ffb700 1 -- 172.21.15.38:0/3358600130 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51380893c0 con 0x7f513c0b93d0 2023-07-11T00:00:23.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f5140e70700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f512006adb0 0x7f512006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7fc8daffd700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc8c806ace0 0x7fc8c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f5349f75700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f534406c770 0x7f53441d6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f5349774700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344071910 0x7f53440b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f534a776700 1 -- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f534406c770 msgr2=0x7f53441d6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f534a776700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f534406c770 0x7f53441d6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f534a776700 1 -- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344071910 msgr2=0x7f53440b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f534a776700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344071910 0x7f53440b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f534a776700 1 -- 172.21.15.38:0/296130413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400094a0 con 0x7f534414b510 2023-07-11T00:00:23.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f5349774700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344071910 0x7f53440b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:23.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.798+0000 7f5140e70700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f512006adb0 0x7f512006d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f513c0b11e0 tx=0x7f512c006120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.798+0000 7f349dd4f700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f347c06ace0 0x7f347c06d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3488009b90 tx=0x7f3488013040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.798+0000 7f534a776700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534414b510 0x7f53440b26e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f533c00caa0 tx=0x7f533c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7fe254ff9700 1 -- 172.21.15.38:0/1921884920 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250011680 con 0x7fe2581dc190 2023-07-11T00:00:23.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7fe254ff9700 1 -- 172.21.15.38:0/1921884920 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2500117e0 con 0x7fe2581dc190 2023-07-11T00:00:23.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7fe254ff9700 1 -- 172.21.15.38:0/1921884920 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250011b50 con 0x7fe2581dc190 2023-07-11T00:00:23.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.798+0000 7fc8daffd700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc8c806ace0 0x7fc8c806d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0099b0 tx=0x7fc8cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7fe25ea34700 1 -- 172.21.15.38:0/1921884920 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2581dbc70 con 0x7fe2581dc190 2023-07-11T00:00:23.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7fe25ea34700 1 -- 172.21.15.38:0/1921884920 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe258143fe0 con 0x7fe2581dc190 2023-07-11T00:00:23.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.798+0000 7fe25ea34700 1 -- 172.21.15.38:0/1921884920 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2380052f0 con 0x7fe2581dc190 2023-07-11T00:00:23.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.796+0000 7f355b7a5700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f35540b93d0 0x7f35541467d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f355b7a5700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35540b46f0 con 0x7f355406aa40 2023-07-11T00:00:23.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f355b7a5700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35540b4940 con 0x7f35540b8700 2023-07-11T00:00:23.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f355b7a5700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35540b4c20 con 0x7f35540b93d0 2023-07-11T00:00:23.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f3559541700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f35540b8700 0x7f35540b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.797+0000 7f3558d40700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f35540b93d0 0x7f35541467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.799+0000 7f3559541700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f35540b8700 0x7f35540b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53396/0 (socket says 172.21.15.38:53396) 2023-07-11T00:00:23.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.799+0000 7f3559541700 1 -- 172.21.15.38:0/3050678631 learned_addr learned my addr 172.21.15.38:0/3050678631 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.800+0000 7f3558d40700 1 -- 172.21.15.38:0/3050678631 >> v2:172.21.15.70:3300/0 conn(0x7f35540b8700 msgr2=0x7f35540b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.800+0000 7f3558d40700 1 --2- 172.21.15.38:0/3050678631 >> v2:172.21.15.70:3300/0 conn(0x7f35540b8700 0x7f35540b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.800+0000 7f3558d40700 1 -- 172.21.15.38:0/3050678631 >> v1:172.21.15.70:6789/0 conn(0x7f355406aa40 legacy=0x7f3554140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.800+0000 7f3558d40700 1 -- 172.21.15.38:0/3050678631 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540b4f00 con 0x7f35540b93d0 2023-07-11T00:00:23.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.800+0000 7f3558d40700 1 --2- 172.21.15.38:0/3050678631 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f35540b93d0 0x7f35541467d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3550009820 tx=0x7f3550009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9de1cf4f305e08f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.801+0000 7fe254ff9700 1 -- 172.21.15.38:0/1921884920 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe250017070 con 0x7fe2581dc190 2023-07-11T00:00:23.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.801+0000 7fe254ff9700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe24406adb0 0x7fe24406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.801+0000 7fe254ff9700 1 -- 172.21.15.38:0/1921884920 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe250088f00 con 0x7fe2581dc190 2023-07-11T00:00:23.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.802+0000 7f5131ffb700 1 -- 172.21.15.38:0/3358600130 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f513c1e7db0 con 0x7f513c0b93d0 2023-07-11T00:00:23.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.803+0000 7fe257fff700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe24406adb0 0x7fe24406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.803+0000 7fe257fff700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe24406adb0 0x7fe24406d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe24c006b40 tx=0x7fe24c009740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.803+0000 7f4bc4807700 1 Processor -- start 2023-07-11T00:00:23.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.803+0000 7f4bc4807700 1 -- start start 2023-07-11T00:00:23.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.804+0000 7f533a7fc700 1 -- 172.21.15.38:0/296130413 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00a9e0 con 0x7f534414b510 2023-07-11T00:00:23.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.804+0000 7f533a7fc700 1 -- 172.21.15.38:0/296130413 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c00ab40 con 0x7f534414b510 2023-07-11T00:00:23.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.804+0000 7f533a7fc700 1 -- 172.21.15.38:0/296130413 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c012400 con 0x7f534414b510 2023-07-11T00:00:23.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.804+0000 7fc8c3fff700 1 -- 172.21.15.38:0/2221616963 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc8d4055ac0 con 0x7fc8dc0b4670 2023-07-11T00:00:23.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.804+0000 7f354bfff700 1 -- 172.21.15.38:0/3050678631 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550005e30 con 0x7f35540b93d0 2023-07-11T00:00:23.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.804+0000 7f354bfff700 1 -- 172.21.15.38:0/3050678631 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3550004030 con 0x7f35540b93d0 2023-07-11T00:00:23.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.804+0000 7f354bfff700 1 -- 172.21.15.38:0/3050678631 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35500043a0 con 0x7f35540b93d0 2023-07-11T00:00:23.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.804+0000 7f534c1d9700 1 -- 172.21.15.38:0/296130413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53440b8400 con 0x7f534414b510 2023-07-11T00:00:23.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.804+0000 7f534c1d9700 1 -- 172.21.15.38:0/296130413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53441d6ea0 con 0x7f534414b510 2023-07-11T00:00:23.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.805+0000 7f4bc4807700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4bc006b120 0x7f4bc01474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.805+0000 7f4bc4807700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bc0147a30 0x7f4bc00b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.805+0000 7f4bc4807700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc00b3bd0 con 0x7f4bc0071b60 2023-07-11T00:00:23.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.805+0000 7f4bc4807700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc0070800 con 0x7f4bc0147a30 2023-07-11T00:00:23.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.805+0000 7f4bc4807700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc0141c90 con 0x7f4bc006b120 2023-07-11T00:00:23.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.805+0000 7f4bbed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bc0147a30 0x7f4bc00b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.805+0000 7f4bbed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bc0147a30 0x7f4bc00b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52962/0 (socket says 172.21.15.38:52962) 2023-07-11T00:00:23.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.805+0000 7f4bbed9d700 1 -- 172.21.15.38:0/3918262445 learned_addr learned my addr 172.21.15.38:0/3918262445 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.805+0000 7f4bbed9d700 1 -- 172.21.15.38:0/3918262445 >> v2:172.21.15.70:3300/0 conn(0x7f4bc006b120 msgr2=0x7f4bc01474f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:00:23.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.805+0000 7f355b7a5700 1 -- 172.21.15.38:0/3050678631 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f35540b93d0 msgr2=0x7f35541467d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.805+0000 7f355b7a5700 1 --2- 172.21.15.38:0/3050678631 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f35540b93d0 0x7f35541467d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3550009820 tx=0x7f3550009b30 comp rx=0 tx=0).stop 2023-07-11T00:00:23.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.806+0000 7f534c1d9700 1 -- 172.21.15.38:0/296130413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c0052f0 con 0x7f534414b510 2023-07-11T00:00:23.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.806+0000 7f4bbed9d700 1 --2- 172.21.15.38:0/3918262445 >> v2:172.21.15.70:3300/0 conn(0x7f4bc006b120 0x7f4bc01474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.806+0000 7f4bbed9d700 1 -- 172.21.15.38:0/3918262445 >> v1:172.21.15.38:6789/0 conn(0x7f4bc0071b60 legacy=0x7f4bc00b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:23.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.806+0000 7f4bbed9d700 1 -- 172.21.15.38:0/3918262445 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00714d0 con 0x7f4bc0147a30 2023-07-11T00:00:23.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.806+0000 7f4bbed9d700 1 --2- 172.21.15.38:0/3918262445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc0147a30 0x7f4bc00b6b40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4bc006b830 tx=0x7f4bb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37749b34b349b9b server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.806+0000 7f4bbd59a700 1 -- 172.21.15.38:0/3918262445 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb800e070 con 0x7f4bc0147a30 2023-07-11T00:00:23.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.806+0000 7f4bbd59a700 1 -- 172.21.15.38:0/3918262445 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb8003a20 con 0x7f4bc0147a30 2023-07-11T00:00:23.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.806+0000 7f4bbd59a700 1 -- 172.21.15.38:0/3918262445 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8003dd0 con 0x7f4bc0147a30 2023-07-11T00:00:23.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.806+0000 7f533a7fc700 1 -- 172.21.15.38:0/296130413 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f533c01b3b0 con 0x7f534414b510 2023-07-11T00:00:23.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.807+0000 7f533a7fc700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f533006ae90 0x7f533006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.807+0000 7f533a7fc700 1 -- 172.21.15.38:0/296130413 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f533c089190 con 0x7f534414b510 2023-07-11T00:00:23.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.807+0000 7fe254ff9700 1 -- 172.21.15.38:0/1921884920 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe250054020 con 0x7fe2581dc190 2023-07-11T00:00:23.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.807+0000 7f355b7a5700 1 -- 172.21.15.38:0/3050678631 shutdown_connections 2023-07-11T00:00:23.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.807+0000 7f355b7a5700 1 --2- 172.21.15.38:0/3050678631 >> v2:172.21.15.70:3300/0 conn(0x7f35540b8700 0x7f35540b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.807+0000 7f355b7a5700 1 --2- 172.21.15.38:0/3050678631 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f35540b93d0 0x7f35541467d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.807+0000 7f355b7a5700 1 -- 172.21.15.38:0/3050678631 >> 172.21.15.38:0/3050678631 conn(0x7f3554069f30 msgr2=0x7f355406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.807+0000 7f4bc4807700 1 -- 172.21.15.38:0/3918262445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc0147a30 msgr2=0x7f4bc00b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.807+0000 7f4bc4807700 1 --2- 172.21.15.38:0/3918262445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc0147a30 0x7f4bc00b6b40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4bc006b830 tx=0x7f4bb800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:23.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.808+0000 7f5349f75700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f533006ae90 0x7f533006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.808+0000 7f5349f75700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f533006ae90 0x7f533006d340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5334009a10 tx=0x7f5334009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.809+0000 7f355b7a5700 1 -- 172.21.15.38:0/3050678631 shutdown_connections 2023-07-11T00:00:23.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.809+0000 7f355b7a5700 1 -- 172.21.15.38:0/3050678631 wait complete. 2023-07-11T00:00:23.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.811+0000 7f355b7a5700 1 Processor -- start 2023-07-11T00:00:23.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.812+0000 7f355b7a5700 1 -- start start 2023-07-11T00:00:23.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.813+0000 7f355b7a5700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f355406aa40 0x7f3554138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.813+0000 7f355b7a5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35540b8700 0x7f3554146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.813+0000 7f355b7a5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35540b93d0 0x7f3554146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.813+0000 7f355b7a5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355413a6e0 con 0x7f35540b93d0 2023-07-11T00:00:23.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.813+0000 7f355b7a5700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355406fda0 con 0x7f35540b8700 2023-07-11T00:00:23.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.813+0000 7f355b7a5700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355413a400 con 0x7f355406aa40 2023-07-11T00:00:23.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.814+0000 7f3559541700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f355406aa40 0x7f3554138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.814+0000 7f3559541700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f355406aa40 0x7f3554138e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42894/0 (socket says 172.21.15.38:42894) 2023-07-11T00:00:23.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.814+0000 7f3559541700 1 -- 172.21.15.38:0/2172108966 learned_addr learned my addr 172.21.15.38:0/2172108966 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.814+0000 7f3558d40700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35540b8700 0x7f3554146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.814+0000 7f533a7fc700 1 -- 172.21.15.38:0/296130413 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f533c0542b0 con 0x7f534414b510 2023-07-11T00:00:23.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.815+0000 7f3559541700 1 -- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35540b8700 msgr2=0x7f3554146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.815+0000 7f3559541700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35540b8700 0x7f3554146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.815+0000 7f3559541700 1 -- 172.21.15.38:0/2172108966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35540b93d0 msgr2=0x7f3554146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.815+0000 7f3559541700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35540b93d0 0x7f3554146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.815+0000 7f3559541700 1 -- 172.21.15.38:0/2172108966 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550009430 con 0x7f355406aa40 2023-07-11T00:00:23.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.815+0000 7f3558d40700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35540b8700 0x7f3554146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:23.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.815+0000 7f3559541700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f355406aa40 0x7f3554138e20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f354c0070b0 tx=0x7f354c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.815+0000 7f3549ffb700 1 -- 172.21.15.38:0/2172108966 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c00ddd0 con 0x7f355406aa40 2023-07-11T00:00:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.815+0000 7f3549ffb700 1 -- 172.21.15.38:0/2172108966 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c00f040 con 0x7f355406aa40 2023-07-11T00:00:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.815+0000 7f3549ffb700 1 -- 172.21.15.38:0/2172108966 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c015620 con 0x7f355406aa40 2023-07-11T00:00:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.816+0000 7f355b7a5700 1 -- 172.21.15.38:0/2172108966 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3554071180 con 0x7f355406aa40 2023-07-11T00:00:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.817+0000 7f355b7a5700 1 -- 172.21.15.38:0/2172108966 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3554139360 con 0x7f355406aa40 2023-07-11T00:00:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.818+0000 7f355b7a5700 1 -- 172.21.15.38:0/2172108966 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35540716a0 con 0x7f355406aa40 2023-07-11T00:00:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.820+0000 7f3549ffb700 1 -- 172.21.15.38:0/2172108966 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f354c015780 con 0x7f355406aa40 2023-07-11T00:00:23.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.821+0000 7f3549ffb700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f353806ad30 0x7f353806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.821+0000 7f3549ffb700 1 -- 172.21.15.38:0/2172108966 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f354c0897c0 con 0x7f355406aa40 2023-07-11T00:00:23.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.821+0000 7f3558d40700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f353806ad30 0x7f353806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.822+0000 7f3558d40700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f353806ad30 0x7f353806d1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3550009b70 tx=0x7f3550008070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.824+0000 7f3549ffb700 1 -- 172.21.15.38:0/2172108966 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f354c054990 con 0x7f355406aa40 2023-07-11T00:00:23.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.830+0000 7f4bc4807700 1 -- 172.21.15.38:0/3918262445 shutdown_connections 2023-07-11T00:00:23.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.830+0000 7f4bc4807700 1 --2- 172.21.15.38:0/3918262445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc0147a30 0x7f4bc00b6b40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.830+0000 7f4bc4807700 1 --2- 172.21.15.38:0/3918262445 >> v2:172.21.15.70:3300/0 conn(0x7f4bc006b120 0x7f4bc01474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.830+0000 7f4bc4807700 1 -- 172.21.15.38:0/3918262445 >> 172.21.15.38:0/3918262445 conn(0x7f4bc00bd980 msgr2=0x7f4bc00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.836+0000 7f4bc4807700 1 -- 172.21.15.38:0/3918262445 shutdown_connections 2023-07-11T00:00:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.836+0000 7f4bc4807700 1 -- 172.21.15.38:0/3918262445 wait complete. 2023-07-11T00:00:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.838+0000 7f4bc4807700 1 Processor -- start 2023-07-11T00:00:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.838+0000 7f4bc4807700 1 -- start start 2023-07-11T00:00:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.839+0000 7f4bc4807700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc006b120 0x7f4bc01d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.839+0000 7f4bc4807700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bc0071b60 0x7f4bc008a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.839+0000 7f4bc4807700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc0147a30 0x7f4bc013be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.839+0000 7f4bc4807700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc01d10d0 con 0x7f4bc0147a30 2023-07-11T00:00:23.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.839+0000 7f4bc4807700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc0141df0 con 0x7f4bc006b120 2023-07-11T00:00:23.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.839+0000 7f4bc4807700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc0142690 con 0x7f4bc0071b60 2023-07-11T00:00:23.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.840+0000 7f4bbdd9b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bc0071b60 0x7f4bc008a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.840+0000 7f4bbe59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc006b120 0x7f4bc01d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.840+0000 7f4bbed9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc0147a30 0x7f4bc013be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.840+0000 7f4bbed9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc0147a30 0x7f4bc013be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52980/0 (socket says 172.21.15.38:52980) 2023-07-11T00:00:23.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.840+0000 7f4bbed9d700 1 -- 172.21.15.38:0/2430220914 learned_addr learned my addr 172.21.15.38:0/2430220914 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:23.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.840+0000 7f4bbed9d700 1 -- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bc0071b60 msgr2=0x7f4bc008a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.840+0000 7f4bbed9d700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bc0071b60 0x7f4bc008a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.840+0000 7f4bbed9d700 1 -- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc006b120 msgr2=0x7f4bc01d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.840+0000 7f4bbed9d700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc006b120 0x7f4bc01d0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.841+0000 7f4bbed9d700 1 -- 172.21.15.38:0/2430220914 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb8009b30 con 0x7f4bc0147a30 2023-07-11T00:00:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.841+0000 7f4bbed9d700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc0147a30 0x7f4bc013be10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800b370 tx=0x7f4bb8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.847+0000 7f4baeffd700 1 -- 172.21.15.38:0/2430220914 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8004240 con 0x7f4bc0147a30 2023-07-11T00:00:23.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.847+0000 7f4baeffd700 1 -- 172.21.15.38:0/2430220914 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb80043a0 con 0x7f4bc0147a30 2023-07-11T00:00:23.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.847+0000 7f4baeffd700 1 -- 172.21.15.38:0/2430220914 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8004730 con 0x7f4bc0147a30 2023-07-11T00:00:23.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.847+0000 7f4bc4807700 1 -- 172.21.15.38:0/2430220914 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc01d1340 con 0x7f4bc0147a30 2023-07-11T00:00:23.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.847+0000 7f4bc4807700 1 -- 172.21.15.38:0/2430220914 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc0142320 con 0x7f4bc0147a30 2023-07-11T00:00:23.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.848+0000 7f4bc4807700 1 -- 172.21.15.38:0/2430220914 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba40052f0 con 0x7f4bc0147a30 2023-07-11T00:00:23.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.859+0000 7f4baeffd700 1 -- 172.21.15.38:0/2430220914 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4bb8019070 con 0x7f4bc0147a30 2023-07-11T00:00:23.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.859+0000 7f4baeffd700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4ba006f1f0 0x7f4ba00716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:23.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.860+0000 7f4baeffd700 1 -- 172.21.15.38:0/2430220914 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4bb808a7b0 con 0x7f4bc0147a30 2023-07-11T00:00:23.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.860+0000 7f4baeffd700 1 -- 172.21.15.38:0/2430220914 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4bb80559f0 con 0x7f4bc0147a30 2023-07-11T00:00:23.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.867+0000 7f4bbe59c700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4ba006f1f0 0x7f4ba00716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:23.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:23.899+0000 7f4bbe59c700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4ba006f1f0 0x7f4ba00716a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0006fd0 tx=0x7f4bb0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:24.169 INFO:teuthology.orchestra.run.smithi038.stdout:55834574852 2023-07-11T00:00:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.164+0000 7f349ffb3700 1 -- 172.21.15.38:0/561746349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3498074360 con 0x7f349806a380 2023-07-11T00:00:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.164+0000 7f348e7fc700 1 -- 172.21.15.38:0/561746349 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3494057cf0 con 0x7f349806a380 2023-07-11T00:00:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 -- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f347c06ace0 msgr2=0x7f347c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f347c06ace0 0x7f347c06d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3488009b90 tx=0x7f3488013040 comp rx=0 tx=0).stop 2023-07-11T00:00:24.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 -- 172.21.15.38:0/561746349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f349806a380 msgr2=0x7f34981e3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f349806a380 0x7f34981e3e20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f349400e810 tx=0x7f349400ebd0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 -- 172.21.15.38:0/561746349 shutdown_connections 2023-07-11T00:00:24.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f347c06ace0 0x7f347c06d190 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3488009b90 tx=0x7f3488013040 comp rx=0 tx=0).stop 2023-07-11T00:00:24.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3498147dc0 0x7f3498142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3498069f30 0x7f3498149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 --2- 172.21.15.38:0/561746349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f349806a380 0x7f34981e3e20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 -- 172.21.15.38:0/561746349 >> 172.21.15.38:0/561746349 conn(0x7f349806d0e0 msgr2=0x7f3498146290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:24.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 -- 172.21.15.38:0/561746349 shutdown_connections 2023-07-11T00:00:24.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.168+0000 7f349ffb3700 1 -- 172.21.15.38:0/561746349 wait complete. 2023-07-11T00:00:24.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-07-11T00:00:24.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.193+0000 7f00fb2ec700 1 -- 172.21.15.38:0/815934086 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f00f4074360 con 0x7f00f414f320 2023-07-11T00:00:24.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.194+0000 7f00e9ffb700 1 -- 172.21.15.38:0/815934086 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00ec018030 con 0x7f00f414f320 2023-07-11T00:00:24.196 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-07-11T00:00:24.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.196+0000 7f00fb2ec700 1 -- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f00d806adb0 msgr2=0x7f00d806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.196+0000 7f00fb2ec700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f00d806adb0 0x7f00d806d260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009fd0 tx=0x7f00f0010000 comp rx=0 tx=0).stop 2023-07-11T00:00:24.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.196+0000 7f00fb2ec700 1 -- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f414f320 msgr2=0x7f00f41e7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.196+0000 7f00fb2ec700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f414f320 0x7f00f41e7500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00efc0 tx=0x7f00ec00c3a0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.197+0000 7f00fb2ec700 1 -- 172.21.15.38:0/815934086 shutdown_connections 2023-07-11T00:00:24.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.197+0000 7f00fb2ec700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f00d806adb0 0x7f00d806d260 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009fd0 tx=0x7f00f0010000 comp rx=0 tx=0).stop 2023-07-11T00:00:24.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.197+0000 7f00fb2ec700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00f414f320 0x7f00f41e7500 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.197+0000 7f00fb2ec700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f406b120 0x7f00f40b6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.197+0000 7f00fb2ec700 1 --2- 172.21.15.38:0/815934086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00f4071380 0x7f00f41d4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.197+0000 7f00fb2ec700 1 -- 172.21.15.38:0/815934086 >> 172.21.15.38:0/815934086 conn(0x7f00f40bd980 msgr2=0x7f00f40b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:24.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.197+0000 7f00fb2ec700 1 -- 172.21.15.38:0/815934086 shutdown_connections 2023-07-11T00:00:24.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.197+0000 7f00fb2ec700 1 -- 172.21.15.38:0/815934086 wait complete. 2023-07-11T00:00:24.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-07-11T00:00:24.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.214+0000 7fe25ea34700 1 -- 172.21.15.38:0/1921884920 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe238005870 con 0x7fe2581dc190 2023-07-11T00:00:24.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.215+0000 7fe254ff9700 1 -- 172.21.15.38:0/1921884920 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe250022350 con 0x7fe2581dc190 2023-07-11T00:00:24.219 INFO:teuthology.orchestra.run.smithi038.stdout:55834574852 2023-07-11T00:00:24.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.218+0000 7fe25ea34700 1 -- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe24406adb0 msgr2=0x7fe24406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.218+0000 7fe25ea34700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe24406adb0 0x7fe24406d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe24c006b40 tx=0x7fe24c009740 comp rx=0 tx=0).stop 2023-07-11T00:00:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.218+0000 7fe25ea34700 1 -- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2581dc190 msgr2=0x7fe2581deaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.218+0000 7fe25ea34700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2581dc190 0x7fe2581deaa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe250001c00 tx=0x7fe25000ca40 comp rx=0 tx=0).stop 2023-07-11T00:00:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.219+0000 7fe25ea34700 1 -- 172.21.15.38:0/1921884920 shutdown_connections 2023-07-11T00:00:24.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.219+0000 7fe25ea34700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe24406adb0 0x7fe24406d260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.219+0000 7fe25ea34700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe258134c90 0x7fe2581433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.219+0000 7fe25ea34700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe240005320 0x7fe25813b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.219+0000 7fe25ea34700 1 --2- 172.21.15.38:0/1921884920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2581dc190 0x7fe2581deaa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.219+0000 7fe25ea34700 1 -- 172.21.15.38:0/1921884920 >> 172.21.15.38:0/1921884920 conn(0x7fe258069f30 msgr2=0x7fe25813e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:24.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.220+0000 7fe25ea34700 1 -- 172.21.15.38:0/1921884920 shutdown_connections 2023-07-11T00:00:24.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.220+0000 7fe25ea34700 1 -- 172.21.15.38:0/1921884920 wait complete. 2023-07-11T00:00:24.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.221+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/2221616963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc8dc14bde0 con 0x7fc8dc0b4670 2023-07-11T00:00:24.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.222+0000 7f534c1d9700 1 -- 172.21.15.38:0/296130413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f532c0055a0 con 0x7f534414b510 2023-07-11T00:00:24.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.223+0000 7f533a7fc700 1 -- 172.21.15.38:0/296130413 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f533c0578d0 con 0x7f534414b510 2023-07-11T00:00:24.225 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-07-11T00:00:24.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.224+0000 7f51438d5700 1 -- 172.21.15.38:0/3358600130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f513c1e7db0 con 0x7f513c0b93d0 2023-07-11T00:00:24.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.224+0000 7fc8c3fff700 1 -- 172.21.15.38:0/2221616963 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8d402a020 con 0x7fc8dc0b4670 2023-07-11T00:00:24.226 INFO:teuthology.orchestra.run.smithi038.stdout:55834574852 2023-07-11T00:00:24.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.224+0000 7f5131ffb700 1 -- 172.21.15.38:0/3358600130 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f513c1e7db0 con 0x7f513c0b93d0 2023-07-11T00:00:24.227 INFO:teuthology.orchestra.run.smithi038.stdout:55834574851 2023-07-11T00:00:24.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.225+0000 7f534c1d9700 1 -- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f533006ae90 msgr2=0x7f533006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.225+0000 7f534c1d9700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f533006ae90 0x7f533006d340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5334009a10 tx=0x7f5334009190 comp rx=0 tx=0).stop 2023-07-11T00:00:24.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.225+0000 7f534c1d9700 1 -- 172.21.15.38:0/296130413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534414b510 msgr2=0x7f53440b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.225+0000 7f534c1d9700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534414b510 0x7f53440b26e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f533c00caa0 tx=0x7f533c00cdb0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.226+0000 7f534c1d9700 1 -- 172.21.15.38:0/296130413 shutdown_connections 2023-07-11T00:00:24.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.226+0000 7f534c1d9700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f533006ae90 0x7f533006d340 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.226+0000 7f534c1d9700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f534414b510 0x7f53440b26e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.226+0000 7f534c1d9700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f534406c770 0x7f53441d6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.226+0000 7f534c1d9700 1 --2- 172.21.15.38:0/296130413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344071910 0x7f53440b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.226+0000 7f534c1d9700 1 -- 172.21.15.38:0/296130413 >> 172.21.15.38:0/296130413 conn(0x7f53440be670 msgr2=0x7f5344148830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:24.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.226+0000 7f534c1d9700 1 -- 172.21.15.38:0/296130413 shutdown_connections 2023-07-11T00:00:24.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.226+0000 7f534c1d9700 1 -- 172.21.15.38:0/296130413 wait complete. 2023-07-11T00:00:24.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.228+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc8c806ace0 msgr2=0x7fc8c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.228+0000 7fc8e1c2e700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc8c806ace0 0x7fc8c806d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0099b0 tx=0x7fc8cc008040 comp rx=0 tx=0).stop 2023-07-11T00:00:24.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.228+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/2221616963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8dc0b4670 msgr2=0x7fc8dc148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.228+0000 7fc8e1c2e700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8dc0b4670 0x7fc8dc148ed0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4012000 tx=0x7fc8d4004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.229+0000 7f51438d5700 1 -- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f512006adb0 msgr2=0x7f512006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.229+0000 7f51438d5700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f512006adb0 0x7f512006d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f513c0b11e0 tx=0x7f512c006120 comp rx=0 tx=0).stop 2023-07-11T00:00:24.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.229+0000 7f51438d5700 1 -- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c0b93d0 msgr2=0x7f513c0bcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.229+0000 7f51438d5700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c0b93d0 0x7f513c0bcba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f513800b500 tx=0x7f513800b810 comp rx=0 tx=0).stop 2023-07-11T00:00:24.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.229+0000 7f51438d5700 1 -- 172.21.15.38:0/3358600130 shutdown_connections 2023-07-11T00:00:24.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.229+0000 7f51438d5700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f512006adb0 0x7f512006d260 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f513c0b11e0 tx=0x7f512c006120 comp rx=0 tx=0).stop 2023-07-11T00:00:24.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.229+0000 7f51438d5700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f513c0b2b90 0x7f513c139540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.229+0000 7f51438d5700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f513c0b93d0 0x7f513c0bcba0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.229+0000 7f51438d5700 1 --2- 172.21.15.38:0/3358600130 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f513c146ee0 0x7f513c1e3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.229+0000 7f51438d5700 1 -- 172.21.15.38:0/3358600130 >> 172.21.15.38:0/3358600130 conn(0x7f513c069f30 msgr2=0x7f513c0b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:24.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.230+0000 7f355b7a5700 1 -- 172.21.15.38:0/2172108966 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35540716a0 con 0x7f355406aa40 2023-07-11T00:00:24.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.230+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/2221616963 shutdown_connections 2023-07-11T00:00:24.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.230+0000 7fc8e1c2e700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc8c806ace0 0x7fc8c806d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.230+0000 7fc8e1c2e700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8dc14b960 0x7fc8dc071940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.230+0000 7fc8e1c2e700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8dc0b4670 0x7fc8dc148ed0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.230+0000 7fc8e1c2e700 1 --2- 172.21.15.38:0/2221616963 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc8dc148950 0x7fc8dc1323a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.230+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/2221616963 >> 172.21.15.38:0/2221616963 conn(0x7fc8dc069f30 msgr2=0x7fc8dc150650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:24.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.230+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/2221616963 shutdown_connections 2023-07-11T00:00:24.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.230+0000 7fc8e1c2e700 1 -- 172.21.15.38:0/2221616963 wait complete. 2023-07-11T00:00:24.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.230+0000 7f3549ffb700 1 -- 172.21.15.38:0/2172108966 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f354c01a020 con 0x7f355406aa40 2023-07-11T00:00:24.239 INFO:teuthology.orchestra.run.smithi038.stdout:55834574852 2023-07-11T00:00:24.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.236+0000 7f51438d5700 1 -- 172.21.15.38:0/3358600130 shutdown_connections 2023-07-11T00:00:24.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.236+0000 7f51438d5700 1 -- 172.21.15.38:0/3358600130 wait complete. 2023-07-11T00:00:24.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.236+0000 7f355b7a5700 1 -- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f353806ad30 msgr2=0x7f353806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.236+0000 7f355b7a5700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f353806ad30 0x7f353806d1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3550009b70 tx=0x7f3550008070 comp rx=0 tx=0).stop 2023-07-11T00:00:24.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.236+0000 7f355b7a5700 1 -- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f355406aa40 msgr2=0x7f3554138e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.236+0000 7f355b7a5700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f355406aa40 0x7f3554138e20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f354c0070b0 tx=0x7f354c00d3b0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.237+0000 7f355b7a5700 1 -- 172.21.15.38:0/2172108966 shutdown_connections 2023-07-11T00:00:24.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.237+0000 7f355b7a5700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f353806ad30 0x7f353806d1e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.237+0000 7f355b7a5700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35540b93d0 0x7f3554146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.237+0000 7f355b7a5700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f355406aa40 0x7f3554138e20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.237+0000 7f355b7a5700 1 --2- 172.21.15.38:0/2172108966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35540b8700 0x7f3554146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.237+0000 7f355b7a5700 1 -- 172.21.15.38:0/2172108966 >> 172.21.15.38:0/2172108966 conn(0x7f3554069f30 msgr2=0x7f355413c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:24.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.237+0000 7f355b7a5700 1 -- 172.21.15.38:0/2172108966 shutdown_connections 2023-07-11T00:00:24.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.237+0000 7f355b7a5700 1 -- 172.21.15.38:0/2172108966 wait complete. 2023-07-11T00:00:24.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-07-11T00:00:24.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-07-11T00:00:24.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-07-11T00:00:24.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2023-07-11T00:00:24.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-07-11T00:00:24.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.255+0000 7f4bc4807700 1 -- 172.21.15.38:0/2430220914 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4ba4005870 con 0x7f4bc0147a30 2023-07-11T00:00:24.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.255+0000 7f4baeffd700 1 -- 172.21.15.38:0/2430220914 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4bb8059010 con 0x7f4bc0147a30 2023-07-11T00:00:24.257 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-07-11T00:00:24.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.257+0000 7f4bc4807700 1 -- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4ba006f1f0 msgr2=0x7f4ba00716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.257+0000 7f4bc4807700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4ba006f1f0 0x7f4ba00716a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0006fd0 tx=0x7f4bb0008040 comp rx=0 tx=0).stop 2023-07-11T00:00:24.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.257+0000 7f4bc4807700 1 -- 172.21.15.38:0/2430220914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc0147a30 msgr2=0x7f4bc013be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:24.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.257+0000 7f4bc4807700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc0147a30 0x7f4bc013be10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800b370 tx=0x7f4bb8004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.257+0000 7f4bc4807700 1 -- 172.21.15.38:0/2430220914 shutdown_connections 2023-07-11T00:00:24.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.257+0000 7f4bc4807700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4ba006f1f0 0x7f4ba00716a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.257+0000 7f4bc4807700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bc0147a30 0x7f4bc013be10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.257+0000 7f4bc4807700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc006b120 0x7f4bc01d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.257+0000 7f4bc4807700 1 --2- 172.21.15.38:0/2430220914 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bc0071b60 0x7f4bc008a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:24.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.257+0000 7f4bc4807700 1 -- 172.21.15.38:0/2430220914 >> 172.21.15.38:0/2430220914 conn(0x7f4bc00bd980 msgr2=0x7f4bc01412e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:24.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.257+0000 7f4bc4807700 1 -- 172.21.15.38:0/2430220914 shutdown_connections 2023-07-11T00:00:24.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:24.258+0000 7f4bc4807700 1 -- 172.21.15.38:0/2430220914 wait complete. 2023-07-11T00:00:24.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-07-11T00:00:25.190 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-11T00:00:25.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-11T00:00:25.244 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-11T00:00:25.247 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-11T00:00:25.251 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-11T00:00:25.255 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-11T00:00:25.256 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-11T00:00:25.272 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-11T00:00:25.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.362+0000 7f9df3712700 1 Processor -- start 2023-07-11T00:00:25.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.362+0000 7f9df3712700 1 -- start start 2023-07-11T00:00:25.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.363+0000 7f9df3712700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9dec0b4810 0x7f9dec0b8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.364+0000 7f9df3712700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9dec148e60 0x7f9dec1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.364+0000 7f9df3712700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec0b3a20 con 0x7f9dec152040 2023-07-11T00:00:25.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.364+0000 7f9df3712700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dec0b3fe0 con 0x7f9dec0b4810 2023-07-11T00:00:25.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.364+0000 7f9df3712700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec0b55d0 con 0x7f9dec148e60 2023-07-11T00:00:25.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.364+0000 7f9df1caf700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9dec148e60 0x7f9dec1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.365+0000 7f9df1caf700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9dec148e60 0x7f9dec1593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42906/0 (socket says 172.21.15.38:42906) 2023-07-11T00:00:25.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.365+0000 7f9df1caf700 1 -- 172.21.15.38:0/1424934387 learned_addr learned my addr 172.21.15.38:0/1424934387 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.365+0000 7f9df14ae700 1 --2- 172.21.15.38:0/1424934387 >> v2:172.21.15.38:3300/0 conn(0x7f9dec0b4810 0x7f9dec0b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.365+0000 7f9df14ae700 1 -- 172.21.15.38:0/1424934387 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9dec148e60 msgr2=0x7f9dec1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:25.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.365+0000 7f9df14ae700 1 --2- 172.21.15.38:0/1424934387 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9dec148e60 0x7f9dec1593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.365+0000 7f9df14ae700 1 -- 172.21.15.38:0/1424934387 >> v1:172.21.15.70:6789/0 conn(0x7f9dec152040 legacy=0x7f9dec148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:25.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.365+0000 7f9df14ae700 1 -- 172.21.15.38:0/1424934387 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec0b3d00 con 0x7f9dec0b4810 2023-07-11T00:00:25.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.366+0000 7f9df14ae700 1 --2- 172.21.15.38:0/1424934387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9dec0b4810 0x7f9dec0b8690 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009d90 tx=0x7f9de400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6e61873fd0f4d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.366+0000 7f9de3fff700 1 -- 172.21.15.38:0/1424934387 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de400e070 con 0x7f9dec0b4810 2023-07-11T00:00:25.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.366+0000 7f9de3fff700 1 -- 172.21.15.38:0/1424934387 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de400bb90 con 0x7f9dec0b4810 2023-07-11T00:00:25.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.366+0000 7f9de3fff700 1 -- 172.21.15.38:0/1424934387 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4003a20 con 0x7f9dec0b4810 2023-07-11T00:00:25.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.367+0000 7f9df3712700 1 -- 172.21.15.38:0/1424934387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9dec0b4810 msgr2=0x7f9dec0b8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.367+0000 7f9df3712700 1 --2- 172.21.15.38:0/1424934387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9dec0b4810 0x7f9dec0b8690 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009d90 tx=0x7f9de400b330 comp rx=0 tx=0).stop 2023-07-11T00:00:25.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.368+0000 7f9df3712700 1 -- 172.21.15.38:0/1424934387 shutdown_connections 2023-07-11T00:00:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.368+0000 7f9df3712700 1 --2- 172.21.15.38:0/1424934387 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9dec148e60 0x7f9dec1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.368+0000 7f9df3712700 1 --2- 172.21.15.38:0/1424934387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9dec0b4810 0x7f9dec0b8690 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.368+0000 7f9df3712700 1 -- 172.21.15.38:0/1424934387 >> 172.21.15.38:0/1424934387 conn(0x7f9dec069f30 msgr2=0x7f9dec06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.368+0000 7f9df3712700 1 -- 172.21.15.38:0/1424934387 shutdown_connections 2023-07-11T00:00:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.368+0000 7f9df3712700 1 -- 172.21.15.38:0/1424934387 wait complete. 2023-07-11T00:00:25.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.370+0000 7f9df3712700 1 Processor -- start 2023-07-11T00:00:25.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.370+0000 7f9df3712700 1 -- start start 2023-07-11T00:00:25.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.371+0000 7f9df3712700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9dec0b4810 0x7f9dec14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.371+0000 7f9df3712700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9dec148e60 0x7f9dec14e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.371+0000 7f9df3712700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec152040 0x7f9dec14d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.371+0000 7f9df3712700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec14f870 con 0x7f9dec0b4810 2023-07-11T00:00:25.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.371+0000 7f9df3712700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec14cb10 con 0x7f9dec152040 2023-07-11T00:00:25.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.371+0000 7f9df3712700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec14e6b0 con 0x7f9dec148e60 2023-07-11T00:00:25.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.372+0000 7f9df14ae700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9dec0b4810 0x7f9dec14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.372+0000 7f9df14ae700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9dec0b4810 0x7f9dec14f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53002/0 (socket says 172.21.15.38:53002) 2023-07-11T00:00:25.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.372+0000 7f9df14ae700 1 -- 172.21.15.38:0/3844121024 learned_addr learned my addr 172.21.15.38:0/3844121024 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.373+0000 7f9df0cad700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9dec148e60 0x7f9dec14e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.373+0000 7f9df1caf700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec152040 0x7f9dec14d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.373+0000 7f9df14ae700 1 -- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9dec148e60 msgr2=0x7f9dec14e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.373+0000 7f9df14ae700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9dec148e60 0x7f9dec14e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.373+0000 7f9df14ae700 1 -- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec152040 msgr2=0x7f9dec14d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.373+0000 7f9df14ae700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec152040 0x7f9dec14d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.373+0000 7f9df14ae700 1 -- 172.21.15.38:0/3844121024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de4009a70 con 0x7f9dec0b4810 2023-07-11T00:00:25.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.373+0000 7f9df14ae700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9dec0b4810 0x7f9dec14f330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9dec06e160 tx=0x7f9de4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.374+0000 7f9de1ffb700 1 -- 172.21.15.38:0/3844121024 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4025660 con 0x7f9dec0b4810 2023-07-11T00:00:25.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.374+0000 7f9de1ffb700 1 -- 172.21.15.38:0/3844121024 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de40257e0 con 0x7f9dec0b4810 2023-07-11T00:00:25.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.374+0000 7f9de1ffb700 1 -- 172.21.15.38:0/3844121024 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4025b90 con 0x7f9dec0b4810 2023-07-11T00:00:25.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.374+0000 7f9df3712700 1 -- 172.21.15.38:0/3844121024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec14c8c0 con 0x7f9dec0b4810 2023-07-11T00:00:25.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.374+0000 7f9df3712700 1 -- 172.21.15.38:0/3844121024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec14e8c0 con 0x7f9dec0b4810 2023-07-11T00:00:25.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.378+0000 7f9de1ffb700 1 -- 172.21.15.38:0/3844121024 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9de4012430 con 0x7f9dec0b4810 2023-07-11T00:00:25.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.379+0000 7f9de1ffb700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9dd006adb0 0x7f9dd006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.379+0000 7f9de1ffb700 1 -- 172.21.15.38:0/3844121024 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9de408bc70 con 0x7f9dec0b4810 2023-07-11T00:00:25.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.379+0000 7f9df3712700 1 -- 172.21.15.38:0/3844121024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc0052f0 con 0x7f9dec0b4810 2023-07-11T00:00:25.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.384+0000 7f9df0cad700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9dd006adb0 0x7f9dd006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.389+0000 7f9de1ffb700 1 -- 172.21.15.38:0/3844121024 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9de4056e40 con 0x7f9dec0b4810 2023-07-11T00:00:25.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.389+0000 7f9df0cad700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9dd006adb0 0x7f9dd006d260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0727a0 tx=0x7f9ddc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.454+0000 7f24d6247700 1 Processor -- start 2023-07-11T00:00:25.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.455+0000 7f24d6247700 1 -- start start 2023-07-11T00:00:25.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.456+0000 7f24d6247700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f24d00b4810 0x7f24d00b8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.456+0000 7f24d6247700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24d0152040 0x7f24d0148750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.456+0000 7f24d6247700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d00b3a20 con 0x7f24d0152490 2023-07-11T00:00:25.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.456+0000 7f24d6247700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d00b3fe0 con 0x7f24d00b4810 2023-07-11T00:00:25.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.456+0000 7f24d6247700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00b55d0 con 0x7f24d0152040 2023-07-11T00:00:25.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.457+0000 7f24ceffd700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24d0152040 0x7f24d0148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.457+0000 7f24cf7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f24d00b4810 0x7f24d00b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.457+0000 7f24cf7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f24d00b4810 0x7f24d00b8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53010/0 (socket says 172.21.15.38:53010) 2023-07-11T00:00:25.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.457+0000 7f24cf7fe700 1 -- 172.21.15.38:0/3994649700 learned_addr learned my addr 172.21.15.38:0/3994649700 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.458+0000 7f24cf7fe700 1 -- 172.21.15.38:0/3994649700 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24d0152040 msgr2=0x7f24d0148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:25.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.458+0000 7f24cf7fe700 1 --2- 172.21.15.38:0/3994649700 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24d0152040 0x7f24d0148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.458+0000 7f24cf7fe700 1 -- 172.21.15.38:0/3994649700 >> v1:172.21.15.38:6789/0 conn(0x7f24d0152490 legacy=0x7f24d0148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.458+0000 7f24cf7fe700 1 -- 172.21.15.38:0/3994649700 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00b3d00 con 0x7f24d00b4810 2023-07-11T00:00:25.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.458+0000 7f24cf7fe700 1 --2- 172.21.15.38:0/3994649700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24d00b4810 0x7f24d00b8690 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009920 tx=0x7f24c4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b180ea6bc73bca7c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.459+0000 7f24ce7fc700 1 -- 172.21.15.38:0/3994649700 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c400ba20 con 0x7f24d00b4810 2023-07-11T00:00:25.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.459+0000 7f24ce7fc700 1 -- 172.21.15.38:0/3994649700 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c400bb80 con 0x7f24d00b4810 2023-07-11T00:00:25.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.459+0000 7f24ce7fc700 1 -- 172.21.15.38:0/3994649700 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4009e70 con 0x7f24d00b4810 2023-07-11T00:00:25.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.460+0000 7f24d6247700 1 -- 172.21.15.38:0/3994649700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24d00b4810 msgr2=0x7f24d00b8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.460+0000 7f24d6247700 1 --2- 172.21.15.38:0/3994649700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24d00b4810 0x7f24d00b8690 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009920 tx=0x7f24c4009c30 comp rx=0 tx=0).stop 2023-07-11T00:00:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.461+0000 7f24d6247700 1 -- 172.21.15.38:0/3994649700 shutdown_connections 2023-07-11T00:00:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.461+0000 7f24d6247700 1 --2- 172.21.15.38:0/3994649700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24d00b4810 0x7f24d00b8690 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.461+0000 7f24d6247700 1 --2- 172.21.15.38:0/3994649700 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24d0152040 0x7f24d0148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.461+0000 7f24d6247700 1 -- 172.21.15.38:0/3994649700 >> 172.21.15.38:0/3994649700 conn(0x7f24d0069f30 msgr2=0x7f24d006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.461+0000 7f24d6247700 1 -- 172.21.15.38:0/3994649700 shutdown_connections 2023-07-11T00:00:25.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.461+0000 7f24d6247700 1 -- 172.21.15.38:0/3994649700 wait complete. 2023-07-11T00:00:25.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.463+0000 7f24d6247700 1 Processor -- start 2023-07-11T00:00:25.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.464+0000 7f24d6247700 1 -- start start 2023-07-11T00:00:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.464+0000 7f24d6247700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24d00b4810 0x7f24d00bb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.464+0000 7f24d6247700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24d0152040 0x7f24d013db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.464+0000 7f24d6247700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24d0152490 0x7f24d00baa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.464+0000 7f24d6247700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00bcc40 con 0x7f24d0152040 2023-07-11T00:00:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.464+0000 7f24d6247700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00bafb0 con 0x7f24d0152490 2023-07-11T00:00:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.464+0000 7f24d6247700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00bc960 con 0x7f24d00b4810 2023-07-11T00:00:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.464+0000 7f24ceffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24d0152040 0x7f24d013db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.465+0000 7f24ceffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24d0152040 0x7f24d013db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53026/0 (socket says 172.21.15.38:53026) 2023-07-11T00:00:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.465+0000 7f24ceffd700 1 -- 172.21.15.38:0/510909871 learned_addr learned my addr 172.21.15.38:0/510909871 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.465+0000 7f24ceffd700 1 -- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24d00b4810 msgr2=0x7f24d00bb9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-11T00:00:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.465+0000 7f24ceffd700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24d00b4810 0x7f24d00bb9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.465+0000 7f24ceffd700 1 -- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24d0152490 msgr2=0x7f24d00baa70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-11T00:00:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.465+0000 7f24ceffd700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24d0152490 0x7f24d00baa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.465+0000 7f24ceffd700 1 -- 172.21.15.38:0/510909871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4009550 con 0x7f24d0152040 2023-07-11T00:00:25.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.465+0000 7f24ceffd700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24d0152040 0x7f24d013db80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c7f0 tx=0x7f24c000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.466+0000 7f24b7fff700 1 -- 172.21.15.38:0/510909871 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0011800 con 0x7f24d0152040 2023-07-11T00:00:25.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.466+0000 7f24b7fff700 1 -- 172.21.15.38:0/510909871 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c0011960 con 0x7f24d0152040 2023-07-11T00:00:25.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.466+0000 7f24b7fff700 1 -- 172.21.15.38:0/510909871 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0011cf0 con 0x7f24d0152040 2023-07-11T00:00:25.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.466+0000 7f24d6247700 1 -- 172.21.15.38:0/510909871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d00bc2c0 con 0x7f24d0152040 2023-07-11T00:00:25.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.466+0000 7f24d6247700 1 -- 172.21.15.38:0/510909871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d00bbfa0 con 0x7f24d0152040 2023-07-11T00:00:25.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.468+0000 7f24b7fff700 1 -- 172.21.15.38:0/510909871 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24c0018360 con 0x7f24d0152040 2023-07-11T00:00:25.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.469+0000 7f24d6247700 1 -- 172.21.15.38:0/510909871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b00052f0 con 0x7f24d0152040 2023-07-11T00:00:25.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.470+0000 7f24b7fff700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f24b806ae70 0x7f24b806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.470+0000 7f24b7fff700 1 -- 172.21.15.38:0/510909871 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24c0089400 con 0x7f24d0152040 2023-07-11T00:00:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.471+0000 7f24cf7fe700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f24b806ae70 0x7f24b806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.471+0000 7f24cf7fe700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f24b806ae70 0x7f24b806d320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009c70 tx=0x7f24c4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.493+0000 7f24b7fff700 1 -- 172.21.15.38:0/510909871 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f24c0057ef0 con 0x7f24d0152040 2023-07-11T00:00:25.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.507+0000 7f3ccd4fc700 1 Processor -- start 2023-07-11T00:00:25.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.507+0000 7f3ccd4fc700 1 -- start start 2023-07-11T00:00:25.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.507+0000 7ff1d4332700 1 Processor -- start 2023-07-11T00:00:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.507+0000 7ff1d4332700 1 -- start start 2023-07-11T00:00:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.508+0000 7f3ccd4fc700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3cc806c5e0 0x7f3cc80b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.508+0000 7f3ccd4fc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc8149c30 con 0x7f3cc8140ad0 2023-07-11T00:00:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.508+0000 7f3ccd4fc700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc8072540 con 0x7f3cc8140680 2023-07-11T00:00:25.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.508+0000 7f3ccd4fc700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc80b5850 con 0x7f3cc806c5e0 2023-07-11T00:00:25.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.508+0000 7f6536a0c700 1 Processor -- start 2023-07-11T00:00:25.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.508+0000 7f6536a0c700 1 -- start start 2023-07-11T00:00:25.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d4332700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc0b8f40 0x7ff1cc146720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d4332700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff1cc146c60 0x7ff1cc140520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f3cc6ffd700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3cc806c5e0 0x7f3cc80b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f3cc6ffd700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3cc806c5e0 0x7f3cc80b68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42942/0 (socket says 172.21.15.38:42942) 2023-07-11T00:00:25.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f3cc6ffd700 1 -- 172.21.15.38:0/2468065161 learned_addr learned my addr 172.21.15.38:0/2468065161 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d4332700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0b8cf0 con 0x7ff1cc06c900 2023-07-11T00:00:25.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d4332700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b4b00 con 0x7ff1cc146c60 2023-07-11T00:00:25.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d4332700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc072600 con 0x7ff1cc0b8f40 2023-07-11T00:00:25.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d28cf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff1cc146c60 0x7ff1cc140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d28cf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff1cc146c60 0x7ff1cc140520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53030/0 (socket says 172.21.15.38:53030) 2023-07-11T00:00:25.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d28cf700 1 -- 172.21.15.38:0/564585568 learned_addr learned my addr 172.21.15.38:0/564585568 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d18cd700 1 --2- 172.21.15.38:0/564585568 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc0b8f40 0x7ff1cc146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f3cc6ffd700 1 -- 172.21.15.38:0/2468065161 >> v1:172.21.15.70:6789/0 conn(0x7f3cc8140680 legacy=0x7f3cc80b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f3cc6ffd700 1 -- 172.21.15.38:0/2468065161 >> v1:172.21.15.38:6789/0 conn(0x7f3cc8140ad0 legacy=0x7f3cc8150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f3cc6ffd700 1 -- 172.21.15.38:0/2468065161 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc80b3db0 con 0x7f3cc806c5e0 2023-07-11T00:00:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f6536a0c700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f653006c900 0x7f65300b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f6536a0c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65300b9380 0x7f6530140520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f6536a0c700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6530072600 con 0x7f65300b8f40 2023-07-11T00:00:25.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f6536a0c700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65300b4b00 con 0x7f653006c900 2023-07-11T00:00:25.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f6536a0c700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6530146e30 con 0x7f65300b9380 2023-07-11T00:00:25.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7f3cc6ffd700 1 --2- 172.21.15.38:0/2468065161 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3cc806c5e0 0x7f3cc80b68c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc008920 tx=0x7f3cbc00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cc774f8e284a0be server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d18cd700 1 -- 172.21.15.38:0/564585568 >> v2:172.21.15.38:3300/0 conn(0x7ff1cc146c60 msgr2=0x7ff1cc140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:25.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d18cd700 1 --2- 172.21.15.38:0/564585568 >> v2:172.21.15.38:3300/0 conn(0x7ff1cc146c60 0x7ff1cc140520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d18cd700 1 -- 172.21.15.38:0/564585568 >> v1:172.21.15.38:6789/0 conn(0x7ff1cc06c900 legacy=0x7ff1cc0b85e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:00:25.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.509+0000 7ff1d18cd700 1 -- 172.21.15.38:0/564585568 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0b3c20 con 0x7ff1cc0b8f40 2023-07-11T00:00:25.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f6534fa9700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65300b9380 0x7f6530140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f6534fa9700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65300b9380 0x7f6530140520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42952/0 (socket says 172.21.15.38:42952) 2023-07-11T00:00:25.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f6534fa9700 1 -- 172.21.15.38:0/733970751 learned_addr learned my addr 172.21.15.38:0/733970751 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f3cc5ffb700 1 -- 172.21.15.38:0/2468065161 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc010070 con 0x7f3cc806c5e0 2023-07-11T00:00:25.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f3cc5ffb700 1 -- 172.21.15.38:0/2468065161 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc00da40 con 0x7f3cc806c5e0 2023-07-11T00:00:25.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f3cc5ffb700 1 -- 172.21.15.38:0/2468065161 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc00ddd0 con 0x7f3cc806c5e0 2023-07-11T00:00:25.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7ff1d18cd700 1 --2- 172.21.15.38:0/564585568 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc0b8f40 0x7ff1cc146720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00dc60 tx=0x7ff1bc00df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa3647531a342b6e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f6534fa9700 1 -- 172.21.15.38:0/733970751 >> v2:172.21.15.70:3300/0 conn(0x7f653006c900 msgr2=0x7f65300b85e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:00:25.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f6534fa9700 1 --2- 172.21.15.38:0/733970751 >> v2:172.21.15.70:3300/0 conn(0x7f653006c900 0x7f65300b85e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f6534fa9700 1 -- 172.21.15.38:0/733970751 >> v1:172.21.15.70:6789/0 conn(0x7f65300b8f40 legacy=0x7f6530146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f6534fa9700 1 -- 172.21.15.38:0/733970751 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65300b3c20 con 0x7f65300b9380 2023-07-11T00:00:25.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f6534fa9700 1 --2- 172.21.15.38:0/733970751 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65300b9380 0x7f6530140520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6528009e80 tx=0x7f652800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3ddbe841699f78e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7ff1d10cc700 1 -- 172.21.15.38:0/564585568 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc012070 con 0x7ff1cc0b8f40 2023-07-11T00:00:25.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7ff1d10cc700 1 -- 172.21.15.38:0/564585568 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc00d2e0 con 0x7ff1cc0b8f40 2023-07-11T00:00:25.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.510+0000 7f652effd700 1 -- 172.21.15.38:0/733970751 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652800e070 con 0x7f65300b9380 2023-07-11T00:00:25.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/2468065161 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3cc806c5e0 msgr2=0x7f3cc80b68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7f3ccd4fc700 1 --2- 172.21.15.38:0/2468065161 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3cc806c5e0 0x7f3cc80b68c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc008920 tx=0x7f3cbc00d330 comp rx=0 tx=0).stop 2023-07-11T00:00:25.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7f652effd700 1 -- 172.21.15.38:0/733970751 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6528003a20 con 0x7f65300b9380 2023-07-11T00:00:25.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7f652effd700 1 -- 172.21.15.38:0/733970751 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528003db0 con 0x7f65300b9380 2023-07-11T00:00:25.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7ff1d10cc700 1 -- 172.21.15.38:0/564585568 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc004250 con 0x7ff1cc0b8f40 2023-07-11T00:00:25.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7ff1d4332700 1 -- 172.21.15.38:0/564585568 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc0b8f40 msgr2=0x7ff1cc146720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7ff1d4332700 1 --2- 172.21.15.38:0/564585568 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc0b8f40 0x7ff1cc146720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00dc60 tx=0x7ff1bc00df70 comp rx=0 tx=0).stop 2023-07-11T00:00:25.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7ff1d4332700 1 -- 172.21.15.38:0/564585568 shutdown_connections 2023-07-11T00:00:25.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7ff1d4332700 1 --2- 172.21.15.38:0/564585568 >> v2:172.21.15.38:3300/0 conn(0x7ff1cc146c60 0x7ff1cc140520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7ff1d4332700 1 --2- 172.21.15.38:0/564585568 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc0b8f40 0x7ff1cc146720 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00dc60 tx=0x7ff1bc00df70 comp rx=0 tx=0).stop 2023-07-11T00:00:25.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7ff1d4332700 1 -- 172.21.15.38:0/564585568 >> 172.21.15.38:0/564585568 conn(0x7ff1cc069f30 msgr2=0x7ff1cc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7ff1d4332700 1 -- 172.21.15.38:0/564585568 shutdown_connections 2023-07-11T00:00:25.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.511+0000 7ff1d4332700 1 -- 172.21.15.38:0/564585568 wait complete. 2023-07-11T00:00:25.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.512+0000 7f6536a0c700 1 -- 172.21.15.38:0/733970751 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65300b9380 msgr2=0x7f6530140520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.512+0000 7f6536a0c700 1 --2- 172.21.15.38:0/733970751 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65300b9380 0x7f6530140520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6528009e80 tx=0x7f652800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:25.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.512+0000 7f6536a0c700 1 -- 172.21.15.38:0/733970751 shutdown_connections 2023-07-11T00:00:25.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.512+0000 7f6536a0c700 1 --2- 172.21.15.38:0/733970751 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65300b9380 0x7f6530140520 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.512+0000 7f6536a0c700 1 --2- 172.21.15.38:0/733970751 >> v2:172.21.15.70:3300/0 conn(0x7f653006c900 0x7f65300b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.512+0000 7f6536a0c700 1 -- 172.21.15.38:0/733970751 >> 172.21.15.38:0/733970751 conn(0x7f6530069f30 msgr2=0x7f653006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.512+0000 7ff1d4332700 1 Processor -- start 2023-07-11T00:00:25.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.513+0000 7ff1d4332700 1 -- start start 2023-07-11T00:00:25.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.513+0000 7f6536a0c700 1 -- 172.21.15.38:0/733970751 shutdown_connections 2023-07-11T00:00:25.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.513+0000 7ff1d4332700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1cc06c900 0x7ff1cc0b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.513+0000 7ff1d4332700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1cc146c60 0x7ff1cc13d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.513+0000 7ff1d4332700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc13d790 0x7ff1cc13b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.513+0000 7ff1d4332700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b29f0 con 0x7ff1cc06c900 2023-07-11T00:00:25.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.513+0000 7ff1d4332700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b7620 con 0x7ff1cc146c60 2023-07-11T00:00:25.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.513+0000 7ff1d4332700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b23c0 con 0x7ff1cc13d790 2023-07-11T00:00:25.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.513+0000 7ff1d20ce700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1cc06c900 0x7ff1cc0b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.513+0000 7ff1d20ce700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1cc06c900 0x7ff1cc0b70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53044/0 (socket says 172.21.15.38:53044) 2023-07-11T00:00:25.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.513+0000 7ff1d20ce700 1 -- 172.21.15.38:0/1559220416 learned_addr learned my addr 172.21.15.38:0/1559220416 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1d28cf700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc13d790 0x7ff1cc13b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1d20ce700 1 -- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc13d790 msgr2=0x7ff1cc13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1d20ce700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc13d790 0x7ff1cc13b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1d20ce700 1 -- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1cc146c60 msgr2=0x7ff1cc13d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1d20ce700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1cc146c60 0x7ff1cc13d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1d20ce700 1 -- 172.21.15.38:0/1559220416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc00d940 con 0x7ff1cc06c900 2023-07-11T00:00:25.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1d28cf700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc13d790 0x7ff1cc13b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:25.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1d20ce700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1cc06c900 0x7ff1cc0b70e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400ba80 tx=0x7ff1c400be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1c2ffd700 1 -- 172.21.15.38:0/1559220416 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400ca50 con 0x7ff1cc06c900 2023-07-11T00:00:25.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1c2ffd700 1 -- 172.21.15.38:0/1559220416 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c400cbb0 con 0x7ff1cc06c900 2023-07-11T00:00:25.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1c2ffd700 1 -- 172.21.15.38:0/1559220416 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4014440 con 0x7ff1cc06c900 2023-07-11T00:00:25.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1d4332700 1 -- 172.21.15.38:0/1559220416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc13c690 con 0x7ff1cc06c900 2023-07-11T00:00:25.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.514+0000 7ff1d4332700 1 -- 172.21.15.38:0/1559220416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc0b2610 con 0x7ff1cc06c900 2023-07-11T00:00:25.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.517+0000 7ff1c2ffd700 1 -- 172.21.15.38:0/1559220416 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff1c40145a0 con 0x7ff1cc06c900 2023-07-11T00:00:25.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.517+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/2468065161 shutdown_connections 2023-07-11T00:00:25.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.517+0000 7f3ccd4fc700 1 --2- 172.21.15.38:0/2468065161 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3cc806c5e0 0x7f3cc80b68c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.517+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/2468065161 >> 172.21.15.38:0/2468065161 conn(0x7f3cc80bc880 msgr2=0x7f3cc80bcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.517+0000 7ff1d4332700 1 -- 172.21.15.38:0/1559220416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc074360 con 0x7ff1cc06c900 2023-07-11T00:00:25.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.517+0000 7f79478b0700 1 Processor -- start 2023-07-11T00:00:25.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.517+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/2468065161 shutdown_connections 2023-07-11T00:00:25.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.517+0000 7ff1c2ffd700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1b006ad10 0x7ff1b006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.517+0000 7ff1c2ffd700 1 -- 172.21.15.38:0/1559220416 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1c4088dd0 con 0x7ff1cc06c900 2023-07-11T00:00:25.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.518+0000 7f79478b0700 1 -- start start 2023-07-11T00:00:25.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.519+0000 7f79478b0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7940071a30 0x7f7940141780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.519+0000 7f79478b0700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f79400722c0 0x7f794014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.519+0000 7f79478b0700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7940070e70 con 0x7f79400b96b0 2023-07-11T00:00:25.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.519+0000 7f79478b0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7940141cc0 con 0x7f7940071a30 2023-07-11T00:00:25.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.519+0000 7f79478b0700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79400ba720 con 0x7f79400722c0 2023-07-11T00:00:25.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.517+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/2468065161 wait complete. 2023-07-11T00:00:25.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.519+0000 7f3ccd4fc700 1 Processor -- start 2023-07-11T00:00:25.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.519+0000 7f7945e4d700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f79400722c0 0x7f794014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.519+0000 7f7945e4d700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f79400722c0 0x7f794014ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53460/0 (socket says 172.21.15.38:53460) 2023-07-11T00:00:25.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.519+0000 7f7945e4d700 1 -- 172.21.15.38:0/2495436401 learned_addr learned my addr 172.21.15.38:0/2495436401 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f7945e4d700 1 -- 172.21.15.38:0/2495436401 >> v2:172.21.15.38:3300/0 conn(0x7f7940071a30 msgr2=0x7f7940141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:25.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f7945e4d700 1 --2- 172.21.15.38:0/2495436401 >> v2:172.21.15.38:3300/0 conn(0x7f7940071a30 0x7f7940141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f7945e4d700 1 -- 172.21.15.38:0/2495436401 >> v1:172.21.15.38:6789/0 conn(0x7f79400b96b0 legacy=0x7f79400ba010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:00:25.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f7945e4d700 1 -- 172.21.15.38:0/2495436401 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940071ea0 con 0x7f79400722c0 2023-07-11T00:00:25.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f7945e4d700 1 --2- 172.21.15.38:0/2495436401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79400722c0 0x7f794014ab20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f794006fe10 tx=0x7f793800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b8f724a5ef48d8d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.519+0000 7f3ccd4fc700 1 -- start start 2023-07-11T00:00:25.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f3ccd4fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cc806c5e0 0x7f3cc81418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f3ccd4fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cc8140680 0x7f3cc813e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f3ccd4fc700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3cc8140ad0 0x7f3cc813dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f3ccd4fc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc8142390 con 0x7f3cc806c5e0 2023-07-11T00:00:25.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f3ccd4fc700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc8144060 con 0x7f3cc8140680 2023-07-11T00:00:25.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f3ccd4fc700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc81432a0 con 0x7f3cc8140ad0 2023-07-11T00:00:25.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.521+0000 7f7937fff700 1 -- 172.21.15.38:0/2495436401 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793800e070 con 0x7f79400722c0 2023-07-11T00:00:25.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.521+0000 7f7937fff700 1 -- 172.21.15.38:0/2495436401 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7938003a20 con 0x7f79400722c0 2023-07-11T00:00:25.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.521+0000 7f7937fff700 1 -- 172.21.15.38:0/2495436401 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938003dd0 con 0x7f79400722c0 2023-07-11T00:00:25.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f79478b0700 1 -- 172.21.15.38:0/2495436401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79400722c0 msgr2=0x7f794014ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f79478b0700 1 --2- 172.21.15.38:0/2495436401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79400722c0 0x7f794014ab20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f794006fe10 tx=0x7f793800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:25.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f3cc67fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cc8140680 0x7f3cc813e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f3cc67fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cc8140680 0x7f3cc813e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53464/0 (socket says 172.21.15.38:53464) 2023-07-11T00:00:25.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f3cc67fc700 1 -- 172.21.15.38:0/3430104861 learned_addr learned my addr 172.21.15.38:0/3430104861 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f3cc6ffd700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cc806c5e0 0x7f3cc81418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f3cc67fc700 1 -- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3cc8140ad0 msgr2=0x7f3cc813dde0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-11T00:00:25.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f3cc67fc700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3cc8140ad0 0x7f3cc813dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f3cc67fc700 1 -- 172.21.15.38:0/3430104861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cc806c5e0 msgr2=0x7f3cc81418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f3cc67fc700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cc806c5e0 0x7f3cc81418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f3cc67fc700 1 -- 172.21.15.38:0/3430104861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc0085d0 con 0x7f3cc8140680 2023-07-11T00:00:25.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.518+0000 7f6536a0c700 1 -- 172.21.15.38:0/733970751 wait complete. 2023-07-11T00:00:25.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.520+0000 7f6536a0c700 1 Processor -- start 2023-07-11T00:00:25.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.521+0000 7f6536a0c700 1 -- start start 2023-07-11T00:00:25.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.521+0000 7f6536a0c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65300b8f40 0x7f65300bc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.521+0000 7f6536a0c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65300b9380 0x7f653013fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.521+0000 7f6536a0c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65301deb00 0x7f653013caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.521+0000 7f6536a0c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65300bcc50 con 0x7f65300b8f40 2023-07-11T00:00:25.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.521+0000 7f6536a0c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6530140170 con 0x7f65300b9380 2023-07-11T00:00:25.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.521+0000 7f6536a0c700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65301406a0 con 0x7f65301deb00 2023-07-11T00:00:25.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f6534fa9700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65301deb00 0x7f653013caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f6534fa9700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65301deb00 0x7f653013caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:42978/0 (socket says 172.21.15.38:42978) 2023-07-11T00:00:25.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f6534fa9700 1 -- 172.21.15.38:0/601026699 learned_addr learned my addr 172.21.15.38:0/601026699 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f652f7fe700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65300b9380 0x7f653013fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f6534fa9700 1 -- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65300b9380 msgr2=0x7f653013fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f6534fa9700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65300b9380 0x7f653013fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f6534fa9700 1 -- 172.21.15.38:0/601026699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65300b8f40 msgr2=0x7f65300bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f6534fa9700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65300b8f40 0x7f65300bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.522+0000 7f6534fa9700 1 -- 172.21.15.38:0/601026699 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528009b30 con 0x7f65301deb00 2023-07-11T00:00:25.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.523+0000 7f652f7fe700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65300b9380 0x7f653013fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:25.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.523+0000 7f3cc67fc700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cc8140680 0x7f3cc813e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c4a0 tx=0x7f3cb800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.523+0000 7ff1d18cd700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1b006ad10 0x7ff1b006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.523+0000 7f6534fa9700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65301deb00 0x7f653013caf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f652800b370 tx=0x7f6528004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.523+0000 7f652cff9700 1 -- 172.21.15.38:0/601026699 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528004240 con 0x7f65301deb00 2023-07-11T00:00:25.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.523+0000 7f652cff9700 1 -- 172.21.15.38:0/601026699 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65280043c0 con 0x7f65301deb00 2023-07-11T00:00:25.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.523+0000 7f652cff9700 1 -- 172.21.15.38:0/601026699 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528004770 con 0x7f65301deb00 2023-07-11T00:00:25.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.523+0000 7ff1d18cd700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1b006ad10 0x7ff1b006d1c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc06e340 tx=0x7ff1bc014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.524+0000 7f6536a0c700 1 -- 172.21.15.38:0/601026699 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65301df030 con 0x7f65301deb00 2023-07-11T00:00:25.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.524+0000 7f6536a0c700 1 -- 172.21.15.38:0/601026699 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653013c2f0 con 0x7f65301deb00 2023-07-11T00:00:25.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.526+0000 7f6536a0c700 1 -- 172.21.15.38:0/601026699 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65300b8a70 con 0x7f65301deb00 2023-07-11T00:00:25.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.525+0000 7f3caf7fe700 1 -- 172.21.15.38:0/3430104861 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80054e0 con 0x7f3cc8140680 2023-07-11T00:00:25.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.525+0000 7f3caf7fe700 1 -- 172.21.15.38:0/3430104861 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8003680 con 0x7f3cc8140680 2023-07-11T00:00:25.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.525+0000 7f3caf7fe700 1 -- 172.21.15.38:0/3430104861 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8003a30 con 0x7f3cc8140680 2023-07-11T00:00:25.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.526+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/3430104861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc8143580 con 0x7f3cc8140680 2023-07-11T00:00:25.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.526+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/3430104861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc8143b40 con 0x7f3cc8140680 2023-07-11T00:00:25.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.526+0000 7f79478b0700 1 -- 172.21.15.38:0/2495436401 shutdown_connections 2023-07-11T00:00:25.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.526+0000 7f79478b0700 1 --2- 172.21.15.38:0/2495436401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79400722c0 0x7f794014ab20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.526+0000 7f79478b0700 1 --2- 172.21.15.38:0/2495436401 >> v2:172.21.15.38:3300/0 conn(0x7f7940071a30 0x7f7940141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.526+0000 7f79478b0700 1 -- 172.21.15.38:0/2495436401 >> 172.21.15.38:0/2495436401 conn(0x7f794006d0e0 msgr2=0x7f794006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.527+0000 7f79478b0700 1 -- 172.21.15.38:0/2495436401 shutdown_connections 2023-07-11T00:00:25.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.527+0000 7f70f0a5f700 1 Processor -- start 2023-07-11T00:00:25.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.527+0000 7f79478b0700 1 -- 172.21.15.38:0/2495436401 wait complete. 2023-07-11T00:00:25.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.528+0000 7ff1c2ffd700 1 -- 172.21.15.38:0/1559220416 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff1c4053fc0 con 0x7ff1cc06c900 2023-07-11T00:00:25.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.527+0000 7f652cff9700 1 -- 172.21.15.38:0/601026699 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f652801d470 con 0x7f65301deb00 2023-07-11T00:00:25.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.528+0000 7f652cff9700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f651c06ad30 0x7f651c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.528+0000 7f652cff9700 1 -- 172.21.15.38:0/601026699 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f652808b3e0 con 0x7f65301deb00 2023-07-11T00:00:25.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.528+0000 7f336dba9700 1 Processor -- start 2023-07-11T00:00:25.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.527+0000 7f70f0a5f700 1 -- start start 2023-07-11T00:00:25.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.528+0000 7f70f0a5f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70e4042a30 0x7f70e4040490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70f0a5f700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f70e40409d0 0x7f70e40db1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70f0a5f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e403e070 con 0x7f70e40ca940 2023-07-11T00:00:25.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70f0a5f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e4040df0 con 0x7f70e4042a30 2023-07-11T00:00:25.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70f0a5f700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e4007940 con 0x7f70e40409d0 2023-07-11T00:00:25.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.528+0000 7f79478b0700 1 Processor -- start 2023-07-11T00:00:25.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.528+0000 7f79478b0700 1 -- start start 2023-07-11T00:00:25.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f336dba9700 1 -- start start 2023-07-11T00:00:25.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70eaffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70e4042a30 0x7f70e4040490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70eaffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70e4042a30 0x7f70e4040490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53090/0 (socket says 172.21.15.38:53090) 2023-07-11T00:00:25.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70eaffd700 1 -- 172.21.15.38:0/3701414311 learned_addr learned my addr 172.21.15.38:0/3701414311 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70ebfff700 1 --2- 172.21.15.38:0/3701414311 >> v2:172.21.15.70:3300/0 conn(0x7f70e40409d0 0x7f70e40db1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70ebfff700 1 -- 172.21.15.38:0/3701414311 >> v2:172.21.15.38:3300/0 conn(0x7f70e4042a30 msgr2=0x7f70e4040490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:25.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70ebfff700 1 --2- 172.21.15.38:0/3701414311 >> v2:172.21.15.38:3300/0 conn(0x7f70e4042a30 0x7f70e4040490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70ebfff700 1 -- 172.21.15.38:0/3701414311 >> v1:172.21.15.38:6789/0 conn(0x7f70e40ca940 legacy=0x7f70e4007230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70ebfff700 1 -- 172.21.15.38:0/3701414311 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e403ffb0 con 0x7f70e40409d0 2023-07-11T00:00:25.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f70ebfff700 1 --2- 172.21.15.38:0/3701414311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e40409d0 0x7f70e40db1f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70ec069e10 tx=0x7f70ec066c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4adff4c83f35c42 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f70ea7fc700 1 -- 172.21.15.38:0/3701414311 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec04f200 con 0x7f70e40409d0 2023-07-11T00:00:25.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f70ea7fc700 1 -- 172.21.15.38:0/3701414311 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec072260 con 0x7f70e40409d0 2023-07-11T00:00:25.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f70ea7fc700 1 -- 172.21.15.38:0/3701414311 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0725d0 con 0x7f70e40409d0 2023-07-11T00:00:25.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f79478b0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940071a30 0x7f7940144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f79478b0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79400722c0 0x7f79400b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f79478b0700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f79400b96b0 0x7f79401f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f79478b0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940144780 con 0x7f79400722c0 2023-07-11T00:00:25.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f79478b0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794013b650 con 0x7f7940071a30 2023-07-11T00:00:25.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.529+0000 7f79478b0700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79400b50d0 con 0x7f79400b96b0 2023-07-11T00:00:25.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f794564c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940071a30 0x7f7940144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f794564c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940071a30 0x7f7940144240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53490/0 (socket says 172.21.15.38:53490) 2023-07-11T00:00:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f794564c700 1 -- 172.21.15.38:0/1088833390 learned_addr learned my addr 172.21.15.38:0/1088833390 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f652ffff700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f651c06ad30 0x7f651c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f794564c700 1 -- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f79400b96b0 msgr2=0x7f79401f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f794564c700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f79400b96b0 0x7f79401f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f794564c700 1 -- 172.21.15.38:0/1088833390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79400722c0 msgr2=0x7f79400b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f794564c700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79400722c0 0x7f79400b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f794564c700 1 -- 172.21.15.38:0/1088833390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7938009b30 con 0x7f7940071a30 2023-07-11T00:00:25.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f652ffff700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f651c06ad30 0x7f651c06d1e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f653006e210 tx=0x7f6520006cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f794564c700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940071a30 0x7f7940144240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f793c00b560 tx=0x7f793c00b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f3caf7fe700 1 -- 172.21.15.38:0/3430104861 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3cb8003b90 con 0x7f3cc8140680 2023-07-11T00:00:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f3caf7fe700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3cb406adb0 0x7f3cb406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f3caf7fe700 1 -- 172.21.15.38:0/3430104861 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3cb8088970 con 0x7f3cc8140680 2023-07-11T00:00:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.530+0000 7f3cc6ffd700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3cb406adb0 0x7f3cb406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.531+0000 7f70f0a5f700 1 -- 172.21.15.38:0/3701414311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e40409d0 msgr2=0x7f70e40db1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.531+0000 7f70f0a5f700 1 --2- 172.21.15.38:0/3701414311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e40409d0 0x7f70e40db1f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70ec069e10 tx=0x7f70ec066c40 comp rx=0 tx=0).stop 2023-07-11T00:00:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.531+0000 7f3cc6ffd700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3cb406adb0 0x7f3cb406d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0088f0 tx=0x7f3cbc012000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.531+0000 7f7935ffb700 1 -- 172.21.15.38:0/1088833390 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c011830 con 0x7f7940071a30 2023-07-11T00:00:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.531+0000 7f7935ffb700 1 -- 172.21.15.38:0/1088833390 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c0119b0 con 0x7f7940071a30 2023-07-11T00:00:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.531+0000 7f7935ffb700 1 -- 172.21.15.38:0/1088833390 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c011d60 con 0x7f7940071a30 2023-07-11T00:00:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.531+0000 7f79478b0700 1 -- 172.21.15.38:0/1088833390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79400b5e60 con 0x7f7940071a30 2023-07-11T00:00:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.531+0000 7f79478b0700 1 -- 172.21.15.38:0/1088833390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79400b4cf0 con 0x7f7940071a30 2023-07-11T00:00:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.532+0000 7f79478b0700 1 -- 172.21.15.38:0/1088833390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7940074360 con 0x7f7940071a30 2023-07-11T00:00:25.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.532+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/3430104861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc8074360 con 0x7f3cc8140680 2023-07-11T00:00:25.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.532+0000 7f652cff9700 1 -- 172.21.15.38:0/601026699 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6528056580 con 0x7f65301deb00 2023-07-11T00:00:25.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.532+0000 7f70f0a5f700 1 -- 172.21.15.38:0/3701414311 shutdown_connections 2023-07-11T00:00:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.532+0000 7f70f0a5f700 1 --2- 172.21.15.38:0/3701414311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e40409d0 0x7f70e40db1f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.532+0000 7f70f0a5f700 1 --2- 172.21.15.38:0/3701414311 >> v2:172.21.15.38:3300/0 conn(0x7f70e4042a30 0x7f70e4040490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.532+0000 7f70f0a5f700 1 -- 172.21.15.38:0/3701414311 >> 172.21.15.38:0/3701414311 conn(0x7f70e4047660 msgr2=0x7f70e4043450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.533+0000 7f7935ffb700 1 -- 172.21.15.38:0/1088833390 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f793c01a400 con 0x7f7940071a30 2023-07-11T00:00:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.533+0000 7f7935ffb700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f792406ad00 0x7f792406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.534+0000 7f7935ffb700 1 -- 172.21.15.38:0/1088833390 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f793c089440 con 0x7f7940071a30 2023-07-11T00:00:25.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.534+0000 7f7944e4b700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f792406ad00 0x7f792406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.532+0000 7f70f0a5f700 1 -- 172.21.15.38:0/3701414311 shutdown_connections 2023-07-11T00:00:25.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.532+0000 7f70f0a5f700 1 -- 172.21.15.38:0/3701414311 wait complete. 2023-07-11T00:00:25.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.534+0000 7f70f0a5f700 1 Processor -- start 2023-07-11T00:00:25.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.534+0000 7f7944e4b700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f792406ad00 0x7f792406d1b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f79401488a0 tx=0x7f7930007ae0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.534+0000 7f70f0a5f700 1 -- start start 2023-07-11T00:00:25.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70f0a5f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e40409d0 0x7f70e40d3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70f0a5f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e4042a30 0x7f70e40c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70f0a5f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e40ca940 0x7f70e40c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70f0a5f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40d3660 con 0x7f70e40409d0 2023-07-11T00:00:25.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70f0a5f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40c6000 con 0x7f70e4042a30 2023-07-11T00:00:25.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70f0a5f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40be0a0 con 0x7f70e40ca940 2023-07-11T00:00:25.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70ebfff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e40ca940 0x7f70e40c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e4042a30 0x7f70e40c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70ebfff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e40ca940 0x7f70e40c2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:43000/0 (socket says 172.21.15.38:43000) 2023-07-11T00:00:25.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e4042a30 0x7f70e40c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:53500/0 (socket says 172.21.15.38:53500) 2023-07-11T00:00:25.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70ebfff700 1 -- 172.21.15.38:0/38741974 learned_addr learned my addr 172.21.15.38:0/38741974 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70ebfff700 1 -- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e4042a30 msgr2=0x7f70e40c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70ebfff700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e4042a30 0x7f70e40c1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70ebfff700 1 -- 172.21.15.38:0/38741974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e40409d0 msgr2=0x7f70e40d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70ebfff700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e40409d0 0x7f70e40d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.535+0000 7f70ebfff700 1 -- 172.21.15.38:0/38741974 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec068f60 con 0x7f70e40ca940 2023-07-11T00:00:25.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.536+0000 7f70ebfff700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e40ca940 0x7f70e40c2fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f70ec04f060 tx=0x7f70ec067d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.536+0000 7f70d7fff700 1 -- 172.21.15.38:0/38741974 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec099070 con 0x7f70e40ca940 2023-07-11T00:00:25.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.536+0000 7f70d7fff700 1 -- 172.21.15.38:0/38741974 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec065bd0 con 0x7f70e40ca940 2023-07-11T00:00:25.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.536+0000 7f70d7fff700 1 -- 172.21.15.38:0/38741974 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0670f0 con 0x7f70e40ca940 2023-07-11T00:00:25.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.536+0000 7f70f0a5f700 1 -- 172.21.15.38:0/38741974 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e40c2250 con 0x7f70e40ca940 2023-07-11T00:00:25.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.536+0000 7f70f0a5f700 1 -- 172.21.15.38:0/38741974 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e40c45e0 con 0x7f70e40ca940 2023-07-11T00:00:25.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.537+0000 7f336dba9700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336814bfa0 0x7f3368145960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.537+0000 7f336dba9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f336814c370 0x7f3368145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.537+0000 7f336dba9700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33680bad30 con 0x7f3368071080 2023-07-11T00:00:25.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.537+0000 7f336dba9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336814c900 con 0x7f336814c370 2023-07-11T00:00:25.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.537+0000 7f336dba9700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336814cbe0 con 0x7f336814bfa0 2023-07-11T00:00:25.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.537+0000 7f3367fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3368071080 0x7f3368071500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54504/0 (socket says 172.21.15.38:54504) 2023-07-11T00:00:25.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.537+0000 7f3367fff700 1 -- 172.21.15.38:0/2120457674 learned_addr learned my addr 172.21.15.38:0/2120457674 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:25.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.537+0000 7f3366ffd700 1 -- 172.21.15.38:0/2120457674 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181068279 0 0) 0x7f33680bad30 con 0x7f3368071080 2023-07-11T00:00:25.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.538+0000 7f3366ffd700 1 -- 172.21.15.38:0/2120457674 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33540035b0 con 0x7f3368071080 2023-07-11T00:00:25.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.538+0000 7f33677fe700 1 --2- 172.21.15.38:0/2120457674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336814bfa0 0x7f3368145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.538+0000 7f33677fe700 1 -- 172.21.15.38:0/2120457674 >> v2:172.21.15.38:3300/0 conn(0x7f336814c370 msgr2=0x7f3368145ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:00:25.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.538+0000 7f33677fe700 1 --2- 172.21.15.38:0/2120457674 >> v2:172.21.15.38:3300/0 conn(0x7f336814c370 0x7f3368145ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.538+0000 7f33677fe700 1 -- 172.21.15.38:0/2120457674 >> v1:172.21.15.38:6789/0 conn(0x7f3368071080 legacy=0x7f3368071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.538+0000 7f33677fe700 1 -- 172.21.15.38:0/2120457674 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33680bf4a0 con 0x7f336814bfa0 2023-07-11T00:00:25.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.538+0000 7f3caf7fe700 1 -- 172.21.15.38:0/3430104861 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3cb8053a00 con 0x7f3cc8140680 2023-07-11T00:00:25.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.538+0000 7f70f0a5f700 1 -- 172.21.15.38:0/38741974 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c80052f0 con 0x7f70e40ca940 2023-07-11T00:00:25.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.539+0000 7f70d7fff700 1 -- 172.21.15.38:0/38741974 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f70ec067250 con 0x7f70e40ca940 2023-07-11T00:00:25.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.539+0000 7f70d7fff700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70d006acb0 0x7f70d006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.539+0000 7f70d7fff700 1 -- 172.21.15.38:0/38741974 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70ec103bc0 con 0x7f70e40ca940 2023-07-11T00:00:25.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.539+0000 7f33677fe700 1 --2- 172.21.15.38:0/2120457674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336814bfa0 0x7f3368145960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3358009d90 tx=0x7f335800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88866214bb0b2f02 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.539+0000 7f70eb7fe700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70d006acb0 0x7f70d006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.540+0000 7f70eb7fe700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70d006acb0 0x7f70d006d160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f70e0000f60 tx=0x7f70e0007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.543+0000 7f7935ffb700 1 -- 172.21.15.38:0/1088833390 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f793c054560 con 0x7f7940071a30 2023-07-11T00:00:25.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.545+0000 7f3366ffd700 1 -- 172.21.15.38:0/2120457674 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335800e070 con 0x7f336814bfa0 2023-07-11T00:00:25.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.545+0000 7f3366ffd700 1 -- 172.21.15.38:0/2120457674 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335800bb20 con 0x7f336814bfa0 2023-07-11T00:00:25.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.545+0000 7f3366ffd700 1 -- 172.21.15.38:0/2120457674 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358012430 con 0x7f336814bfa0 2023-07-11T00:00:25.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.547+0000 7f70d7fff700 1 -- 172.21.15.38:0/38741974 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f70ec0ced80 con 0x7f70e40ca940 2023-07-11T00:00:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.551+0000 7f336dba9700 1 -- 172.21.15.38:0/2120457674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336814bfa0 msgr2=0x7f3368145960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.551+0000 7f336dba9700 1 --2- 172.21.15.38:0/2120457674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336814bfa0 0x7f3368145960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3358009d90 tx=0x7f335800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.552+0000 7f336dba9700 1 -- 172.21.15.38:0/2120457674 shutdown_connections 2023-07-11T00:00:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.552+0000 7f336dba9700 1 --2- 172.21.15.38:0/2120457674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336814bfa0 0x7f3368145960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.552+0000 7f336dba9700 1 --2- 172.21.15.38:0/2120457674 >> v2:172.21.15.38:3300/0 conn(0x7f336814c370 0x7f3368145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.552+0000 7f336dba9700 1 -- 172.21.15.38:0/2120457674 >> 172.21.15.38:0/2120457674 conn(0x7f33680be670 msgr2=0x7f33680bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.552+0000 7f336dba9700 1 -- 172.21.15.38:0/2120457674 shutdown_connections 2023-07-11T00:00:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.552+0000 7f336dba9700 1 -- 172.21.15.38:0/2120457674 wait complete. 2023-07-11T00:00:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.554+0000 7f336dba9700 1 Processor -- start 2023-07-11T00:00:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.554+0000 7f336dba9700 1 -- start start 2023-07-11T00:00:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.555+0000 7f336dba9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3368071080 0x7f33681409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.555+0000 7f336dba9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f336814bfa0 0x7f3368149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.555+0000 7f336dba9700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336814c370 0x7f3368148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.555+0000 7f336dba9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3368148280 con 0x7f3368071080 2023-07-11T00:00:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.555+0000 7f336dba9700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33680b5540 con 0x7f336814bfa0 2023-07-11T00:00:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.555+0000 7f336dba9700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3368148e60 con 0x7f336814c370 2023-07-11T00:00:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.556+0000 7f33677fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3368071080 0x7f33681409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.556+0000 7f33677fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3368071080 0x7f33681409c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53118/0 (socket says 172.21.15.38:53118) 2023-07-11T00:00:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.556+0000 7f33677fe700 1 -- 172.21.15.38:0/1400249940 learned_addr learned my addr 172.21.15.38:0/1400249940 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.556+0000 7f33677fe700 1 -- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336814c370 msgr2=0x7f3368148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.556+0000 7f33677fe700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336814c370 0x7f3368148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.556+0000 7f33677fe700 1 -- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f336814bfa0 msgr2=0x7f3368149230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-11T00:00:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.556+0000 7f33677fe700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f336814bfa0 0x7f3368149230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.556+0000 7f33677fe700 1 -- 172.21.15.38:0/1400249940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3358009a70 con 0x7f3368071080 2023-07-11T00:00:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.557+0000 7f33677fe700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3368071080 0x7f33681409c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f336814cd20 tx=0x7f3358004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.562+0000 7f3364ff9700 1 -- 172.21.15.38:0/1400249940 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358012430 con 0x7f3368071080 2023-07-11T00:00:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.562+0000 7f3364ff9700 1 -- 172.21.15.38:0/1400249940 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3358020070 con 0x7f3368071080 2023-07-11T00:00:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.563+0000 7f3364ff9700 1 -- 172.21.15.38:0/1400249940 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358004280 con 0x7f3368071080 2023-07-11T00:00:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.563+0000 7f336dba9700 1 -- 172.21.15.38:0/1400249940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33681466d0 con 0x7f3368071080 2023-07-11T00:00:25.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.563+0000 7f336dba9700 1 -- 172.21.15.38:0/1400249940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33680b5260 con 0x7f3368071080 2023-07-11T00:00:25.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.566+0000 7f3364ff9700 1 -- 172.21.15.38:0/1400249940 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33580043e0 con 0x7f3368071080 2023-07-11T00:00:25.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.567+0000 7f3364ff9700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f334806adb0 0x7f334806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:25.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.567+0000 7f3364ff9700 1 -- 172.21.15.38:0/1400249940 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3358022070 con 0x7f3368071080 2023-07-11T00:00:25.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.568+0000 7f335effd700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f334806adb0 0x7f334806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:25.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.568+0000 7f336dba9700 1 -- 172.21.15.38:0/1400249940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334c0052f0 con 0x7f3368071080 2023-07-11T00:00:25.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.578+0000 7f3364ff9700 1 -- 172.21.15.38:0/1400249940 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3358056770 con 0x7f3368071080 2023-07-11T00:00:25.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.600+0000 7f335effd700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f334806adb0 0x7f334806d260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3350006fd0 tx=0x7f3350006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:25.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.806+0000 7f9df3712700 1 -- 172.21.15.38:0/3844121024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9dcc0055a0 con 0x7f9dec0b4810 2023-07-11T00:00:25.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.806+0000 7f9de1ffb700 1 -- 172.21.15.38:0/3844121024 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9de4020070 con 0x7f9dec0b4810 2023-07-11T00:00:25.811 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-07-11T00:00:25.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.810+0000 7f9df3712700 1 -- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9dd006adb0 msgr2=0x7f9dd006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.810+0000 7f9df3712700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9dd006adb0 0x7f9dd006d260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0727a0 tx=0x7f9ddc009040 comp rx=0 tx=0).stop 2023-07-11T00:00:25.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.810+0000 7f9df3712700 1 -- 172.21.15.38:0/3844121024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9dec0b4810 msgr2=0x7f9dec14f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.810+0000 7f9df3712700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9dec0b4810 0x7f9dec14f330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9dec06e160 tx=0x7f9de4004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.810+0000 7f9df3712700 1 -- 172.21.15.38:0/3844121024 shutdown_connections 2023-07-11T00:00:25.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.810+0000 7f9df3712700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9dd006adb0 0x7f9dd006d260 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.810+0000 7f9df3712700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec152040 0x7f9dec14d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.810+0000 7f9df3712700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9dec0b4810 0x7f9dec14f330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.810+0000 7f9df3712700 1 --2- 172.21.15.38:0/3844121024 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9dec148e60 0x7f9dec14e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.810+0000 7f9df3712700 1 -- 172.21.15.38:0/3844121024 >> 172.21.15.38:0/3844121024 conn(0x7f9dec069f30 msgr2=0x7f9dec0b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.811+0000 7f9df3712700 1 -- 172.21.15.38:0/3844121024 shutdown_connections 2023-07-11T00:00:25.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.811+0000 7f9df3712700 1 -- 172.21.15.38:0/3844121024 wait complete. 2023-07-11T00:00:25.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-07-11T00:00:25.832 DEBUG:teuthology.parallel:result is None 2023-07-11T00:00:25.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.893+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/3430104861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3cc80baa00 con 0x7f3cc8140680 2023-07-11T00:00:25.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.893+0000 7f3caf7fe700 1 -- 172.21.15.38:0/3430104861 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cb8017020 con 0x7f3cc8140680 2023-07-11T00:00:25.896 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-07-11T00:00:25.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.895+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3cb406adb0 msgr2=0x7f3cb406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.895+0000 7f3ccd4fc700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3cb406adb0 0x7f3cb406d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0088f0 tx=0x7f3cbc012000 comp rx=0 tx=0).stop 2023-07-11T00:00:25.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.895+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cc8140680 msgr2=0x7f3cc813e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.895+0000 7f3ccd4fc700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cc8140680 0x7f3cc813e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c4a0 tx=0x7f3cb800c7b0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.896+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/3430104861 shutdown_connections 2023-07-11T00:00:25.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.896+0000 7f3ccd4fc700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3cb406adb0 0x7f3cb406d260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.896+0000 7f3ccd4fc700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3cc8140ad0 0x7f3cc813dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.896+0000 7f3ccd4fc700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cc806c5e0 0x7f3cc81418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.896+0000 7f3ccd4fc700 1 --2- 172.21.15.38:0/3430104861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cc8140680 0x7f3cc813e760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.896+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/3430104861 >> 172.21.15.38:0/3430104861 conn(0x7f3cc80bc880 msgr2=0x7f3cc81d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.899+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/3430104861 shutdown_connections 2023-07-11T00:00:25.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.899+0000 7f3ccd4fc700 1 -- 172.21.15.38:0/3430104861 wait complete. 2023-07-11T00:00:25.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.907+0000 7f24d6247700 1 -- 172.21.15.38:0/510909871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f24b00055a0 con 0x7f24d0152040 2023-07-11T00:00:25.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.908+0000 7f24b7fff700 1 -- 172.21.15.38:0/510909871 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24c0057a80 con 0x7f24d0152040 2023-07-11T00:00:25.913 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-07-11T00:00:25.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.911+0000 7f24d6247700 1 -- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f24b806ae70 msgr2=0x7f24b806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.911+0000 7f24d6247700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f24b806ae70 0x7f24b806d320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009c70 tx=0x7f24c4008030 comp rx=0 tx=0).stop 2023-07-11T00:00:25.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.911+0000 7f24d6247700 1 -- 172.21.15.38:0/510909871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24d0152040 msgr2=0x7f24d013db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.911+0000 7f24d6247700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24d0152040 0x7f24d013db80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c7f0 tx=0x7f24c000cbb0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.912+0000 7f24d6247700 1 -- 172.21.15.38:0/510909871 shutdown_connections 2023-07-11T00:00:25.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.912+0000 7f24d6247700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f24b806ae70 0x7f24b806d320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.912+0000 7f24d6247700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24d0152490 0x7f24d00baa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.912+0000 7f24d6247700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24d00b4810 0x7f24d00bb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.912+0000 7f24d6247700 1 --2- 172.21.15.38:0/510909871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24d0152040 0x7f24d013db80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.912+0000 7f24d6247700 1 -- 172.21.15.38:0/510909871 >> 172.21.15.38:0/510909871 conn(0x7f24d0069f30 msgr2=0x7f24d014be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-07-11T00:00:25.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.913+0000 7f24d6247700 1 -- 172.21.15.38:0/510909871 shutdown_connections 2023-07-11T00:00:25.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.914+0000 7f24d6247700 1 -- 172.21.15.38:0/510909871 wait complete. 2023-07-11T00:00:25.917 DEBUG:teuthology.parallel:result is None 2023-07-11T00:00:25.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-07-11T00:00:25.929 DEBUG:teuthology.parallel:result is None 2023-07-11T00:00:25.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.930+0000 7f6536a0c700 1 -- 172.21.15.38:0/601026699 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f653006d780 con 0x7f65301deb00 2023-07-11T00:00:25.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.931+0000 7f652cff9700 1 -- 172.21.15.38:0/601026699 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6528059ba0 con 0x7f65301deb00 2023-07-11T00:00:25.933 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-07-11T00:00:25.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.933+0000 7f6536a0c700 1 -- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f651c06ad30 msgr2=0x7f651c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.933+0000 7f6536a0c700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f651c06ad30 0x7f651c06d1e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f653006e210 tx=0x7f6520006cd0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.933+0000 7f6536a0c700 1 -- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65301deb00 msgr2=0x7f653013caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.933+0000 7f6536a0c700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65301deb00 0x7f653013caf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f652800b370 tx=0x7f6528004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.935+0000 7f6536a0c700 1 -- 172.21.15.38:0/601026699 shutdown_connections 2023-07-11T00:00:25.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.935+0000 7f6536a0c700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f651c06ad30 0x7f651c06d1e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.935+0000 7f6536a0c700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65301deb00 0x7f653013caf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.935+0000 7f6536a0c700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65300b8f40 0x7f65300bc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.935+0000 7f6536a0c700 1 --2- 172.21.15.38:0/601026699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65300b9380 0x7f653013fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.935+0000 7f6536a0c700 1 -- 172.21.15.38:0/601026699 >> 172.21.15.38:0/601026699 conn(0x7f6530069f30 msgr2=0x7f65300b8360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.935+0000 7f6536a0c700 1 -- 172.21.15.38:0/601026699 shutdown_connections 2023-07-11T00:00:25.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.935+0000 7f6536a0c700 1 -- 172.21.15.38:0/601026699 wait complete. 2023-07-11T00:00:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.946+0000 7f70f0a5f700 1 -- 172.21.15.38:0/38741974 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f70c80055a0 con 0x7f70e40ca940 2023-07-11T00:00:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.946+0000 7f70d7fff700 1 -- 172.21.15.38:0/38741974 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70ec08e090 con 0x7f70e40ca940 2023-07-11T00:00:25.949 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-07-11T00:00:25.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-07-11T00:00:25.951 DEBUG:teuthology.parallel:result is None 2023-07-11T00:00:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 -- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70d006acb0 msgr2=0x7f70d006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70d006acb0 0x7f70d006d160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f70e0000f60 tx=0x7f70e0007a40 comp rx=0 tx=0).stop 2023-07-11T00:00:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 -- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e40ca940 msgr2=0x7f70e40c2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e40ca940 0x7f70e40c2fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f70ec04f060 tx=0x7f70ec067d30 comp rx=0 tx=0).stop 2023-07-11T00:00:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 -- 172.21.15.38:0/38741974 shutdown_connections 2023-07-11T00:00:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f70d006acb0 0x7f70d006d160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e40ca940 0x7f70e40c2fd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70e40409d0 0x7f70e40d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 --2- 172.21.15.38:0/38741974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e4042a30 0x7f70e40c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 -- 172.21.15.38:0/38741974 >> 172.21.15.38:0/38741974 conn(0x7f70e4047660 msgr2=0x7f70e40c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 -- 172.21.15.38:0/38741974 shutdown_connections 2023-07-11T00:00:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.949+0000 7f70f0a5f700 1 -- 172.21.15.38:0/38741974 wait complete. 2023-07-11T00:00:25.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.950+0000 7ff1d4332700 1 -- 172.21.15.38:0/1559220416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff1cc1e4640 con 0x7ff1cc06c900 2023-07-11T00:00:25.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.950+0000 7ff1c2ffd700 1 -- 172.21.15.38:0/1559220416 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1c40575e0 con 0x7ff1cc06c900 2023-07-11T00:00:25.957 INFO:teuthology.orchestra.run.smithi038.stdout:55834574852 2023-07-11T00:00:25.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.951+0000 7f79478b0700 1 -- 172.21.15.38:0/1088833390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f79400b9490 con 0x7f7940071a30 2023-07-11T00:00:25.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.951+0000 7f7935ffb700 1 -- 172.21.15.38:0/1088833390 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f793c057b80 con 0x7f7940071a30 2023-07-11T00:00:25.958 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-07-11T00:00:25.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 -- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1b006ad10 msgr2=0x7ff1b006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1b006ad10 0x7ff1b006d1c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc06e340 tx=0x7ff1bc014000 comp rx=0 tx=0).stop 2023-07-11T00:00:25.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 -- 172.21.15.38:0/1559220416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1cc06c900 msgr2=0x7ff1cc0b70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1cc06c900 0x7ff1cc0b70e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400ba80 tx=0x7ff1c400be40 comp rx=0 tx=0).stop 2023-07-11T00:00:25.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 -- 172.21.15.38:0/1559220416 shutdown_connections 2023-07-11T00:00:25.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff1b006ad10 0x7ff1b006d1c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1cc13d790 0x7ff1cc13b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1cc06c900 0x7ff1cc0b70e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 --2- 172.21.15.38:0/1559220416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1cc146c60 0x7ff1cc13d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 -- 172.21.15.38:0/1559220416 >> 172.21.15.38:0/1559220416 conn(0x7ff1cc069f30 msgr2=0x7ff1cc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 -- 172.21.15.38:0/1559220416 shutdown_connections 2023-07-11T00:00:25.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.952+0000 7ff1d4332700 1 -- 172.21.15.38:0/1559220416 wait complete. 2023-07-11T00:00:25.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 -- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f792406ad00 msgr2=0x7f792406d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f792406ad00 0x7f792406d1b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f79401488a0 tx=0x7f7930007ae0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 -- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940071a30 msgr2=0x7f7940144240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940071a30 0x7f7940144240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f793c00b560 tx=0x7f793c00b920 comp rx=0 tx=0).stop 2023-07-11T00:00:25.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 -- 172.21.15.38:0/1088833390 shutdown_connections 2023-07-11T00:00:25.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f792406ad00 0x7f792406d1b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f79400b96b0 0x7f79401f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940071a30 0x7f7940144240 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 --2- 172.21.15.38:0/1088833390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79400722c0 0x7f79400b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 -- 172.21.15.38:0/1088833390 >> 172.21.15.38:0/1088833390 conn(0x7f794006d0e0 msgr2=0x7f79400b8680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 -- 172.21.15.38:0/1088833390 shutdown_connections 2023-07-11T00:00:25.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.954+0000 7f79478b0700 1 -- 172.21.15.38:0/1088833390 wait complete. 2023-07-11T00:00:25.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.955+0000 7f336dba9700 1 -- 172.21.15.38:0/1400249940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f334c0055a0 con 0x7f3368071080 2023-07-11T00:00:25.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.956+0000 7f3364ff9700 1 -- 172.21.15.38:0/1400249940 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3358059d90 con 0x7f3368071080 2023-07-11T00:00:25.964 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-07-11T00:00:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.959+0000 7f336dba9700 1 -- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f334806adb0 msgr2=0x7f334806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.959+0000 7f336dba9700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f334806adb0 0x7f334806d260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3350006fd0 tx=0x7f3350006bc0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.959+0000 7f336dba9700 1 -- 172.21.15.38:0/1400249940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3368071080 msgr2=0x7f33681409c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.959+0000 7f336dba9700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3368071080 0x7f33681409c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f336814cd20 tx=0x7f3358004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.963+0000 7f336dba9700 1 -- 172.21.15.38:0/1400249940 shutdown_connections 2023-07-11T00:00:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.963+0000 7f336dba9700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f334806adb0 0x7f334806d260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.963+0000 7f336dba9700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336814c370 0x7f3368148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.963+0000 7f336dba9700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3368071080 0x7f33681409c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.963+0000 7f336dba9700 1 --2- 172.21.15.38:0/1400249940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f336814bfa0 0x7f3368149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.963+0000 7f336dba9700 1 -- 172.21.15.38:0/1400249940 >> 172.21.15.38:0/1400249940 conn(0x7f33680be670 msgr2=0x7f3368144d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:25.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.963+0000 7f336dba9700 1 -- 172.21.15.38:0/1400249940 shutdown_connections 2023-07-11T00:00:25.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:25.963+0000 7f336dba9700 1 -- 172.21.15.38:0/1400249940 wait complete. 2023-07-11T00:00:25.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-07-11T00:00:25.968 DEBUG:teuthology.parallel:result is None 2023-07-11T00:00:25.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2023-07-11T00:00:25.971 DEBUG:teuthology.parallel:result is None 2023-07-11T00:00:25.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-07-11T00:00:25.976 DEBUG:teuthology.parallel:result is None 2023-07-11T00:00:25.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-07-11T00:00:25.981 DEBUG:teuthology.parallel:result is None 2023-07-11T00:00:25.982 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-11T00:00:25.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:00:26.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.146+0000 7f4fbf08d700 1 Processor -- start 2023-07-11T00:00:26.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.147+0000 7f4fbf08d700 1 -- start start 2023-07-11T00:00:26.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.147+0000 7f4fbf08d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fb806b120 0x7f4fb814bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.147+0000 7f4fbf08d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fb8071590 0x7f4fb814c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fbf08d700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb8071c60 con 0x7f4fb8142310 2023-07-11T00:00:26.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fbf08d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb8070fd0 con 0x7f4fb806b120 2023-07-11T00:00:26.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fbf08d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80712b0 con 0x7f4fb8071590 2023-07-11T00:00:26.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fbce29700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fb806b120 0x7f4fb814bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fbce29700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fb806b120 0x7f4fb814bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53126/0 (socket says 172.21.15.38:53126) 2023-07-11T00:00:26.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fbce29700 1 -- 172.21.15.38:0/3810364183 learned_addr learned my addr 172.21.15.38:0/3810364183 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:26.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/3810364183 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fb8071590 0x7f4fb814c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fbce29700 1 -- 172.21.15.38:0/3810364183 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fb8071590 msgr2=0x7f4fb814c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:26.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fbce29700 1 --2- 172.21.15.38:0/3810364183 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fb8071590 0x7f4fb814c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fbce29700 1 -- 172.21.15.38:0/3810364183 >> v1:172.21.15.70:6789/0 conn(0x7f4fb8142310 legacy=0x7f4fb81427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fbce29700 1 -- 172.21.15.38:0/3810364183 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb80ba240 con 0x7f4fb806b120 2023-07-11T00:00:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fbce29700 1 --2- 172.21.15.38:0/3810364183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb806b120 0x7f4fb814bc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0098f0 tx=0x7f4fac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279bf8e74374d3b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fb77fe700 1 -- 172.21.15.38:0/3810364183 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac011830 con 0x7f4fb806b120 2023-07-11T00:00:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fb77fe700 1 -- 172.21.15.38:0/3810364183 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac011990 con 0x7f4fb806b120 2023-07-11T00:00:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.148+0000 7f4fb77fe700 1 -- 172.21.15.38:0/3810364183 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac011d20 con 0x7f4fb806b120 2023-07-11T00:00:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.149+0000 7f4fbf08d700 1 -- 172.21.15.38:0/3810364183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb806b120 msgr2=0x7f4fb814bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.149+0000 7f4fbf08d700 1 --2- 172.21.15.38:0/3810364183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb806b120 0x7f4fb814bc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0098f0 tx=0x7f4fac009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.149+0000 7f4fbf08d700 1 -- 172.21.15.38:0/3810364183 shutdown_connections 2023-07-11T00:00:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.149+0000 7f4fbf08d700 1 --2- 172.21.15.38:0/3810364183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb806b120 0x7f4fb814bc90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.149+0000 7f4fbf08d700 1 --2- 172.21.15.38:0/3810364183 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fb8071590 0x7f4fb814c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.149+0000 7f4fbf08d700 1 -- 172.21.15.38:0/3810364183 >> 172.21.15.38:0/3810364183 conn(0x7f4fb80bd980 msgr2=0x7f4fb80b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.149+0000 7f4fbf08d700 1 -- 172.21.15.38:0/3810364183 shutdown_connections 2023-07-11T00:00:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.149+0000 7f4fbf08d700 1 -- 172.21.15.38:0/3810364183 wait complete. 2023-07-11T00:00:26.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.150+0000 7f4fbf08d700 1 Processor -- start 2023-07-11T00:00:26.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.150+0000 7f4fbf08d700 1 -- start start 2023-07-11T00:00:26.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fbf08d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb806b120 0x7f4fb8070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fbf08d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8071590 0x7f4fb80b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fbf08d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fb8142310 0x7f4fb80b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fbf08d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80707a0 con 0x7f4fb8071590 2023-07-11T00:00:26.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fbf08d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb806f380 con 0x7f4fb806b120 2023-07-11T00:00:26.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fbf08d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb806fe30 con 0x7f4fb8142310 2023-07-11T00:00:26.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fb7fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8071590 0x7f4fb80b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fb7fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8071590 0x7f4fb80b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53136/0 (socket says 172.21.15.38:53136) 2023-07-11T00:00:26.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fb7fff700 1 -- 172.21.15.38:0/4100219704 learned_addr learned my addr 172.21.15.38:0/4100219704 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:26.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fbd62a700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fb8142310 0x7f4fb80b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fbce29700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb806b120 0x7f4fb8070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fb7fff700 1 -- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fb8142310 msgr2=0x7f4fb80b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fb8142310 0x7f4fb80b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fb7fff700 1 -- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb806b120 msgr2=0x7f4fb8070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb806b120 0x7f4fb8070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fb7fff700 1 -- 172.21.15.38:0/4100219704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac009550 con 0x7f4fb8071590 2023-07-11T00:00:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.151+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8071590 0x7f4fb80b5180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400e980 tx=0x7f4fa400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.152+0000 7f4fb57fa700 1 -- 172.21.15.38:0/4100219704 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4009710 con 0x7f4fb8071590 2023-07-11T00:00:26.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.152+0000 7f4fb57fa700 1 -- 172.21.15.38:0/4100219704 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa400c690 con 0x7f4fb8071590 2023-07-11T00:00:26.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.152+0000 7f4fbf08d700 1 -- 172.21.15.38:0/4100219704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb80b6570 con 0x7f4fb8071590 2023-07-11T00:00:26.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.152+0000 7f4fb57fa700 1 -- 172.21.15.38:0/4100219704 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa400ca40 con 0x7f4fb8071590 2023-07-11T00:00:26.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.152+0000 7f4fbf08d700 1 -- 172.21.15.38:0/4100219704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb806f590 con 0x7f4fb8071590 2023-07-11T00:00:26.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.153+0000 7f4fbf08d700 1 -- 172.21.15.38:0/4100219704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb80b4fd0 con 0x7f4fb8071590 2023-07-11T00:00:26.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.153+0000 7f4fb57fa700 1 -- 172.21.15.38:0/4100219704 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4fa400cba0 con 0x7f4fb8071590 2023-07-11T00:00:26.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.154+0000 7f4fb57fa700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4f9c06ace0 0x7f4f9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.154+0000 7f4fb57fa700 1 -- 172.21.15.38:0/4100219704 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4fa4089850 con 0x7f4fb8071590 2023-07-11T00:00:26.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.154+0000 7f4fbce29700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4f9c06ace0 0x7f4f9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.154+0000 7f4fbce29700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4f9c06ace0 0x7f4f9c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009c40 tx=0x7f4fac008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:26.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.158+0000 7f4fb57fa700 1 -- 172.21.15.38:0/4100219704 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4fa4054950 con 0x7f4fb8071590 2023-07-11T00:00:26.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.348+0000 7f4fbf08d700 1 -- 172.21.15.38:0/4100219704 --> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fb80ba520 con 0x7f4f9c06ace0 2023-07-11T00:00:26.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.357+0000 7f4fb57fa700 1 -- 172.21.15.38:0/4100219704 <== mgr.4105 v2:172.21.15.70:6832/2073477499 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286881 (secure 0 0 0) 0x7f4fac011c00 con 0x7f4f9c06ace0 2023-07-11T00:00:26.362 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 -- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4f9c06ace0 msgr2=0x7f4f9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4f9c06ace0 0x7f4f9c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009c40 tx=0x7f4fac008030 comp rx=0 tx=0).stop 2023-07-11T00:00:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 -- 172.21.15.38:0/4100219704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8071590 msgr2=0x7f4fb80b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8071590 0x7f4fb80b5180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400e980 tx=0x7f4fa400ec90 comp rx=0 tx=0).stop 2023-07-11T00:00:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 -- 172.21.15.38:0/4100219704 shutdown_connections 2023-07-11T00:00:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4f9c06ace0 0x7f4f9c06d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fb8142310 0x7f4fb80b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb806b120 0x7f4fb8070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 --2- 172.21.15.38:0/4100219704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8071590 0x7f4fb80b5180 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 -- 172.21.15.38:0/4100219704 >> 172.21.15.38:0/4100219704 conn(0x7f4fb80bd980 msgr2=0x7f4fb81d2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:26.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 -- 172.21.15.38:0/4100219704 shutdown_connections 2023-07-11T00:00:26.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.360+0000 7f4fbf08d700 1 -- 172.21.15.38:0/4100219704 wait complete. 2023-07-11T00:00:26.366 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-07-11T00:00:26.374 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-07-11T00:00:25.951531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2990080,"data_stored":1818252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.580963"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008537+0000","last_change":"2023-07-11T00:00:17.397708+0000","last_active":"2023-07-11T00:00:19.008537+0000","last_peered":"2023-07-11T00:00:19.008537+0000","last_clean":"2023-07-11T00:00:19.008537+0000","last_became_active":"2023-07-11T00:00:17.397420+0000","last_became_peered":"2023-07-11T00:00:17.397420+0000","last_unstale":"2023-07-11T00:00:19.008537+0000","last_undegraded":"2023-07-11T00:00:19.008537+0000","last_fullsized":"2023-07-11T00:00:19.008537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:36:59.464113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373811+0000","last_change":"2023-07-11T00:00:17.397645+0000","last_active":"2023-07-11T00:00:18.373811+0000","last_peered":"2023-07-11T00:00:18.373811+0000","last_clean":"2023-07-11T00:00:18.373811+0000","last_became_active":"2023-07-11T00:00:17.397379+0000","last_became_peered":"2023-07-11T00:00:17.397379+0000","last_unstale":"2023-07-11T00:00:18.373811+0000","last_undegraded":"2023-07-11T00:00:18.373811+0000","last_fullsized":"2023-07-11T00:00:18.373811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009115+0000","last_change":"2023-07-11T00:00:17.383242+0000","last_active":"2023-07-11T00:00:19.009115+0000","last_peered":"2023-07-11T00:00:19.009115+0000","last_clean":"2023-07-11T00:00:19.009115+0000","last_became_active":"2023-07-11T00:00:17.382949+0000","last_became_peered":"2023-07-11T00:00:17.382949+0000","last_unstale":"2023-07-11T00:00:19.009115+0000","last_undegraded":"2023-07-11T00:00:19.009115+0000","last_fullsized":"2023-07-11T00:00:19.009115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:03.546582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374355+0000","last_change":"2023-07-11T00:00:17.382742+0000","last_active":"2023-07-11T00:00:18.374355+0000","last_peered":"2023-07-11T00:00:18.374355+0000","last_clean":"2023-07-11T00:00:18.374355+0000","last_became_active":"2023-07-11T00:00:17.382485+0000","last_became_peered":"2023-07-11T00:00:17.382485+0000","last_unstale":"2023-07-11T00:00:18.374355+0000","last_undegraded":"2023-07-11T00:00:18.374355+0000","last_fullsized":"2023-07-11T00:00:18.374355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:10:20.060069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506405+0000","last_change":"2023-07-11T00:00:17.397047+0000","last_active":"2023-07-11T00:00:18.506405+0000","last_peered":"2023-07-11T00:00:18.506405+0000","last_clean":"2023-07-11T00:00:18.506405+0000","last_became_active":"2023-07-11T00:00:17.396780+0000","last_became_peered":"2023-07-11T00:00:17.396780+0000","last_unstale":"2023-07-11T00:00:18.506405+0000","last_undegraded":"2023-07-11T00:00:18.506405+0000","last_fullsized":"2023-07-11T00:00:18.506405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:49.980328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007933+0000","last_change":"2023-07-11T00:00:17.383091+0000","last_active":"2023-07-11T00:00:19.007933+0000","last_peered":"2023-07-11T00:00:19.007933+0000","last_clean":"2023-07-11T00:00:19.007933+0000","last_became_active":"2023-07-11T00:00:17.382732+0000","last_became_peered":"2023-07-11T00:00:17.382732+0000","last_unstale":"2023-07-11T00:00:19.007933+0000","last_undegraded":"2023-07-11T00:00:19.007933+0000","last_fullsized":"2023-07-11T00:00:19.007933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007960+0000","last_change":"2023-07-11T00:00:17.398152+0000","last_active":"2023-07-11T00:00:19.007960+0000","last_peered":"2023-07-11T00:00:19.007960+0000","last_clean":"2023-07-11T00:00:19.007960+0000","last_became_active":"2023-07-11T00:00:17.397866+0000","last_became_peered":"2023-07-11T00:00:17.397866+0000","last_unstale":"2023-07-11T00:00:19.007960+0000","last_undegraded":"2023-07-11T00:00:19.007960+0000","last_fullsized":"2023-07-11T00:00:19.007960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:45.858410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373410+0000","last_change":"2023-07-11T00:00:17.388247+0000","last_active":"2023-07-11T00:00:18.373410+0000","last_peered":"2023-07-11T00:00:18.373410+0000","last_clean":"2023-07-11T00:00:18.373410+0000","last_became_active":"2023-07-11T00:00:17.387971+0000","last_became_peered":"2023-07-11T00:00:17.387971+0000","last_unstale":"2023-07-11T00:00:18.373410+0000","last_undegraded":"2023-07-11T00:00:18.373410+0000","last_fullsized":"2023-07-11T00:00:18.373410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:49.980328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506791+0000","last_change":"2023-07-11T00:00:17.399917+0000","last_active":"2023-07-11T00:00:18.506791+0000","last_peered":"2023-07-11T00:00:18.506791+0000","last_clean":"2023-07-11T00:00:18.506791+0000","last_became_active":"2023-07-11T00:00:17.399650+0000","last_became_peered":"2023-07-11T00:00:17.399650+0000","last_unstale":"2023-07-11T00:00:18.506791+0000","last_undegraded":"2023-07-11T00:00:18.506791+0000","last_fullsized":"2023-07-11T00:00:18.506791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:16.918740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374155+0000","last_change":"2023-07-11T00:00:17.391372+0000","last_active":"2023-07-11T00:00:18.374155+0000","last_peered":"2023-07-11T00:00:18.374155+0000","last_clean":"2023-07-11T00:00:18.374155+0000","last_became_active":"2023-07-11T00:00:17.391073+0000","last_became_peered":"2023-07-11T00:00:17.391073+0000","last_unstale":"2023-07-11T00:00:18.374155+0000","last_undegraded":"2023-07-11T00:00:18.374155+0000","last_fullsized":"2023-07-11T00:00:18.374155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:57.519021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009402+0000","last_change":"2023-07-11T00:00:17.386526+0000","last_active":"2023-07-11T00:00:19.009402+0000","last_peered":"2023-07-11T00:00:19.009402+0000","last_clean":"2023-07-11T00:00:19.009402+0000","last_became_active":"2023-07-11T00:00:17.386224+0000","last_became_peered":"2023-07-11T00:00:17.386224+0000","last_unstale":"2023-07-11T00:00:19.009402+0000","last_undegraded":"2023-07-11T00:00:19.009402+0000","last_fullsized":"2023-07-11T00:00:19.009402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:33.551132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008039+0000","last_change":"2023-07-11T00:00:17.391880+0000","last_active":"2023-07-11T00:00:19.008039+0000","last_peered":"2023-07-11T00:00:19.008039+0000","last_clean":"2023-07-11T00:00:19.008039+0000","last_became_active":"2023-07-11T00:00:17.391579+0000","last_became_peered":"2023-07-11T00:00:17.391579+0000","last_unstale":"2023-07-11T00:00:19.008039+0000","last_undegraded":"2023-07-11T00:00:19.008039+0000","last_fullsized":"2023-07-11T00:00:19.008039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:36.282927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008235+0000","last_change":"2023-07-11T00:00:17.395824+0000","last_active":"2023-07-11T00:00:19.008235+0000","last_peered":"2023-07-11T00:00:19.008235+0000","last_clean":"2023-07-11T00:00:19.008235+0000","last_became_active":"2023-07-11T00:00:17.395540+0000","last_became_peered":"2023-07-11T00:00:17.395540+0000","last_unstale":"2023-07-11T00:00:19.008235+0000","last_undegraded":"2023-07-11T00:00:19.008235+0000","last_fullsized":"2023-07-11T00:00:19.008235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:12:34.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373653+0000","last_change":"2023-07-11T00:00:17.392402+0000","last_active":"2023-07-11T00:00:18.373653+0000","last_peered":"2023-07-11T00:00:18.373653+0000","last_clean":"2023-07-11T00:00:18.373653+0000","last_became_active":"2023-07-11T00:00:17.392138+0000","last_became_peered":"2023-07-11T00:00:17.392138+0000","last_unstale":"2023-07-11T00:00:18.373653+0000","last_undegraded":"2023-07-11T00:00:18.373653+0000","last_fullsized":"2023-07-11T00:00:18.373653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008481+0000","last_change":"2023-07-11T00:00:17.398211+0000","last_active":"2023-07-11T00:00:19.008481+0000","last_peered":"2023-07-11T00:00:19.008481+0000","last_clean":"2023-07-11T00:00:19.008481+0000","last_became_active":"2023-07-11T00:00:17.397884+0000","last_became_peered":"2023-07-11T00:00:17.397884+0000","last_unstale":"2023-07-11T00:00:19.008481+0000","last_undegraded":"2023-07-11T00:00:19.008481+0000","last_fullsized":"2023-07-11T00:00:19.008481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:18:53.735358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008071+0000","last_change":"2023-07-11T00:00:17.383250+0000","last_active":"2023-07-11T00:00:19.008071+0000","last_peered":"2023-07-11T00:00:19.008071+0000","last_clean":"2023-07-11T00:00:19.008071+0000","last_became_active":"2023-07-11T00:00:17.382988+0000","last_became_peered":"2023-07-11T00:00:17.382988+0000","last_unstale":"2023-07-11T00:00:19.008071+0000","last_undegraded":"2023-07-11T00:00:19.008071+0000","last_fullsized":"2023-07-11T00:00:19.008071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:40.051389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506790+0000","last_change":"2023-07-11T00:00:17.395710+0000","last_active":"2023-07-11T00:00:18.506790+0000","last_peered":"2023-07-11T00:00:18.506790+0000","last_clean":"2023-07-11T00:00:18.506790+0000","last_became_active":"2023-07-11T00:00:17.395425+0000","last_became_peered":"2023-07-11T00:00:17.395425+0000","last_unstale":"2023-07-11T00:00:18.506790+0000","last_undegraded":"2023-07-11T00:00:18.506790+0000","last_fullsized":"2023-07-11T00:00:18.506790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:40.051389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009267+0000","last_change":"2023-07-11T00:00:17.392947+0000","last_active":"2023-07-11T00:00:19.009267+0000","last_peered":"2023-07-11T00:00:19.009267+0000","last_clean":"2023-07-11T00:00:19.009267+0000","last_became_active":"2023-07-11T00:00:17.392696+0000","last_became_peered":"2023-07-11T00:00:17.392696+0000","last_unstale":"2023-07-11T00:00:19.009267+0000","last_undegraded":"2023-07-11T00:00:19.009267+0000","last_fullsized":"2023-07-11T00:00:19.009267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:51:54.640593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008178+0000","last_change":"2023-07-11T00:00:17.399163+0000","last_active":"2023-07-11T00:00:19.008178+0000","last_peered":"2023-07-11T00:00:19.008178+0000","last_clean":"2023-07-11T00:00:19.008178+0000","last_became_active":"2023-07-11T00:00:17.398876+0000","last_became_peered":"2023-07-11T00:00:17.398876+0000","last_unstale":"2023-07-11T00:00:19.008178+0000","last_undegraded":"2023-07-11T00:00:19.008178+0000","last_fullsized":"2023-07-11T00:00:19.008178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:40:09.287884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009140+0000","last_change":"2023-07-11T00:00:17.385145+0000","last_active":"2023-07-11T00:00:19.009140+0000","last_peered":"2023-07-11T00:00:19.009140+0000","last_clean":"2023-07-11T00:00:19.009140+0000","last_became_active":"2023-07-11T00:00:17.384889+0000","last_became_peered":"2023-07-11T00:00:17.384889+0000","last_unstale":"2023-07-11T00:00:19.009140+0000","last_undegraded":"2023-07-11T00:00:19.009140+0000","last_fullsized":"2023-07-11T00:00:19.009140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:49.096105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008620+0000","last_change":"2023-07-11T00:00:17.396464+0000","last_active":"2023-07-11T00:00:19.008620+0000","last_peered":"2023-07-11T00:00:19.008620+0000","last_clean":"2023-07-11T00:00:19.008620+0000","last_became_active":"2023-07-11T00:00:17.396157+0000","last_became_peered":"2023-07-11T00:00:17.396157+0000","last_unstale":"2023-07-11T00:00:19.008620+0000","last_undegraded":"2023-07-11T00:00:19.008620+0000","last_fullsized":"2023-07-11T00:00:19.008620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:56:38.988691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506379+0000","last_change":"2023-07-11T00:00:17.400807+0000","last_active":"2023-07-11T00:00:18.506379+0000","last_peered":"2023-07-11T00:00:18.506379+0000","last_clean":"2023-07-11T00:00:18.506379+0000","last_became_active":"2023-07-11T00:00:17.400518+0000","last_became_peered":"2023-07-11T00:00:17.400518+0000","last_unstale":"2023-07-11T00:00:18.506379+0000","last_undegraded":"2023-07-11T00:00:18.506379+0000","last_fullsized":"2023-07-11T00:00:18.506379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:26.253992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007811+0000","last_change":"2023-07-11T00:00:17.393536+0000","last_active":"2023-07-11T00:00:19.007811+0000","last_peered":"2023-07-11T00:00:19.007811+0000","last_clean":"2023-07-11T00:00:19.007811+0000","last_became_active":"2023-07-11T00:00:17.393218+0000","last_became_peered":"2023-07-11T00:00:17.393218+0000","last_unstale":"2023-07-11T00:00:19.007811+0000","last_undegraded":"2023-07-11T00:00:19.007811+0000","last_fullsized":"2023-07-11T00:00:19.007811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008065+0000","last_change":"2023-07-11T00:00:17.394760+0000","last_active":"2023-07-11T00:00:19.008065+0000","last_peered":"2023-07-11T00:00:19.008065+0000","last_clean":"2023-07-11T00:00:19.008065+0000","last_became_active":"2023-07-11T00:00:17.394413+0000","last_became_peered":"2023-07-11T00:00:17.394413+0000","last_unstale":"2023-07-11T00:00:19.008065+0000","last_undegraded":"2023-07-11T00:00:19.008065+0000","last_fullsized":"2023-07-11T00:00:19.008065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373353+0000","last_change":"2023-07-11T00:00:17.392669+0000","last_active":"2023-07-11T00:00:18.373353+0000","last_peered":"2023-07-11T00:00:18.373353+0000","last_clean":"2023-07-11T00:00:18.373353+0000","last_became_active":"2023-07-11T00:00:17.392196+0000","last_became_peered":"2023-07-11T00:00:17.392196+0000","last_unstale":"2023-07-11T00:00:18.373353+0000","last_undegraded":"2023-07-11T00:00:18.373353+0000","last_fullsized":"2023-07-11T00:00:18.373353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373327+0000","last_change":"2023-07-11T00:00:17.393336+0000","last_active":"2023-07-11T00:00:18.373327+0000","last_peered":"2023-07-11T00:00:18.373327+0000","last_clean":"2023-07-11T00:00:18.373327+0000","last_became_active":"2023-07-11T00:00:17.393012+0000","last_became_peered":"2023-07-11T00:00:17.393012+0000","last_unstale":"2023-07-11T00:00:18.373327+0000","last_undegraded":"2023-07-11T00:00:18.373327+0000","last_fullsized":"2023-07-11T00:00:18.373327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373803+0000","last_change":"2023-07-11T00:00:17.391606+0000","last_active":"2023-07-11T00:00:18.373803+0000","last_peered":"2023-07-11T00:00:18.373803+0000","last_clean":"2023-07-11T00:00:18.373803+0000","last_became_active":"2023-07-11T00:00:17.391040+0000","last_became_peered":"2023-07-11T00:00:17.391040+0000","last_unstale":"2023-07-11T00:00:18.373803+0000","last_undegraded":"2023-07-11T00:00:18.373803+0000","last_fullsized":"2023-07-11T00:00:18.373803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008846+0000","last_change":"2023-07-11T00:00:16.382120+0000","last_active":"2023-07-11T00:00:19.008846+0000","last_peered":"2023-07-11T00:00:19.008846+0000","last_clean":"2023-07-11T00:00:19.008846+0000","last_became_active":"2023-07-11T00:00:16.381850+0000","last_became_peered":"2023-07-11T00:00:16.381850+0000","last_unstale":"2023-07-11T00:00:19.008846+0000","last_undegraded":"2023-07-11T00:00:19.008846+0000","last_fullsized":"2023-07-11T00:00:19.008846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:56.513606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008521+0000","last_change":"2023-07-11T00:00:17.399984+0000","last_active":"2023-07-11T00:00:19.008521+0000","last_peered":"2023-07-11T00:00:19.008521+0000","last_clean":"2023-07-11T00:00:19.008521+0000","last_became_active":"2023-07-11T00:00:17.399791+0000","last_became_peered":"2023-07-11T00:00:17.399791+0000","last_unstale":"2023-07-11T00:00:19.008521+0000","last_undegraded":"2023-07-11T00:00:19.008521+0000","last_fullsized":"2023-07-11T00:00:19.008521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372863+0000","last_change":"2023-07-11T00:00:16.386771+0000","last_active":"2023-07-11T00:00:18.372863+0000","last_peered":"2023-07-11T00:00:18.372863+0000","last_clean":"2023-07-11T00:00:18.372863+0000","last_became_active":"2023-07-11T00:00:16.386510+0000","last_became_peered":"2023-07-11T00:00:16.386510+0000","last_unstale":"2023-07-11T00:00:18.372863+0000","last_undegraded":"2023-07-11T00:00:18.372863+0000","last_fullsized":"2023-07-11T00:00:18.372863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:04:26.155667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506805+0000","last_change":"2023-07-11T00:00:17.382846+0000","last_active":"2023-07-11T00:00:18.506805+0000","last_peered":"2023-07-11T00:00:18.506805+0000","last_clean":"2023-07-11T00:00:18.506805+0000","last_became_active":"2023-07-11T00:00:17.382575+0000","last_became_peered":"2023-07-11T00:00:17.382575+0000","last_unstale":"2023-07-11T00:00:18.506805+0000","last_undegraded":"2023-07-11T00:00:18.506805+0000","last_fullsized":"2023-07-11T00:00:18.506805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:29.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008088+0000","last_change":"2023-07-11T00:00:16.385044+0000","last_active":"2023-07-11T00:00:19.008088+0000","last_peered":"2023-07-11T00:00:19.008088+0000","last_clean":"2023-07-11T00:00:19.008088+0000","last_became_active":"2023-07-11T00:00:16.384163+0000","last_became_peered":"2023-07-11T00:00:16.384163+0000","last_unstale":"2023-07-11T00:00:19.008088+0000","last_undegraded":"2023-07-11T00:00:19.008088+0000","last_fullsized":"2023-07-11T00:00:19.008088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:39.045974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374477+0000","last_change":"2023-07-11T00:00:17.386852+0000","last_active":"2023-07-11T00:00:18.374477+0000","last_peered":"2023-07-11T00:00:18.374477+0000","last_clean":"2023-07-11T00:00:18.374477+0000","last_became_active":"2023-07-11T00:00:17.386559+0000","last_became_peered":"2023-07-11T00:00:17.386559+0000","last_unstale":"2023-07-11T00:00:18.374477+0000","last_undegraded":"2023-07-11T00:00:18.374477+0000","last_fullsized":"2023-07-11T00:00:18.374477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:17.746982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506933+0000","last_change":"2023-07-11T00:00:16.386985+0000","last_active":"2023-07-11T00:00:18.506933+0000","last_peered":"2023-07-11T00:00:18.506933+0000","last_clean":"2023-07-11T00:00:18.506933+0000","last_became_active":"2023-07-11T00:00:16.386092+0000","last_became_peered":"2023-07-11T00:00:16.386092+0000","last_unstale":"2023-07-11T00:00:18.506933+0000","last_undegraded":"2023-07-11T00:00:18.506933+0000","last_fullsized":"2023-07-11T00:00:18.506933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:56.513606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007916+0000","last_change":"2023-07-11T00:00:17.400026+0000","last_active":"2023-07-11T00:00:19.007916+0000","last_peered":"2023-07-11T00:00:19.007916+0000","last_clean":"2023-07-11T00:00:19.007916+0000","last_became_active":"2023-07-11T00:00:17.399293+0000","last_became_peered":"2023-07-11T00:00:17.399293+0000","last_unstale":"2023-07-11T00:00:19.007916+0000","last_undegraded":"2023-07-11T00:00:19.007916+0000","last_fullsized":"2023-07-11T00:00:19.007916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374001+0000","last_change":"2023-07-11T00:00:16.384101+0000","last_active":"2023-07-11T00:00:18.374001+0000","last_peered":"2023-07-11T00:00:18.374001+0000","last_clean":"2023-07-11T00:00:18.374001+0000","last_became_active":"2023-07-11T00:00:16.383818+0000","last_became_peered":"2023-07-11T00:00:16.383818+0000","last_unstale":"2023-07-11T00:00:18.374001+0000","last_undegraded":"2023-07-11T00:00:18.374001+0000","last_fullsized":"2023-07-11T00:00:18.374001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:28.418665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008115+0000","last_change":"2023-07-11T00:00:17.389712+0000","last_active":"2023-07-11T00:00:19.008115+0000","last_peered":"2023-07-11T00:00:19.008115+0000","last_clean":"2023-07-11T00:00:19.008115+0000","last_became_active":"2023-07-11T00:00:17.389347+0000","last_became_peered":"2023-07-11T00:00:17.389347+0000","last_unstale":"2023-07-11T00:00:19.008115+0000","last_undegraded":"2023-07-11T00:00:19.008115+0000","last_fullsized":"2023-07-11T00:00:19.008115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:29.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008467+0000","last_change":"2023-07-11T00:00:16.389670+0000","last_active":"2023-07-11T00:00:19.008467+0000","last_peered":"2023-07-11T00:00:19.008467+0000","last_clean":"2023-07-11T00:00:19.008467+0000","last_became_active":"2023-07-11T00:00:16.389452+0000","last_became_peered":"2023-07-11T00:00:16.389452+0000","last_unstale":"2023-07-11T00:00:19.008467+0000","last_undegraded":"2023-07-11T00:00:19.008467+0000","last_fullsized":"2023-07-11T00:00:19.008467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:51:53.635178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372965+0000","last_change":"2023-07-11T00:00:17.395904+0000","last_active":"2023-07-11T00:00:18.372965+0000","last_peered":"2023-07-11T00:00:18.372965+0000","last_clean":"2023-07-11T00:00:18.372965+0000","last_became_active":"2023-07-11T00:00:17.392236+0000","last_became_peered":"2023-07-11T00:00:17.392236+0000","last_unstale":"2023-07-11T00:00:18.372965+0000","last_undegraded":"2023-07-11T00:00:18.372965+0000","last_fullsized":"2023-07-11T00:00:18.372965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:12:05.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009431+0000","last_change":"2023-07-11T00:00:16.382024+0000","last_active":"2023-07-11T00:00:19.009431+0000","last_peered":"2023-07-11T00:00:19.009431+0000","last_clean":"2023-07-11T00:00:19.009431+0000","last_became_active":"2023-07-11T00:00:16.380867+0000","last_became_peered":"2023-07-11T00:00:16.380867+0000","last_unstale":"2023-07-11T00:00:19.009431+0000","last_undegraded":"2023-07-11T00:00:19.009431+0000","last_fullsized":"2023-07-11T00:00:19.009431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:56:37.983275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009263+0000","last_change":"2023-07-11T00:00:17.378560+0000","last_active":"2023-07-11T00:00:19.009263+0000","last_peered":"2023-07-11T00:00:19.009263+0000","last_clean":"2023-07-11T00:00:19.009263+0000","last_became_active":"2023-07-11T00:00:17.378254+0000","last_became_peered":"2023-07-11T00:00:17.378254+0000","last_unstale":"2023-07-11T00:00:19.009263+0000","last_undegraded":"2023-07-11T00:00:19.009263+0000","last_fullsized":"2023-07-11T00:00:19.009263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:23.254269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008429+0000","last_change":"2023-07-11T00:00:16.384078+0000","last_active":"2023-07-11T00:00:19.008429+0000","last_peered":"2023-07-11T00:00:19.008429+0000","last_clean":"2023-07-11T00:00:19.008429+0000","last_became_active":"2023-07-11T00:00:16.383846+0000","last_became_peered":"2023-07-11T00:00:16.383846+0000","last_unstale":"2023-07-11T00:00:19.008429+0000","last_undegraded":"2023-07-11T00:00:19.008429+0000","last_fullsized":"2023-07-11T00:00:19.008429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:22.248854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008163+0000","last_change":"2023-07-11T00:00:17.399815+0000","last_active":"2023-07-11T00:00:19.008163+0000","last_peered":"2023-07-11T00:00:19.008163+0000","last_clean":"2023-07-11T00:00:19.008163+0000","last_became_active":"2023-07-11T00:00:17.399521+0000","last_became_peered":"2023-07-11T00:00:17.399521+0000","last_unstale":"2023-07-11T00:00:19.008163+0000","last_undegraded":"2023-07-11T00:00:19.008163+0000","last_fullsized":"2023-07-11T00:00:19.008163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:05.297107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506521+0000","last_change":"2023-07-11T00:00:16.380652+0000","last_active":"2023-07-11T00:00:18.506521+0000","last_peered":"2023-07-11T00:00:18.506521+0000","last_clean":"2023-07-11T00:00:18.506521+0000","last_became_active":"2023-07-11T00:00:16.380380+0000","last_became_peered":"2023-07-11T00:00:16.380380+0000","last_unstale":"2023-07-11T00:00:18.506521+0000","last_undegraded":"2023-07-11T00:00:18.506521+0000","last_fullsized":"2023-07-11T00:00:18.506521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:06.207909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373844+0000","last_change":"2023-07-11T00:00:17.390008+0000","last_active":"2023-07-11T00:00:18.373844+0000","last_peered":"2023-07-11T00:00:18.373844+0000","last_clean":"2023-07-11T00:00:18.373844+0000","last_became_active":"2023-07-11T00:00:17.389740+0000","last_became_peered":"2023-07-11T00:00:17.389740+0000","last_unstale":"2023-07-11T00:00:18.373844+0000","last_undegraded":"2023-07-11T00:00:18.373844+0000","last_fullsized":"2023-07-11T00:00:18.373844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008147+0000","last_change":"2023-07-11T00:00:16.383128+0000","last_active":"2023-07-11T00:00:19.008147+0000","last_peered":"2023-07-11T00:00:19.008147+0000","last_clean":"2023-07-11T00:00:19.008147+0000","last_became_active":"2023-07-11T00:00:16.382870+0000","last_became_peered":"2023-07-11T00:00:16.382870+0000","last_unstale":"2023-07-11T00:00:19.008147+0000","last_undegraded":"2023-07-11T00:00:19.008147+0000","last_fullsized":"2023-07-11T00:00:19.008147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:02.541167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506680+0000","last_change":"2023-07-11T00:00:17.394408+0000","last_active":"2023-07-11T00:00:18.506680+0000","last_peered":"2023-07-11T00:00:18.506680+0000","last_clean":"2023-07-11T00:00:18.506680+0000","last_became_active":"2023-07-11T00:00:17.394079+0000","last_became_peered":"2023-07-11T00:00:17.394079+0000","last_unstale":"2023-07-11T00:00:18.506680+0000","last_undegraded":"2023-07-11T00:00:18.506680+0000","last_fullsized":"2023-07-11T00:00:18.506680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373459+0000","last_change":"2023-07-11T00:00:16.380308+0000","last_active":"2023-07-11T00:00:18.373459+0000","last_peered":"2023-07-11T00:00:18.373459+0000","last_clean":"2023-07-11T00:00:18.373459+0000","last_became_active":"2023-07-11T00:00:16.380036+0000","last_became_peered":"2023-07-11T00:00:16.380036+0000","last_unstale":"2023-07-11T00:00:18.373459+0000","last_undegraded":"2023-07-11T00:00:18.373459+0000","last_fullsized":"2023-07-11T00:00:18.373459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:57:14.865203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008874+0000","last_change":"2023-07-11T00:00:17.396665+0000","last_active":"2023-07-11T00:00:19.008874+0000","last_peered":"2023-07-11T00:00:19.008874+0000","last_clean":"2023-07-11T00:00:19.008874+0000","last_became_active":"2023-07-11T00:00:17.396049+0000","last_became_peered":"2023-07-11T00:00:17.396049+0000","last_unstale":"2023-07-11T00:00:19.008874+0000","last_undegraded":"2023-07-11T00:00:19.008874+0000","last_fullsized":"2023-07-11T00:00:19.008874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:23.254269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008597+0000","last_change":"2023-07-11T00:00:16.382403+0000","last_active":"2023-07-11T00:00:19.008597+0000","last_peered":"2023-07-11T00:00:19.008597+0000","last_clean":"2023-07-11T00:00:19.008597+0000","last_became_active":"2023-07-11T00:00:16.382062+0000","last_became_peered":"2023-07-11T00:00:16.382062+0000","last_unstale":"2023-07-11T00:00:19.008597+0000","last_undegraded":"2023-07-11T00:00:19.008597+0000","last_fullsized":"2023-07-11T00:00:19.008597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:17:20.832645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373662+0000","last_change":"2023-07-11T00:00:17.384147+0000","last_active":"2023-07-11T00:00:18.373662+0000","last_peered":"2023-07-11T00:00:18.373662+0000","last_clean":"2023-07-11T00:00:18.373662+0000","last_became_active":"2023-07-11T00:00:17.383896+0000","last_became_peered":"2023-07-11T00:00:17.383896+0000","last_unstale":"2023-07-11T00:00:18.373662+0000","last_undegraded":"2023-07-11T00:00:18.373662+0000","last_fullsized":"2023-07-11T00:00:18.373662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008430+0000","last_change":"2023-07-11T00:00:16.384123+0000","last_active":"2023-07-11T00:00:19.008430+0000","last_peered":"2023-07-11T00:00:19.008430+0000","last_clean":"2023-07-11T00:00:19.008430+0000","last_became_active":"2023-07-11T00:00:16.383832+0000","last_became_peered":"2023-07-11T00:00:16.383832+0000","last_unstale":"2023-07-11T00:00:19.008430+0000","last_undegraded":"2023-07-11T00:00:19.008430+0000","last_fullsized":"2023-07-11T00:00:19.008430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:34:19.684185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008056+0000","last_change":"2023-07-11T00:00:17.387530+0000","last_active":"2023-07-11T00:00:19.008056+0000","last_peered":"2023-07-11T00:00:19.008056+0000","last_clean":"2023-07-11T00:00:19.008056+0000","last_became_active":"2023-07-11T00:00:17.387105+0000","last_became_peered":"2023-07-11T00:00:17.387105+0000","last_unstale":"2023-07-11T00:00:19.008056+0000","last_undegraded":"2023-07-11T00:00:19.008056+0000","last_fullsized":"2023-07-11T00:00:19.008056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008383+0000","last_change":"2023-07-11T00:00:16.385068+0000","last_active":"2023-07-11T00:00:19.008383+0000","last_peered":"2023-07-11T00:00:19.008383+0000","last_clean":"2023-07-11T00:00:19.008383+0000","last_became_active":"2023-07-11T00:00:16.384772+0000","last_became_peered":"2023-07-11T00:00:16.384772+0000","last_unstale":"2023-07-11T00:00:19.008383+0000","last_undegraded":"2023-07-11T00:00:19.008383+0000","last_fullsized":"2023-07-11T00:00:19.008383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:32.545716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374548+0000","last_change":"2023-07-11T00:00:17.383412+0000","last_active":"2023-07-11T00:00:18.374548+0000","last_peered":"2023-07-11T00:00:18.374548+0000","last_clean":"2023-07-11T00:00:18.374548+0000","last_became_active":"2023-07-11T00:00:17.383162+0000","last_became_peered":"2023-07-11T00:00:17.383162+0000","last_unstale":"2023-07-11T00:00:18.374548+0000","last_undegraded":"2023-07-11T00:00:18.374548+0000","last_fullsized":"2023-07-11T00:00:18.374548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373928+0000","last_change":"2023-07-11T00:00:16.386464+0000","last_active":"2023-07-11T00:00:18.373928+0000","last_peered":"2023-07-11T00:00:18.373928+0000","last_clean":"2023-07-11T00:00:18.373928+0000","last_became_active":"2023-07-11T00:00:16.385972+0000","last_became_peered":"2023-07-11T00:00:16.385972+0000","last_unstale":"2023-07-11T00:00:18.373928+0000","last_undegraded":"2023-07-11T00:00:18.373928+0000","last_fullsized":"2023-07-11T00:00:18.373928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:39.045974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506589+0000","last_change":"2023-07-11T00:00:17.397631+0000","last_active":"2023-07-11T00:00:18.506589+0000","last_peered":"2023-07-11T00:00:18.506589+0000","last_clean":"2023-07-11T00:00:18.506589+0000","last_became_active":"2023-07-11T00:00:17.397331+0000","last_became_peered":"2023-07-11T00:00:17.397331+0000","last_unstale":"2023-07-11T00:00:18.506589+0000","last_undegraded":"2023-07-11T00:00:18.506589+0000","last_fullsized":"2023-07-11T00:00:18.506589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008780+0000","last_change":"2023-07-11T00:00:16.385414+0000","last_active":"2023-07-11T00:00:19.008780+0000","last_peered":"2023-07-11T00:00:19.008780+0000","last_clean":"2023-07-11T00:00:19.008780+0000","last_became_active":"2023-07-11T00:00:16.385078+0000","last_became_peered":"2023-07-11T00:00:16.385078+0000","last_unstale":"2023-07-11T00:00:19.008780+0000","last_undegraded":"2023-07-11T00:00:19.008780+0000","last_fullsized":"2023-07-11T00:00:19.008780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:48.090690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009326+0000","last_change":"2023-07-11T00:00:17.394701+0000","last_active":"2023-07-11T00:00:19.009326+0000","last_peered":"2023-07-11T00:00:19.009326+0000","last_clean":"2023-07-11T00:00:19.009326+0000","last_became_active":"2023-07-11T00:00:17.394427+0000","last_became_peered":"2023-07-11T00:00:17.394427+0000","last_unstale":"2023-07-11T00:00:19.009326+0000","last_undegraded":"2023-07-11T00:00:19.009326+0000","last_fullsized":"2023-07-11T00:00:19.009326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:18:53.735358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374476+0000","last_change":"2023-07-11T00:00:16.379119+0000","last_active":"2023-07-11T00:00:18.374476+0000","last_peered":"2023-07-11T00:00:18.374476+0000","last_clean":"2023-07-11T00:00:18.374476+0000","last_became_active":"2023-07-11T00:00:16.378596+0000","last_became_peered":"2023-07-11T00:00:16.378596+0000","last_unstale":"2023-07-11T00:00:18.374476+0000","last_undegraded":"2023-07-11T00:00:18.374476+0000","last_fullsized":"2023-07-11T00:00:18.374476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:48.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009450+0000","last_change":"2023-07-11T00:00:17.392798+0000","last_active":"2023-07-11T00:00:19.009450+0000","last_peered":"2023-07-11T00:00:19.009450+0000","last_clean":"2023-07-11T00:00:19.009450+0000","last_became_active":"2023-07-11T00:00:17.392534+0000","last_became_peered":"2023-07-11T00:00:17.392534+0000","last_unstale":"2023-07-11T00:00:19.009450+0000","last_undegraded":"2023-07-11T00:00:19.009450+0000","last_fullsized":"2023-07-11T00:00:19.009450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:18.979975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008294+0000","last_change":"2023-07-11T00:00:16.381752+0000","last_active":"2023-07-11T00:00:19.008294+0000","last_peered":"2023-07-11T00:00:19.008294+0000","last_clean":"2023-07-11T00:00:19.008294+0000","last_became_active":"2023-07-11T00:00:16.381446+0000","last_became_peered":"2023-07-11T00:00:16.381446+0000","last_unstale":"2023-07-11T00:00:19.008294+0000","last_undegraded":"2023-07-11T00:00:19.008294+0000","last_fullsized":"2023-07-11T00:00:19.008294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:28.418665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009436+0000","last_change":"2023-07-11T00:00:17.381280+0000","last_active":"2023-07-11T00:00:19.009436+0000","last_peered":"2023-07-11T00:00:19.009436+0000","last_clean":"2023-07-11T00:00:19.009436+0000","last_became_active":"2023-07-11T00:00:17.380991+0000","last_became_peered":"2023-07-11T00:00:17.380991+0000","last_unstale":"2023-07-11T00:00:19.009436+0000","last_undegraded":"2023-07-11T00:00:19.009436+0000","last_fullsized":"2023-07-11T00:00:19.009436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:17:21.838060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008404+0000","last_change":"2023-07-11T00:00:16.385241+0000","last_active":"2023-07-11T00:00:19.008404+0000","last_peered":"2023-07-11T00:00:19.008404+0000","last_clean":"2023-07-11T00:00:19.008404+0000","last_became_active":"2023-07-11T00:00:16.384948+0000","last_became_peered":"2023-07-11T00:00:16.384948+0000","last_unstale":"2023-07-11T00:00:19.008404+0000","last_undegraded":"2023-07-11T00:00:19.008404+0000","last_fullsized":"2023-07-11T00:00:19.008404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:44.852995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373444+0000","last_change":"2023-07-11T00:00:17.394512+0000","last_active":"2023-07-11T00:00:18.373444+0000","last_peered":"2023-07-11T00:00:18.373444+0000","last_clean":"2023-07-11T00:00:18.373444+0000","last_became_active":"2023-07-11T00:00:17.394195+0000","last_became_peered":"2023-07-11T00:00:17.394195+0000","last_unstale":"2023-07-11T00:00:18.373444+0000","last_undegraded":"2023-07-11T00:00:18.373444+0000","last_fullsized":"2023-07-11T00:00:18.373444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008794+0000","last_change":"2023-07-11T00:00:16.385203+0000","last_active":"2023-07-11T00:00:19.008794+0000","last_peered":"2023-07-11T00:00:19.008794+0000","last_clean":"2023-07-11T00:00:19.008794+0000","last_became_active":"2023-07-11T00:00:16.384926+0000","last_became_peered":"2023-07-11T00:00:16.384926+0000","last_unstale":"2023-07-11T00:00:19.008794+0000","last_undegraded":"2023-07-11T00:00:19.008794+0000","last_fullsized":"2023-07-11T00:00:19.008794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:02.541167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009209+0000","last_change":"2023-07-11T00:00:11.737777+0000","last_active":"2023-07-11T00:00:19.009209+0000","last_peered":"2023-07-11T00:00:19.009209+0000","last_clean":"2023-07-11T00:00:19.009209+0000","last_became_active":"2023-07-11T00:00:11.737518+0000","last_became_peered":"2023-07-11T00:00:11.737518+0000","last_unstale":"2023-07-11T00:00:19.009209+0000","last_undegraded":"2023-07-11T00:00:19.009209+0000","last_fullsized":"2023-07-11T00:00:19.009209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:34:14.575826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007733+0000","last_change":"2023-07-11T00:00:17.392911+0000","last_active":"2023-07-11T00:00:19.007733+0000","last_peered":"2023-07-11T00:00:19.007733+0000","last_clean":"2023-07-11T00:00:19.007733+0000","last_became_active":"2023-07-11T00:00:17.392614+0000","last_became_peered":"2023-07-11T00:00:17.392614+0000","last_unstale":"2023-07-11T00:00:19.007733+0000","last_undegraded":"2023-07-11T00:00:19.007733+0000","last_fullsized":"2023-07-11T00:00:19.007733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008255+0000","last_change":"2023-07-11T00:00:11.270609+0000","last_active":"2023-07-11T00:00:19.008255+0000","last_peered":"2023-07-11T00:00:19.008255+0000","last_clean":"2023-07-11T00:00:19.008255+0000","last_became_active":"2023-07-11T00:00:11.270289+0000","last_became_peered":"2023-07-11T00:00:11.270289+0000","last_unstale":"2023-07-11T00:00:19.008255+0000","last_undegraded":"2023-07-11T00:00:19.008255+0000","last_fullsized":"2023-07-11T00:00:19.008255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:51.405247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.024738+0000","last_change":"2023-07-11T00:00:16.381972+0000","last_active":"2023-07-11T00:00:19.024738+0000","last_peered":"2023-07-11T00:00:19.024738+0000","last_clean":"2023-07-11T00:00:19.024738+0000","last_became_active":"2023-07-11T00:00:16.381691+0000","last_became_peered":"2023-07-11T00:00:16.381691+0000","last_unstale":"2023-07-11T00:00:19.024738+0000","last_undegraded":"2023-07-11T00:00:19.024738+0000","last_fullsized":"2023-07-11T00:00:19.024738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:04.291692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008189+0000","last_change":"2023-07-11T00:00:17.380382+0000","last_active":"2023-07-11T00:00:19.008189+0000","last_peered":"2023-07-11T00:00:19.008189+0000","last_clean":"2023-07-11T00:00:19.008189+0000","last_became_active":"2023-07-11T00:00:17.380071+0000","last_became_peered":"2023-07-11T00:00:17.380071+0000","last_unstale":"2023-07-11T00:00:19.008189+0000","last_undegraded":"2023-07-11T00:00:19.008189+0000","last_fullsized":"2023-07-11T00:00:19.008189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:16.918740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372829+0000","last_change":"2023-07-11T00:00:11.269546+0000","last_active":"2023-07-11T00:00:18.372829+0000","last_peered":"2023-07-11T00:00:18.372829+0000","last_clean":"2023-07-11T00:00:18.372829+0000","last_became_active":"2023-07-11T00:00:11.269178+0000","last_became_peered":"2023-07-11T00:00:11.269178+0000","last_unstale":"2023-07-11T00:00:18.372829+0000","last_undegraded":"2023-07-11T00:00:18.372829+0000","last_fullsized":"2023-07-11T00:00:18.372829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:43.866553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008074+0000","last_change":"2023-07-11T00:00:11.270402+0000","last_active":"2023-07-11T00:00:19.008074+0000","last_peered":"2023-07-11T00:00:19.008074+0000","last_clean":"2023-07-11T00:00:19.008074+0000","last_became_active":"2023-07-11T00:00:11.270024+0000","last_became_peered":"2023-07-11T00:00:11.270024+0000","last_unstale":"2023-07-11T00:00:19.008074+0000","last_undegraded":"2023-07-11T00:00:19.008074+0000","last_fullsized":"2023-07-11T00:00:19.008074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:44.333198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506429+0000","last_change":"2023-07-11T00:00:16.384464+0000","last_active":"2023-07-11T00:00:18.506429+0000","last_peered":"2023-07-11T00:00:18.506429+0000","last_clean":"2023-07-11T00:00:18.506429+0000","last_became_active":"2023-07-11T00:00:16.384194+0000","last_became_peered":"2023-07-11T00:00:16.384194+0000","last_unstale":"2023-07-11T00:00:18.506429+0000","last_undegraded":"2023-07-11T00:00:18.506429+0000","last_fullsized":"2023-07-11T00:00:18.506429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:16.741566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506745+0000","last_change":"2023-07-11T00:00:17.398420+0000","last_active":"2023-07-11T00:00:18.506745+0000","last_peered":"2023-07-11T00:00:18.506745+0000","last_clean":"2023-07-11T00:00:18.506745+0000","last_became_active":"2023-07-11T00:00:17.398014+0000","last_became_peered":"2023-07-11T00:00:17.398014+0000","last_unstale":"2023-07-11T00:00:18.506745+0000","last_undegraded":"2023-07-11T00:00:18.506745+0000","last_fullsized":"2023-07-11T00:00:18.506745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008280+0000","last_change":"2023-07-11T00:00:11.518743+0000","last_active":"2023-07-11T00:00:19.008280+0000","last_peered":"2023-07-11T00:00:19.008280+0000","last_clean":"2023-07-11T00:00:19.008280+0000","last_became_active":"2023-07-11T00:00:11.518395+0000","last_became_peered":"2023-07-11T00:00:11.518395+0000","last_unstale":"2023-07-11T00:00:19.008280+0000","last_undegraded":"2023-07-11T00:00:19.008280+0000","last_fullsized":"2023-07-11T00:00:19.008280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:42.982331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372725+0000","last_change":"2023-07-11T00:00:16.379506+0000","last_active":"2023-07-11T00:00:18.372725+0000","last_peered":"2023-07-11T00:00:18.372725+0000","last_clean":"2023-07-11T00:00:18.372725+0000","last_became_active":"2023-07-11T00:00:16.379263+0000","last_became_peered":"2023-07-11T00:00:16.379263+0000","last_unstale":"2023-07-11T00:00:18.372725+0000","last_undegraded":"2023-07-11T00:00:18.372725+0000","last_fullsized":"2023-07-11T00:00:18.372725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:43:40.599156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373432+0000","last_change":"2023-07-11T00:00:17.387290+0000","last_active":"2023-07-11T00:00:18.373432+0000","last_peered":"2023-07-11T00:00:18.373432+0000","last_clean":"2023-07-11T00:00:18.373432+0000","last_became_active":"2023-07-11T00:00:17.386701+0000","last_became_peered":"2023-07-11T00:00:17.386701+0000","last_unstale":"2023-07-11T00:00:18.373432+0000","last_undegraded":"2023-07-11T00:00:18.373432+0000","last_fullsized":"2023-07-11T00:00:18.373432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007892+0000","last_change":"2023-07-11T00:00:11.518875+0000","last_active":"2023-07-11T00:00:19.007892+0000","last_peered":"2023-07-11T00:00:19.007892+0000","last_clean":"2023-07-11T00:00:19.007892+0000","last_became_active":"2023-07-11T00:00:11.518595+0000","last_became_peered":"2023-07-11T00:00:11.518595+0000","last_unstale":"2023-07-11T00:00:19.007892+0000","last_undegraded":"2023-07-11T00:00:19.007892+0000","last_fullsized":"2023-07-11T00:00:19.007892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:51.405247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008089+0000","last_change":"2023-07-11T00:00:16.384893+0000","last_active":"2023-07-11T00:00:19.008089+0000","last_peered":"2023-07-11T00:00:19.008089+0000","last_clean":"2023-07-11T00:00:19.008089+0000","last_became_active":"2023-07-11T00:00:16.384614+0000","last_became_peered":"2023-07-11T00:00:16.384614+0000","last_unstale":"2023-07-11T00:00:19.008089+0000","last_undegraded":"2023-07-11T00:00:19.008089+0000","last_fullsized":"2023-07-11T00:00:19.008089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:15.913324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374261+0000","last_change":"2023-07-11T00:00:17.381906+0000","last_active":"2023-07-11T00:00:18.374261+0000","last_peered":"2023-07-11T00:00:18.374261+0000","last_clean":"2023-07-11T00:00:18.374261+0000","last_became_active":"2023-07-11T00:00:17.381630+0000","last_became_peered":"2023-07-11T00:00:17.381630+0000","last_unstale":"2023-07-11T00:00:18.374261+0000","last_undegraded":"2023-07-11T00:00:18.374261+0000","last_fullsized":"2023-07-11T00:00:18.374261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:12:05.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373405+0000","last_change":"2023-07-11T00:00:11.518769+0000","last_active":"2023-07-11T00:00:18.373405+0000","last_peered":"2023-07-11T00:00:18.373405+0000","last_clean":"2023-07-11T00:00:18.373405+0000","last_became_active":"2023-07-11T00:00:11.518440+0000","last_became_peered":"2023-07-11T00:00:11.518440+0000","last_unstale":"2023-07-11T00:00:18.373405+0000","last_undegraded":"2023-07-11T00:00:18.373405+0000","last_fullsized":"2023-07-11T00:00:18.373405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:11.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009013+0000","last_change":"2023-07-11T00:00:16.384509+0000","last_active":"2023-07-11T00:00:19.009013+0000","last_peered":"2023-07-11T00:00:19.009013+0000","last_clean":"2023-07-11T00:00:19.009013+0000","last_became_active":"2023-07-11T00:00:16.384064+0000","last_became_peered":"2023-07-11T00:00:16.384064+0000","last_unstale":"2023-07-11T00:00:19.009013+0000","last_undegraded":"2023-07-11T00:00:19.009013+0000","last_fullsized":"2023-07-11T00:00:19.009013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:49.441556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373265+0000","last_change":"2023-07-11T00:00:17.393714+0000","last_active":"2023-07-11T00:00:18.373265+0000","last_peered":"2023-07-11T00:00:18.373265+0000","last_clean":"2023-07-11T00:00:18.373265+0000","last_became_active":"2023-07-11T00:00:17.392964+0000","last_became_peered":"2023-07-11T00:00:17.392964+0000","last_unstale":"2023-07-11T00:00:18.373265+0000","last_undegraded":"2023-07-11T00:00:18.373265+0000","last_fullsized":"2023-07-11T00:00:18.373265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:17.746982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374578+0000","last_change":"2023-07-11T00:00:11.518696+0000","last_active":"2023-07-11T00:00:18.374578+0000","last_peered":"2023-07-11T00:00:18.374578+0000","last_clean":"2023-07-11T00:00:18.374578+0000","last_became_active":"2023-07-11T00:00:11.518413+0000","last_became_peered":"2023-07-11T00:00:11.518413+0000","last_unstale":"2023-07-11T00:00:18.374578+0000","last_undegraded":"2023-07-11T00:00:18.374578+0000","last_fullsized":"2023-07-11T00:00:18.374578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:01.099550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373125+0000","last_change":"2023-07-11T00:00:16.379703+0000","last_active":"2023-07-11T00:00:18.373125+0000","last_peered":"2023-07-11T00:00:18.373125+0000","last_clean":"2023-07-11T00:00:18.373125+0000","last_became_active":"2023-07-11T00:00:16.379251+0000","last_became_peered":"2023-07-11T00:00:16.379251+0000","last_unstale":"2023-07-11T00:00:18.373125+0000","last_undegraded":"2023-07-11T00:00:18.373125+0000","last_fullsized":"2023-07-11T00:00:18.373125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:25.248576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506437+0000","last_change":"2023-07-11T00:00:17.390220+0000","last_active":"2023-07-11T00:00:18.506437+0000","last_peered":"2023-07-11T00:00:18.506437+0000","last_clean":"2023-07-11T00:00:18.506437+0000","last_became_active":"2023-07-11T00:00:17.389938+0000","last_became_peered":"2023-07-11T00:00:17.389938+0000","last_unstale":"2023-07-11T00:00:18.506437+0000","last_undegraded":"2023-07-11T00:00:18.506437+0000","last_fullsized":"2023-07-11T00:00:18.506437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374335+0000","last_change":"2023-07-11T00:00:11.269674+0000","last_active":"2023-07-11T00:00:18.374335+0000","last_peered":"2023-07-11T00:00:18.374335+0000","last_clean":"2023-07-11T00:00:18.374335+0000","last_became_active":"2023-07-11T00:00:11.269355+0000","last_became_peered":"2023-07-11T00:00:11.269355+0000","last_unstale":"2023-07-11T00:00:18.374335+0000","last_undegraded":"2023-07-11T00:00:18.374335+0000","last_fullsized":"2023-07-11T00:00:18.374335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:20.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373947+0000","last_change":"2023-07-11T00:00:16.386828+0000","last_active":"2023-07-11T00:00:18.373947+0000","last_peered":"2023-07-11T00:00:18.373947+0000","last_clean":"2023-07-11T00:00:18.373947+0000","last_became_active":"2023-07-11T00:00:16.386586+0000","last_became_peered":"2023-07-11T00:00:16.386586+0000","last_unstale":"2023-07-11T00:00:18.373947+0000","last_undegraded":"2023-07-11T00:00:18.373947+0000","last_fullsized":"2023-07-11T00:00:18.373947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:15.913324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372814+0000","last_change":"2023-07-11T00:00:17.393914+0000","last_active":"2023-07-11T00:00:18.372814+0000","last_peered":"2023-07-11T00:00:18.372814+0000","last_clean":"2023-07-11T00:00:18.372814+0000","last_became_active":"2023-07-11T00:00:17.392216+0000","last_became_peered":"2023-07-11T00:00:17.392216+0000","last_unstale":"2023-07-11T00:00:18.372814+0000","last_undegraded":"2023-07-11T00:00:18.372814+0000","last_fullsized":"2023-07-11T00:00:18.372814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:57:15.870619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506667+0000","last_change":"2023-07-11T00:00:16.383581+0000","last_active":"2023-07-11T00:00:18.506667+0000","last_peered":"2023-07-11T00:00:18.506667+0000","last_clean":"2023-07-11T00:00:18.506667+0000","last_became_active":"2023-07-11T00:00:16.383295+0000","last_became_peered":"2023-07-11T00:00:16.383295+0000","last_unstale":"2023-07-11T00:00:18.506667+0000","last_undegraded":"2023-07-11T00:00:18.506667+0000","last_fullsized":"2023-07-11T00:00:18.506667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:17.100187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008310+0000","last_change":"2023-07-11T00:00:17.398128+0000","last_active":"2023-07-11T00:00:19.008310+0000","last_peered":"2023-07-11T00:00:19.008310+0000","last_clean":"2023-07-11T00:00:19.008310+0000","last_became_active":"2023-07-11T00:00:17.397851+0000","last_became_peered":"2023-07-11T00:00:17.397851+0000","last_unstale":"2023-07-11T00:00:19.008310+0000","last_undegraded":"2023-07-11T00:00:19.008310+0000","last_fullsized":"2023-07-11T00:00:19.008310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:00:40.235957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373474+0000","last_change":"2023-07-11T00:00:16.382786+0000","last_active":"2023-07-11T00:00:18.373474+0000","last_peered":"2023-07-11T00:00:18.373474+0000","last_clean":"2023-07-11T00:00:18.373474+0000","last_became_active":"2023-07-11T00:00:16.382519+0000","last_became_peered":"2023-07-11T00:00:16.382519+0000","last_unstale":"2023-07-11T00:00:18.373474+0000","last_undegraded":"2023-07-11T00:00:18.373474+0000","last_fullsized":"2023-07-11T00:00:18.373474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:28.631488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008963+0000","last_change":"2023-07-11T00:00:17.396289+0000","last_active":"2023-07-11T00:00:19.008963+0000","last_peered":"2023-07-11T00:00:19.008963+0000","last_clean":"2023-07-11T00:00:19.008963+0000","last_became_active":"2023-07-11T00:00:17.395948+0000","last_became_peered":"2023-07-11T00:00:17.395948+0000","last_unstale":"2023-07-11T00:00:19.008963+0000","last_undegraded":"2023-07-11T00:00:19.008963+0000","last_fullsized":"2023-07-11T00:00:19.008963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373988+0000","last_change":"2023-07-11T00:00:16.381779+0000","last_active":"2023-07-11T00:00:18.373988+0000","last_peered":"2023-07-11T00:00:18.373988+0000","last_clean":"2023-07-11T00:00:18.373988+0000","last_became_active":"2023-07-11T00:00:16.381496+0000","last_became_peered":"2023-07-11T00:00:16.381496+0000","last_unstale":"2023-07-11T00:00:18.373988+0000","last_undegraded":"2023-07-11T00:00:18.373988+0000","last_fullsized":"2023-07-11T00:00:18.373988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:04.291692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008966+0000","last_change":"2023-07-11T00:00:17.392394+0000","last_active":"2023-07-11T00:00:19.008966+0000","last_peered":"2023-07-11T00:00:19.008966+0000","last_clean":"2023-07-11T00:00:19.008966+0000","last_became_active":"2023-07-11T00:00:17.391500+0000","last_became_peered":"2023-07-11T00:00:17.391500+0000","last_unstale":"2023-07-11T00:00:19.008966+0000","last_undegraded":"2023-07-11T00:00:19.008966+0000","last_fullsized":"2023-07-11T00:00:19.008966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:45.858410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008803+0000","last_change":"2023-07-11T00:00:16.384057+0000","last_active":"2023-07-11T00:00:19.008803+0000","last_peered":"2023-07-11T00:00:19.008803+0000","last_clean":"2023-07-11T00:00:19.008803+0000","last_became_active":"2023-07-11T00:00:16.383707+0000","last_became_peered":"2023-07-11T00:00:16.383707+0000","last_unstale":"2023-07-11T00:00:19.008803+0000","last_undegraded":"2023-07-11T00:00:19.008803+0000","last_fullsized":"2023-07-11T00:00:19.008803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:32.545716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007992+0000","last_change":"2023-07-11T00:00:17.393506+0000","last_active":"2023-07-11T00:00:19.007992+0000","last_peered":"2023-07-11T00:00:19.007992+0000","last_clean":"2023-07-11T00:00:19.007992+0000","last_became_active":"2023-07-11T00:00:17.392891+0000","last_became_peered":"2023-07-11T00:00:17.392891+0000","last_unstale":"2023-07-11T00:00:19.007992+0000","last_undegraded":"2023-07-11T00:00:19.007992+0000","last_fullsized":"2023-07-11T00:00:19.007992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506934+0000","last_change":"2023-07-11T00:00:16.386794+0000","last_active":"2023-07-11T00:00:18.506934+0000","last_peered":"2023-07-11T00:00:18.506934+0000","last_clean":"2023-07-11T00:00:18.506934+0000","last_became_active":"2023-07-11T00:00:16.386581+0000","last_became_peered":"2023-07-11T00:00:16.386581+0000","last_unstale":"2023-07-11T00:00:18.506934+0000","last_undegraded":"2023-07-11T00:00:18.506934+0000","last_fullsized":"2023-07-11T00:00:18.506934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:44.852995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007926+0000","last_change":"2023-07-11T00:00:17.383214+0000","last_active":"2023-07-11T00:00:19.007926+0000","last_peered":"2023-07-11T00:00:19.007926+0000","last_clean":"2023-07-11T00:00:19.007926+0000","last_became_active":"2023-07-11T00:00:17.381360+0000","last_became_peered":"2023-07-11T00:00:17.381360+0000","last_unstale":"2023-07-11T00:00:19.007926+0000","last_undegraded":"2023-07-11T00:00:19.007926+0000","last_fullsized":"2023-07-11T00:00:19.007926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373840+0000","last_change":"2023-07-11T00:00:17.392151+0000","last_active":"2023-07-11T00:00:18.373840+0000","last_peered":"2023-07-11T00:00:18.373840+0000","last_clean":"2023-07-11T00:00:18.373840+0000","last_became_active":"2023-07-11T00:00:17.391869+0000","last_became_peered":"2023-07-11T00:00:17.391869+0000","last_unstale":"2023-07-11T00:00:18.373840+0000","last_undegraded":"2023-07-11T00:00:18.373840+0000","last_fullsized":"2023-07-11T00:00:18.373840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:04:27.161083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007854+0000","last_change":"2023-07-11T00:00:17.400395+0000","last_active":"2023-07-11T00:00:19.007854+0000","last_peered":"2023-07-11T00:00:19.007854+0000","last_clean":"2023-07-11T00:00:19.007854+0000","last_became_active":"2023-07-11T00:00:17.400124+0000","last_became_peered":"2023-07-11T00:00:17.400124+0000","last_unstale":"2023-07-11T00:00:19.007854+0000","last_undegraded":"2023-07-11T00:00:19.007854+0000","last_fullsized":"2023-07-11T00:00:19.007854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008468+0000","last_change":"2023-07-11T00:00:17.388655+0000","last_active":"2023-07-11T00:00:19.008468+0000","last_peered":"2023-07-11T00:00:19.008468+0000","last_clean":"2023-07-11T00:00:19.008468+0000","last_became_active":"2023-07-11T00:00:17.388372+0000","last_became_peered":"2023-07-11T00:00:17.388372+0000","last_unstale":"2023-07-11T00:00:19.008468+0000","last_undegraded":"2023-07-11T00:00:19.008468+0000","last_fullsized":"2023-07-11T00:00:19.008468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:05.297107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008602+0000","last_change":"2023-07-11T00:00:17.394965+0000","last_active":"2023-07-11T00:00:19.008602+0000","last_peered":"2023-07-11T00:00:19.008602+0000","last_clean":"2023-07-11T00:00:19.008602+0000","last_became_active":"2023-07-11T00:00:17.394513+0000","last_became_peered":"2023-07-11T00:00:17.394513+0000","last_unstale":"2023-07-11T00:00:19.008602+0000","last_undegraded":"2023-07-11T00:00:19.008602+0000","last_fullsized":"2023-07-11T00:00:19.008602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:50.446972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373114+0000","last_change":"2023-07-11T00:00:17.384534+0000","last_active":"2023-07-11T00:00:18.373114+0000","last_peered":"2023-07-11T00:00:18.373114+0000","last_clean":"2023-07-11T00:00:18.373114+0000","last_became_active":"2023-07-11T00:00:17.382062+0000","last_became_peered":"2023-07-11T00:00:17.382062+0000","last_unstale":"2023-07-11T00:00:18.373114+0000","last_undegraded":"2023-07-11T00:00:18.373114+0000","last_fullsized":"2023-07-11T00:00:18.373114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:10:20.060069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":671247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":79681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":80719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:00:26.381 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:00:26.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.539+0000 7f39b612a700 1 Processor -- start 2023-07-11T00:00:26.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.539+0000 7f39b612a700 1 -- start start 2023-07-11T00:00:26.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.539+0000 7f39b612a700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f39b0141780 0x7f39b00ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.539+0000 7f39b612a700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39b00b96b0 0x7f39b0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.539+0000 7f39b612a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b0070e70 con 0x7f39b0071a30 2023-07-11T00:00:26.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.539+0000 7f39b612a700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b0071ea0 con 0x7f39b0141780 2023-07-11T00:00:26.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.539+0000 7f39b612a700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b00b9b40 con 0x7f39b00b96b0 2023-07-11T00:00:26.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.539+0000 7f39aeffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f39b0071a30 0x7f39b014ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54506/0 (socket says 172.21.15.38:54506) 2023-07-11T00:00:26.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.539+0000 7f39aeffd700 1 -- 172.21.15.38:0/1780240879 learned_addr learned my addr 172.21.15.38:0/1780240879 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:26.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39af7fe700 1 --2- 172.21.15.38:0/1780240879 >> v2:172.21.15.70:3300/0 conn(0x7f39b0141780 0x7f39b00ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39affff700 1 --2- 172.21.15.38:0/1780240879 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39b00b96b0 0x7f39b0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39ae7fc700 1 -- 172.21.15.38:0/1780240879 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823518337 0 0) 0x7f39b0070e70 con 0x7f39b0071a30 2023-07-11T00:00:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39ae7fc700 1 -- 172.21.15.38:0/1780240879 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39980057c0 con 0x7f39b0071a30 2023-07-11T00:00:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39af7fe700 1 -- 172.21.15.38:0/1780240879 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39b00b96b0 msgr2=0x7f39b0151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39af7fe700 1 --2- 172.21.15.38:0/1780240879 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39b00b96b0 0x7f39b0151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39af7fe700 1 -- 172.21.15.38:0/1780240879 >> v1:172.21.15.38:6789/0 conn(0x7f39b0071a30 legacy=0x7f39b014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39af7fe700 1 -- 172.21.15.38:0/1780240879 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0070670 con 0x7f39b0141780 2023-07-11T00:00:26.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39af7fe700 1 --2- 172.21.15.38:0/1780240879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39b0141780 0x7f39b00ba010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009840 tx=0x7f39a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8dbd61a0e1e9009 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:26.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39ae7fc700 1 -- 172.21.15.38:0/1780240879 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0011830 con 0x7f39b0141780 2023-07-11T00:00:26.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39ae7fc700 1 -- 172.21.15.38:0/1780240879 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a0011990 con 0x7f39b0141780 2023-07-11T00:00:26.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.540+0000 7f39ae7fc700 1 -- 172.21.15.38:0/1780240879 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0011d00 con 0x7f39b0141780 2023-07-11T00:00:26.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.541+0000 7f39b612a700 1 -- 172.21.15.38:0/1780240879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39b0141780 msgr2=0x7f39b00ba010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.541+0000 7f39b612a700 1 --2- 172.21.15.38:0/1780240879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39b0141780 0x7f39b00ba010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009840 tx=0x7f39a0009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:26.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.541+0000 7f39b612a700 1 -- 172.21.15.38:0/1780240879 shutdown_connections 2023-07-11T00:00:26.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.541+0000 7f39b612a700 1 --2- 172.21.15.38:0/1780240879 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39b00b96b0 0x7f39b0151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.541+0000 7f39b612a700 1 --2- 172.21.15.38:0/1780240879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39b0141780 0x7f39b00ba010 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.541+0000 7f39b612a700 1 -- 172.21.15.38:0/1780240879 >> 172.21.15.38:0/1780240879 conn(0x7f39b006d0e0 msgr2=0x7f39b006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:26.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.541+0000 7f39b612a700 1 -- 172.21.15.38:0/1780240879 shutdown_connections 2023-07-11T00:00:26.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.541+0000 7f39b612a700 1 -- 172.21.15.38:0/1780240879 wait complete. 2023-07-11T00:00:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.542+0000 7f39b612a700 1 Processor -- start 2023-07-11T00:00:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.542+0000 7f39b612a700 1 -- start start 2023-07-11T00:00:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39b612a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39b0071a30 0x7f39b01436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39b612a700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39b00b96b0 0x7f39b01df900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39b612a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39b0141780 0x7f39b0147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39b612a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b013d180 con 0x7f39b0071a30 2023-07-11T00:00:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39b612a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b0143bf0 con 0x7f39b0141780 2023-07-11T00:00:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39b612a700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b0144350 con 0x7f39b00b96b0 2023-07-11T00:00:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39af7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39b0071a30 0x7f39b01436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39af7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39b0071a30 0x7f39b01436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53142/0 (socket says 172.21.15.38:53142) 2023-07-11T00:00:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39af7fe700 1 -- 172.21.15.38:0/297845200 learned_addr learned my addr 172.21.15.38:0/297845200 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39affff700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39b0141780 0x7f39b0147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39aeffd700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39b00b96b0 0x7f39b01df900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39af7fe700 1 -- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39b00b96b0 msgr2=0x7f39b01df900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39af7fe700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39b00b96b0 0x7f39b01df900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39af7fe700 1 -- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39b0141780 msgr2=0x7f39b0147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39af7fe700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39b0141780 0x7f39b0147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39af7fe700 1 -- 172.21.15.38:0/297845200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a00094a0 con 0x7f39b0071a30 2023-07-11T00:00:26.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39affff700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39b0141780 0x7f39b0147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:26.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39aeffd700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39b00b96b0 0x7f39b01df900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:26.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f39af7fe700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39b0071a30 0x7f39b01436b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009fd0 tx=0x7f39a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:26.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.543+0000 7f3997fff700 1 -- 172.21.15.38:0/297845200 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00045d0 con 0x7f39b0071a30 2023-07-11T00:00:26.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.544+0000 7f3997fff700 1 -- 172.21.15.38:0/297845200 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a001e070 con 0x7f39b0071a30 2023-07-11T00:00:26.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.544+0000 7f39b612a700 1 -- 172.21.15.38:0/297845200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b013da00 con 0x7f39b0071a30 2023-07-11T00:00:26.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.544+0000 7f3997fff700 1 -- 172.21.15.38:0/297845200 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00038a0 con 0x7f39b0071a30 2023-07-11T00:00:26.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.544+0000 7f39b612a700 1 -- 172.21.15.38:0/297845200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b01e3350 con 0x7f39b0071a30 2023-07-11T00:00:26.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.545+0000 7f39b612a700 1 -- 172.21.15.38:0/297845200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b0074360 con 0x7f39b0071a30 2023-07-11T00:00:26.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.545+0000 7f3997fff700 1 -- 172.21.15.38:0/297845200 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39a0003a00 con 0x7f39b0071a30 2023-07-11T00:00:26.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.545+0000 7f3997fff700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f399c06ace0 0x7f399c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.545+0000 7f3997fff700 1 -- 172.21.15.38:0/297845200 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39a008a2b0 con 0x7f39b0071a30 2023-07-11T00:00:26.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.545+0000 7f39aeffd700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f399c06ace0 0x7f399c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.546+0000 7f39aeffd700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f399c06ace0 0x7f399c06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f39b013dec0 tx=0x7f39a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:26.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.550+0000 7f3997fff700 1 -- 172.21.15.38:0/297845200 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f39a0055370 con 0x7f39b0071a30 2023-07-11T00:00:26.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.741+0000 7f39b612a700 1 -- 172.21.15.38:0/297845200 --> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39b0141b50 con 0x7f399c06ace0 2023-07-11T00:00:26.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.749+0000 7f3997fff700 1 -- 172.21.15.38:0/297845200 <== mgr.4105 v2:172.21.15.70:6832/2073477499 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286881 (secure 0 0 0) 0x7f39a40013f0 con 0x7f399c06ace0 2023-07-11T00:00:26.754 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:26.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.752+0000 7f39b612a700 1 -- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f399c06ace0 msgr2=0x7f399c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.752+0000 7f39b612a700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f399c06ace0 0x7f399c06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f39b013dec0 tx=0x7f39a4009040 comp rx=0 tx=0).stop 2023-07-11T00:00:26.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.752+0000 7f39b612a700 1 -- 172.21.15.38:0/297845200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39b0071a30 msgr2=0x7f39b01436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.753+0000 7f39b612a700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39b0071a30 0x7f39b01436b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009fd0 tx=0x7f39a0004750 comp rx=0 tx=0).stop 2023-07-11T00:00:26.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.753+0000 7f39b612a700 1 -- 172.21.15.38:0/297845200 shutdown_connections 2023-07-11T00:00:26.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.753+0000 7f39b612a700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f399c06ace0 0x7f399c06d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.753+0000 7f39b612a700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39b0141780 0x7f39b0147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.753+0000 7f39b612a700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39b0071a30 0x7f39b01436b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.753+0000 7f39b612a700 1 --2- 172.21.15.38:0/297845200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39b00b96b0 0x7f39b01df900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.753+0000 7f39b612a700 1 -- 172.21.15.38:0/297845200 >> 172.21.15.38:0/297845200 conn(0x7f39b006d0e0 msgr2=0x7f39b00b8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:26.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.753+0000 7f39b612a700 1 -- 172.21.15.38:0/297845200 shutdown_connections 2023-07-11T00:00:26.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.753+0000 7f39b612a700 1 -- 172.21.15.38:0/297845200 wait complete. 2023-07-11T00:00:26.757 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-07-11T00:00:26.766 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-07-11T00:00:25.951531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2990080,"data_stored":1818252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.580963"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008537+0000","last_change":"2023-07-11T00:00:17.397708+0000","last_active":"2023-07-11T00:00:19.008537+0000","last_peered":"2023-07-11T00:00:19.008537+0000","last_clean":"2023-07-11T00:00:19.008537+0000","last_became_active":"2023-07-11T00:00:17.397420+0000","last_became_peered":"2023-07-11T00:00:17.397420+0000","last_unstale":"2023-07-11T00:00:19.008537+0000","last_undegraded":"2023-07-11T00:00:19.008537+0000","last_fullsized":"2023-07-11T00:00:19.008537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:36:59.464113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373811+0000","last_change":"2023-07-11T00:00:17.397645+0000","last_active":"2023-07-11T00:00:18.373811+0000","last_peered":"2023-07-11T00:00:18.373811+0000","last_clean":"2023-07-11T00:00:18.373811+0000","last_became_active":"2023-07-11T00:00:17.397379+0000","last_became_peered":"2023-07-11T00:00:17.397379+0000","last_unstale":"2023-07-11T00:00:18.373811+0000","last_undegraded":"2023-07-11T00:00:18.373811+0000","last_fullsized":"2023-07-11T00:00:18.373811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009115+0000","last_change":"2023-07-11T00:00:17.383242+0000","last_active":"2023-07-11T00:00:19.009115+0000","last_peered":"2023-07-11T00:00:19.009115+0000","last_clean":"2023-07-11T00:00:19.009115+0000","last_became_active":"2023-07-11T00:00:17.382949+0000","last_became_peered":"2023-07-11T00:00:17.382949+0000","last_unstale":"2023-07-11T00:00:19.009115+0000","last_undegraded":"2023-07-11T00:00:19.009115+0000","last_fullsized":"2023-07-11T00:00:19.009115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:03.546582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374355+0000","last_change":"2023-07-11T00:00:17.382742+0000","last_active":"2023-07-11T00:00:18.374355+0000","last_peered":"2023-07-11T00:00:18.374355+0000","last_clean":"2023-07-11T00:00:18.374355+0000","last_became_active":"2023-07-11T00:00:17.382485+0000","last_became_peered":"2023-07-11T00:00:17.382485+0000","last_unstale":"2023-07-11T00:00:18.374355+0000","last_undegraded":"2023-07-11T00:00:18.374355+0000","last_fullsized":"2023-07-11T00:00:18.374355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:10:20.060069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506405+0000","last_change":"2023-07-11T00:00:17.397047+0000","last_active":"2023-07-11T00:00:18.506405+0000","last_peered":"2023-07-11T00:00:18.506405+0000","last_clean":"2023-07-11T00:00:18.506405+0000","last_became_active":"2023-07-11T00:00:17.396780+0000","last_became_peered":"2023-07-11T00:00:17.396780+0000","last_unstale":"2023-07-11T00:00:18.506405+0000","last_undegraded":"2023-07-11T00:00:18.506405+0000","last_fullsized":"2023-07-11T00:00:18.506405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:49.980328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007933+0000","last_change":"2023-07-11T00:00:17.383091+0000","last_active":"2023-07-11T00:00:19.007933+0000","last_peered":"2023-07-11T00:00:19.007933+0000","last_clean":"2023-07-11T00:00:19.007933+0000","last_became_active":"2023-07-11T00:00:17.382732+0000","last_became_peered":"2023-07-11T00:00:17.382732+0000","last_unstale":"2023-07-11T00:00:19.007933+0000","last_undegraded":"2023-07-11T00:00:19.007933+0000","last_fullsized":"2023-07-11T00:00:19.007933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007960+0000","last_change":"2023-07-11T00:00:17.398152+0000","last_active":"2023-07-11T00:00:19.007960+0000","last_peered":"2023-07-11T00:00:19.007960+0000","last_clean":"2023-07-11T00:00:19.007960+0000","last_became_active":"2023-07-11T00:00:17.397866+0000","last_became_peered":"2023-07-11T00:00:17.397866+0000","last_unstale":"2023-07-11T00:00:19.007960+0000","last_undegraded":"2023-07-11T00:00:19.007960+0000","last_fullsized":"2023-07-11T00:00:19.007960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:45.858410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373410+0000","last_change":"2023-07-11T00:00:17.388247+0000","last_active":"2023-07-11T00:00:18.373410+0000","last_peered":"2023-07-11T00:00:18.373410+0000","last_clean":"2023-07-11T00:00:18.373410+0000","last_became_active":"2023-07-11T00:00:17.387971+0000","last_became_peered":"2023-07-11T00:00:17.387971+0000","last_unstale":"2023-07-11T00:00:18.373410+0000","last_undegraded":"2023-07-11T00:00:18.373410+0000","last_fullsized":"2023-07-11T00:00:18.373410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:49.980328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506791+0000","last_change":"2023-07-11T00:00:17.399917+0000","last_active":"2023-07-11T00:00:18.506791+0000","last_peered":"2023-07-11T00:00:18.506791+0000","last_clean":"2023-07-11T00:00:18.506791+0000","last_became_active":"2023-07-11T00:00:17.399650+0000","last_became_peered":"2023-07-11T00:00:17.399650+0000","last_unstale":"2023-07-11T00:00:18.506791+0000","last_undegraded":"2023-07-11T00:00:18.506791+0000","last_fullsized":"2023-07-11T00:00:18.506791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:16.918740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374155+0000","last_change":"2023-07-11T00:00:17.391372+0000","last_active":"2023-07-11T00:00:18.374155+0000","last_peered":"2023-07-11T00:00:18.374155+0000","last_clean":"2023-07-11T00:00:18.374155+0000","last_became_active":"2023-07-11T00:00:17.391073+0000","last_became_peered":"2023-07-11T00:00:17.391073+0000","last_unstale":"2023-07-11T00:00:18.374155+0000","last_undegraded":"2023-07-11T00:00:18.374155+0000","last_fullsized":"2023-07-11T00:00:18.374155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:57.519021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009402+0000","last_change":"2023-07-11T00:00:17.386526+0000","last_active":"2023-07-11T00:00:19.009402+0000","last_peered":"2023-07-11T00:00:19.009402+0000","last_clean":"2023-07-11T00:00:19.009402+0000","last_became_active":"2023-07-11T00:00:17.386224+0000","last_became_peered":"2023-07-11T00:00:17.386224+0000","last_unstale":"2023-07-11T00:00:19.009402+0000","last_undegraded":"2023-07-11T00:00:19.009402+0000","last_fullsized":"2023-07-11T00:00:19.009402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:33.551132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008039+0000","last_change":"2023-07-11T00:00:17.391880+0000","last_active":"2023-07-11T00:00:19.008039+0000","last_peered":"2023-07-11T00:00:19.008039+0000","last_clean":"2023-07-11T00:00:19.008039+0000","last_became_active":"2023-07-11T00:00:17.391579+0000","last_became_peered":"2023-07-11T00:00:17.391579+0000","last_unstale":"2023-07-11T00:00:19.008039+0000","last_undegraded":"2023-07-11T00:00:19.008039+0000","last_fullsized":"2023-07-11T00:00:19.008039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:02:36.282927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008235+0000","last_change":"2023-07-11T00:00:17.395824+0000","last_active":"2023-07-11T00:00:19.008235+0000","last_peered":"2023-07-11T00:00:19.008235+0000","last_clean":"2023-07-11T00:00:19.008235+0000","last_became_active":"2023-07-11T00:00:17.395540+0000","last_became_peered":"2023-07-11T00:00:17.395540+0000","last_unstale":"2023-07-11T00:00:19.008235+0000","last_undegraded":"2023-07-11T00:00:19.008235+0000","last_fullsized":"2023-07-11T00:00:19.008235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:12:34.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373653+0000","last_change":"2023-07-11T00:00:17.392402+0000","last_active":"2023-07-11T00:00:18.373653+0000","last_peered":"2023-07-11T00:00:18.373653+0000","last_clean":"2023-07-11T00:00:18.373653+0000","last_became_active":"2023-07-11T00:00:17.392138+0000","last_became_peered":"2023-07-11T00:00:17.392138+0000","last_unstale":"2023-07-11T00:00:18.373653+0000","last_undegraded":"2023-07-11T00:00:18.373653+0000","last_fullsized":"2023-07-11T00:00:18.373653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008481+0000","last_change":"2023-07-11T00:00:17.398211+0000","last_active":"2023-07-11T00:00:19.008481+0000","last_peered":"2023-07-11T00:00:19.008481+0000","last_clean":"2023-07-11T00:00:19.008481+0000","last_became_active":"2023-07-11T00:00:17.397884+0000","last_became_peered":"2023-07-11T00:00:17.397884+0000","last_unstale":"2023-07-11T00:00:19.008481+0000","last_undegraded":"2023-07-11T00:00:19.008481+0000","last_fullsized":"2023-07-11T00:00:19.008481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:18:53.735358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008071+0000","last_change":"2023-07-11T00:00:17.383250+0000","last_active":"2023-07-11T00:00:19.008071+0000","last_peered":"2023-07-11T00:00:19.008071+0000","last_clean":"2023-07-11T00:00:19.008071+0000","last_became_active":"2023-07-11T00:00:17.382988+0000","last_became_peered":"2023-07-11T00:00:17.382988+0000","last_unstale":"2023-07-11T00:00:19.008071+0000","last_undegraded":"2023-07-11T00:00:19.008071+0000","last_fullsized":"2023-07-11T00:00:19.008071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:40.051389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506790+0000","last_change":"2023-07-11T00:00:17.395710+0000","last_active":"2023-07-11T00:00:18.506790+0000","last_peered":"2023-07-11T00:00:18.506790+0000","last_clean":"2023-07-11T00:00:18.506790+0000","last_became_active":"2023-07-11T00:00:17.395425+0000","last_became_peered":"2023-07-11T00:00:17.395425+0000","last_unstale":"2023-07-11T00:00:18.506790+0000","last_undegraded":"2023-07-11T00:00:18.506790+0000","last_fullsized":"2023-07-11T00:00:18.506790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:40.051389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009267+0000","last_change":"2023-07-11T00:00:17.392947+0000","last_active":"2023-07-11T00:00:19.009267+0000","last_peered":"2023-07-11T00:00:19.009267+0000","last_clean":"2023-07-11T00:00:19.009267+0000","last_became_active":"2023-07-11T00:00:17.392696+0000","last_became_peered":"2023-07-11T00:00:17.392696+0000","last_unstale":"2023-07-11T00:00:19.009267+0000","last_undegraded":"2023-07-11T00:00:19.009267+0000","last_fullsized":"2023-07-11T00:00:19.009267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:51:54.640593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008178+0000","last_change":"2023-07-11T00:00:17.399163+0000","last_active":"2023-07-11T00:00:19.008178+0000","last_peered":"2023-07-11T00:00:19.008178+0000","last_clean":"2023-07-11T00:00:19.008178+0000","last_became_active":"2023-07-11T00:00:17.398876+0000","last_became_peered":"2023-07-11T00:00:17.398876+0000","last_unstale":"2023-07-11T00:00:19.008178+0000","last_undegraded":"2023-07-11T00:00:19.008178+0000","last_fullsized":"2023-07-11T00:00:19.008178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:40:09.287884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009140+0000","last_change":"2023-07-11T00:00:17.385145+0000","last_active":"2023-07-11T00:00:19.009140+0000","last_peered":"2023-07-11T00:00:19.009140+0000","last_clean":"2023-07-11T00:00:19.009140+0000","last_became_active":"2023-07-11T00:00:17.384889+0000","last_became_peered":"2023-07-11T00:00:17.384889+0000","last_unstale":"2023-07-11T00:00:19.009140+0000","last_undegraded":"2023-07-11T00:00:19.009140+0000","last_fullsized":"2023-07-11T00:00:19.009140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:49.096105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008620+0000","last_change":"2023-07-11T00:00:17.396464+0000","last_active":"2023-07-11T00:00:19.008620+0000","last_peered":"2023-07-11T00:00:19.008620+0000","last_clean":"2023-07-11T00:00:19.008620+0000","last_became_active":"2023-07-11T00:00:17.396157+0000","last_became_peered":"2023-07-11T00:00:17.396157+0000","last_unstale":"2023-07-11T00:00:19.008620+0000","last_undegraded":"2023-07-11T00:00:19.008620+0000","last_fullsized":"2023-07-11T00:00:19.008620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:56:38.988691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506379+0000","last_change":"2023-07-11T00:00:17.400807+0000","last_active":"2023-07-11T00:00:18.506379+0000","last_peered":"2023-07-11T00:00:18.506379+0000","last_clean":"2023-07-11T00:00:18.506379+0000","last_became_active":"2023-07-11T00:00:17.400518+0000","last_became_peered":"2023-07-11T00:00:17.400518+0000","last_unstale":"2023-07-11T00:00:18.506379+0000","last_undegraded":"2023-07-11T00:00:18.506379+0000","last_fullsized":"2023-07-11T00:00:18.506379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:26.253992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007811+0000","last_change":"2023-07-11T00:00:17.393536+0000","last_active":"2023-07-11T00:00:19.007811+0000","last_peered":"2023-07-11T00:00:19.007811+0000","last_clean":"2023-07-11T00:00:19.007811+0000","last_became_active":"2023-07-11T00:00:17.393218+0000","last_became_peered":"2023-07-11T00:00:17.393218+0000","last_unstale":"2023-07-11T00:00:19.007811+0000","last_undegraded":"2023-07-11T00:00:19.007811+0000","last_fullsized":"2023-07-11T00:00:19.007811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008065+0000","last_change":"2023-07-11T00:00:17.394760+0000","last_active":"2023-07-11T00:00:19.008065+0000","last_peered":"2023-07-11T00:00:19.008065+0000","last_clean":"2023-07-11T00:00:19.008065+0000","last_became_active":"2023-07-11T00:00:17.394413+0000","last_became_peered":"2023-07-11T00:00:17.394413+0000","last_unstale":"2023-07-11T00:00:19.008065+0000","last_undegraded":"2023-07-11T00:00:19.008065+0000","last_fullsized":"2023-07-11T00:00:19.008065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373353+0000","last_change":"2023-07-11T00:00:17.392669+0000","last_active":"2023-07-11T00:00:18.373353+0000","last_peered":"2023-07-11T00:00:18.373353+0000","last_clean":"2023-07-11T00:00:18.373353+0000","last_became_active":"2023-07-11T00:00:17.392196+0000","last_became_peered":"2023-07-11T00:00:17.392196+0000","last_unstale":"2023-07-11T00:00:18.373353+0000","last_undegraded":"2023-07-11T00:00:18.373353+0000","last_fullsized":"2023-07-11T00:00:18.373353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373327+0000","last_change":"2023-07-11T00:00:17.393336+0000","last_active":"2023-07-11T00:00:18.373327+0000","last_peered":"2023-07-11T00:00:18.373327+0000","last_clean":"2023-07-11T00:00:18.373327+0000","last_became_active":"2023-07-11T00:00:17.393012+0000","last_became_peered":"2023-07-11T00:00:17.393012+0000","last_unstale":"2023-07-11T00:00:18.373327+0000","last_undegraded":"2023-07-11T00:00:18.373327+0000","last_fullsized":"2023-07-11T00:00:18.373327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373803+0000","last_change":"2023-07-11T00:00:17.391606+0000","last_active":"2023-07-11T00:00:18.373803+0000","last_peered":"2023-07-11T00:00:18.373803+0000","last_clean":"2023-07-11T00:00:18.373803+0000","last_became_active":"2023-07-11T00:00:17.391040+0000","last_became_peered":"2023-07-11T00:00:17.391040+0000","last_unstale":"2023-07-11T00:00:18.373803+0000","last_undegraded":"2023-07-11T00:00:18.373803+0000","last_fullsized":"2023-07-11T00:00:18.373803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008846+0000","last_change":"2023-07-11T00:00:16.382120+0000","last_active":"2023-07-11T00:00:19.008846+0000","last_peered":"2023-07-11T00:00:19.008846+0000","last_clean":"2023-07-11T00:00:19.008846+0000","last_became_active":"2023-07-11T00:00:16.381850+0000","last_became_peered":"2023-07-11T00:00:16.381850+0000","last_unstale":"2023-07-11T00:00:19.008846+0000","last_undegraded":"2023-07-11T00:00:19.008846+0000","last_fullsized":"2023-07-11T00:00:19.008846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:56.513606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008521+0000","last_change":"2023-07-11T00:00:17.399984+0000","last_active":"2023-07-11T00:00:19.008521+0000","last_peered":"2023-07-11T00:00:19.008521+0000","last_clean":"2023-07-11T00:00:19.008521+0000","last_became_active":"2023-07-11T00:00:17.399791+0000","last_became_peered":"2023-07-11T00:00:17.399791+0000","last_unstale":"2023-07-11T00:00:19.008521+0000","last_undegraded":"2023-07-11T00:00:19.008521+0000","last_fullsized":"2023-07-11T00:00:19.008521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372863+0000","last_change":"2023-07-11T00:00:16.386771+0000","last_active":"2023-07-11T00:00:18.372863+0000","last_peered":"2023-07-11T00:00:18.372863+0000","last_clean":"2023-07-11T00:00:18.372863+0000","last_became_active":"2023-07-11T00:00:16.386510+0000","last_became_peered":"2023-07-11T00:00:16.386510+0000","last_unstale":"2023-07-11T00:00:18.372863+0000","last_undegraded":"2023-07-11T00:00:18.372863+0000","last_fullsized":"2023-07-11T00:00:18.372863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:04:26.155667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506805+0000","last_change":"2023-07-11T00:00:17.382846+0000","last_active":"2023-07-11T00:00:18.506805+0000","last_peered":"2023-07-11T00:00:18.506805+0000","last_clean":"2023-07-11T00:00:18.506805+0000","last_became_active":"2023-07-11T00:00:17.382575+0000","last_became_peered":"2023-07-11T00:00:17.382575+0000","last_unstale":"2023-07-11T00:00:18.506805+0000","last_undegraded":"2023-07-11T00:00:18.506805+0000","last_fullsized":"2023-07-11T00:00:18.506805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:29.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008088+0000","last_change":"2023-07-11T00:00:16.385044+0000","last_active":"2023-07-11T00:00:19.008088+0000","last_peered":"2023-07-11T00:00:19.008088+0000","last_clean":"2023-07-11T00:00:19.008088+0000","last_became_active":"2023-07-11T00:00:16.384163+0000","last_became_peered":"2023-07-11T00:00:16.384163+0000","last_unstale":"2023-07-11T00:00:19.008088+0000","last_undegraded":"2023-07-11T00:00:19.008088+0000","last_fullsized":"2023-07-11T00:00:19.008088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:39.045974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374477+0000","last_change":"2023-07-11T00:00:17.386852+0000","last_active":"2023-07-11T00:00:18.374477+0000","last_peered":"2023-07-11T00:00:18.374477+0000","last_clean":"2023-07-11T00:00:18.374477+0000","last_became_active":"2023-07-11T00:00:17.386559+0000","last_became_peered":"2023-07-11T00:00:17.386559+0000","last_unstale":"2023-07-11T00:00:18.374477+0000","last_undegraded":"2023-07-11T00:00:18.374477+0000","last_fullsized":"2023-07-11T00:00:18.374477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:17.746982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506933+0000","last_change":"2023-07-11T00:00:16.386985+0000","last_active":"2023-07-11T00:00:18.506933+0000","last_peered":"2023-07-11T00:00:18.506933+0000","last_clean":"2023-07-11T00:00:18.506933+0000","last_became_active":"2023-07-11T00:00:16.386092+0000","last_became_peered":"2023-07-11T00:00:16.386092+0000","last_unstale":"2023-07-11T00:00:18.506933+0000","last_undegraded":"2023-07-11T00:00:18.506933+0000","last_fullsized":"2023-07-11T00:00:18.506933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:56.513606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007916+0000","last_change":"2023-07-11T00:00:17.400026+0000","last_active":"2023-07-11T00:00:19.007916+0000","last_peered":"2023-07-11T00:00:19.007916+0000","last_clean":"2023-07-11T00:00:19.007916+0000","last_became_active":"2023-07-11T00:00:17.399293+0000","last_became_peered":"2023-07-11T00:00:17.399293+0000","last_unstale":"2023-07-11T00:00:19.007916+0000","last_undegraded":"2023-07-11T00:00:19.007916+0000","last_fullsized":"2023-07-11T00:00:19.007916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374001+0000","last_change":"2023-07-11T00:00:16.384101+0000","last_active":"2023-07-11T00:00:18.374001+0000","last_peered":"2023-07-11T00:00:18.374001+0000","last_clean":"2023-07-11T00:00:18.374001+0000","last_became_active":"2023-07-11T00:00:16.383818+0000","last_became_peered":"2023-07-11T00:00:16.383818+0000","last_unstale":"2023-07-11T00:00:18.374001+0000","last_undegraded":"2023-07-11T00:00:18.374001+0000","last_fullsized":"2023-07-11T00:00:18.374001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:28.418665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008115+0000","last_change":"2023-07-11T00:00:17.389712+0000","last_active":"2023-07-11T00:00:19.008115+0000","last_peered":"2023-07-11T00:00:19.008115+0000","last_clean":"2023-07-11T00:00:19.008115+0000","last_became_active":"2023-07-11T00:00:17.389347+0000","last_became_peered":"2023-07-11T00:00:17.389347+0000","last_unstale":"2023-07-11T00:00:19.008115+0000","last_undegraded":"2023-07-11T00:00:19.008115+0000","last_fullsized":"2023-07-11T00:00:19.008115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:29.424080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008467+0000","last_change":"2023-07-11T00:00:16.389670+0000","last_active":"2023-07-11T00:00:19.008467+0000","last_peered":"2023-07-11T00:00:19.008467+0000","last_clean":"2023-07-11T00:00:19.008467+0000","last_became_active":"2023-07-11T00:00:16.389452+0000","last_became_peered":"2023-07-11T00:00:16.389452+0000","last_unstale":"2023-07-11T00:00:19.008467+0000","last_undegraded":"2023-07-11T00:00:19.008467+0000","last_fullsized":"2023-07-11T00:00:19.008467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:51:53.635178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372965+0000","last_change":"2023-07-11T00:00:17.395904+0000","last_active":"2023-07-11T00:00:18.372965+0000","last_peered":"2023-07-11T00:00:18.372965+0000","last_clean":"2023-07-11T00:00:18.372965+0000","last_became_active":"2023-07-11T00:00:17.392236+0000","last_became_peered":"2023-07-11T00:00:17.392236+0000","last_unstale":"2023-07-11T00:00:18.372965+0000","last_undegraded":"2023-07-11T00:00:18.372965+0000","last_fullsized":"2023-07-11T00:00:18.372965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:12:05.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009431+0000","last_change":"2023-07-11T00:00:16.382024+0000","last_active":"2023-07-11T00:00:19.009431+0000","last_peered":"2023-07-11T00:00:19.009431+0000","last_clean":"2023-07-11T00:00:19.009431+0000","last_became_active":"2023-07-11T00:00:16.380867+0000","last_became_peered":"2023-07-11T00:00:16.380867+0000","last_unstale":"2023-07-11T00:00:19.009431+0000","last_undegraded":"2023-07-11T00:00:19.009431+0000","last_fullsized":"2023-07-11T00:00:19.009431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:56:37.983275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009263+0000","last_change":"2023-07-11T00:00:17.378560+0000","last_active":"2023-07-11T00:00:19.009263+0000","last_peered":"2023-07-11T00:00:19.009263+0000","last_clean":"2023-07-11T00:00:19.009263+0000","last_became_active":"2023-07-11T00:00:17.378254+0000","last_became_peered":"2023-07-11T00:00:17.378254+0000","last_unstale":"2023-07-11T00:00:19.009263+0000","last_undegraded":"2023-07-11T00:00:19.009263+0000","last_fullsized":"2023-07-11T00:00:19.009263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:23.254269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008429+0000","last_change":"2023-07-11T00:00:16.384078+0000","last_active":"2023-07-11T00:00:19.008429+0000","last_peered":"2023-07-11T00:00:19.008429+0000","last_clean":"2023-07-11T00:00:19.008429+0000","last_became_active":"2023-07-11T00:00:16.383846+0000","last_became_peered":"2023-07-11T00:00:16.383846+0000","last_unstale":"2023-07-11T00:00:19.008429+0000","last_undegraded":"2023-07-11T00:00:19.008429+0000","last_fullsized":"2023-07-11T00:00:19.008429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:22.248854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008163+0000","last_change":"2023-07-11T00:00:17.399815+0000","last_active":"2023-07-11T00:00:19.008163+0000","last_peered":"2023-07-11T00:00:19.008163+0000","last_clean":"2023-07-11T00:00:19.008163+0000","last_became_active":"2023-07-11T00:00:17.399521+0000","last_became_peered":"2023-07-11T00:00:17.399521+0000","last_unstale":"2023-07-11T00:00:19.008163+0000","last_undegraded":"2023-07-11T00:00:19.008163+0000","last_fullsized":"2023-07-11T00:00:19.008163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:05.297107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506521+0000","last_change":"2023-07-11T00:00:16.380652+0000","last_active":"2023-07-11T00:00:18.506521+0000","last_peered":"2023-07-11T00:00:18.506521+0000","last_clean":"2023-07-11T00:00:18.506521+0000","last_became_active":"2023-07-11T00:00:16.380380+0000","last_became_peered":"2023-07-11T00:00:16.380380+0000","last_unstale":"2023-07-11T00:00:18.506521+0000","last_undegraded":"2023-07-11T00:00:18.506521+0000","last_fullsized":"2023-07-11T00:00:18.506521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:06.207909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373844+0000","last_change":"2023-07-11T00:00:17.390008+0000","last_active":"2023-07-11T00:00:18.373844+0000","last_peered":"2023-07-11T00:00:18.373844+0000","last_clean":"2023-07-11T00:00:18.373844+0000","last_became_active":"2023-07-11T00:00:17.389740+0000","last_became_peered":"2023-07-11T00:00:17.389740+0000","last_unstale":"2023-07-11T00:00:18.373844+0000","last_undegraded":"2023-07-11T00:00:18.373844+0000","last_fullsized":"2023-07-11T00:00:18.373844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008147+0000","last_change":"2023-07-11T00:00:16.383128+0000","last_active":"2023-07-11T00:00:19.008147+0000","last_peered":"2023-07-11T00:00:19.008147+0000","last_clean":"2023-07-11T00:00:19.008147+0000","last_became_active":"2023-07-11T00:00:16.382870+0000","last_became_peered":"2023-07-11T00:00:16.382870+0000","last_unstale":"2023-07-11T00:00:19.008147+0000","last_undegraded":"2023-07-11T00:00:19.008147+0000","last_fullsized":"2023-07-11T00:00:19.008147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:02.541167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506680+0000","last_change":"2023-07-11T00:00:17.394408+0000","last_active":"2023-07-11T00:00:18.506680+0000","last_peered":"2023-07-11T00:00:18.506680+0000","last_clean":"2023-07-11T00:00:18.506680+0000","last_became_active":"2023-07-11T00:00:17.394079+0000","last_became_peered":"2023-07-11T00:00:17.394079+0000","last_unstale":"2023-07-11T00:00:18.506680+0000","last_undegraded":"2023-07-11T00:00:18.506680+0000","last_fullsized":"2023-07-11T00:00:18.506680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:37:37.062070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373459+0000","last_change":"2023-07-11T00:00:16.380308+0000","last_active":"2023-07-11T00:00:18.373459+0000","last_peered":"2023-07-11T00:00:18.373459+0000","last_clean":"2023-07-11T00:00:18.373459+0000","last_became_active":"2023-07-11T00:00:16.380036+0000","last_became_peered":"2023-07-11T00:00:16.380036+0000","last_unstale":"2023-07-11T00:00:18.373459+0000","last_undegraded":"2023-07-11T00:00:18.373459+0000","last_fullsized":"2023-07-11T00:00:18.373459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:57:14.865203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008874+0000","last_change":"2023-07-11T00:00:17.396665+0000","last_active":"2023-07-11T00:00:19.008874+0000","last_peered":"2023-07-11T00:00:19.008874+0000","last_clean":"2023-07-11T00:00:19.008874+0000","last_became_active":"2023-07-11T00:00:17.396049+0000","last_became_peered":"2023-07-11T00:00:17.396049+0000","last_unstale":"2023-07-11T00:00:19.008874+0000","last_undegraded":"2023-07-11T00:00:19.008874+0000","last_fullsized":"2023-07-11T00:00:19.008874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:29:23.254269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008597+0000","last_change":"2023-07-11T00:00:16.382403+0000","last_active":"2023-07-11T00:00:19.008597+0000","last_peered":"2023-07-11T00:00:19.008597+0000","last_clean":"2023-07-11T00:00:19.008597+0000","last_became_active":"2023-07-11T00:00:16.382062+0000","last_became_peered":"2023-07-11T00:00:16.382062+0000","last_unstale":"2023-07-11T00:00:19.008597+0000","last_undegraded":"2023-07-11T00:00:19.008597+0000","last_fullsized":"2023-07-11T00:00:19.008597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:17:20.832645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373662+0000","last_change":"2023-07-11T00:00:17.384147+0000","last_active":"2023-07-11T00:00:18.373662+0000","last_peered":"2023-07-11T00:00:18.373662+0000","last_clean":"2023-07-11T00:00:18.373662+0000","last_became_active":"2023-07-11T00:00:17.383896+0000","last_became_peered":"2023-07-11T00:00:17.383896+0000","last_unstale":"2023-07-11T00:00:18.373662+0000","last_undegraded":"2023-07-11T00:00:18.373662+0000","last_fullsized":"2023-07-11T00:00:18.373662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008430+0000","last_change":"2023-07-11T00:00:16.384123+0000","last_active":"2023-07-11T00:00:19.008430+0000","last_peered":"2023-07-11T00:00:19.008430+0000","last_clean":"2023-07-11T00:00:19.008430+0000","last_became_active":"2023-07-11T00:00:16.383832+0000","last_became_peered":"2023-07-11T00:00:16.383832+0000","last_unstale":"2023-07-11T00:00:19.008430+0000","last_undegraded":"2023-07-11T00:00:19.008430+0000","last_fullsized":"2023-07-11T00:00:19.008430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:34:19.684185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008056+0000","last_change":"2023-07-11T00:00:17.387530+0000","last_active":"2023-07-11T00:00:19.008056+0000","last_peered":"2023-07-11T00:00:19.008056+0000","last_clean":"2023-07-11T00:00:19.008056+0000","last_became_active":"2023-07-11T00:00:17.387105+0000","last_became_peered":"2023-07-11T00:00:17.387105+0000","last_unstale":"2023-07-11T00:00:19.008056+0000","last_undegraded":"2023-07-11T00:00:19.008056+0000","last_fullsized":"2023-07-11T00:00:19.008056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008383+0000","last_change":"2023-07-11T00:00:16.385068+0000","last_active":"2023-07-11T00:00:19.008383+0000","last_peered":"2023-07-11T00:00:19.008383+0000","last_clean":"2023-07-11T00:00:19.008383+0000","last_became_active":"2023-07-11T00:00:16.384772+0000","last_became_peered":"2023-07-11T00:00:16.384772+0000","last_unstale":"2023-07-11T00:00:19.008383+0000","last_undegraded":"2023-07-11T00:00:19.008383+0000","last_fullsized":"2023-07-11T00:00:19.008383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:32.545716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374548+0000","last_change":"2023-07-11T00:00:17.383412+0000","last_active":"2023-07-11T00:00:18.374548+0000","last_peered":"2023-07-11T00:00:18.374548+0000","last_clean":"2023-07-11T00:00:18.374548+0000","last_became_active":"2023-07-11T00:00:17.383162+0000","last_became_peered":"2023-07-11T00:00:17.383162+0000","last_unstale":"2023-07-11T00:00:18.374548+0000","last_undegraded":"2023-07-11T00:00:18.374548+0000","last_fullsized":"2023-07-11T00:00:18.374548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373928+0000","last_change":"2023-07-11T00:00:16.386464+0000","last_active":"2023-07-11T00:00:18.373928+0000","last_peered":"2023-07-11T00:00:18.373928+0000","last_clean":"2023-07-11T00:00:18.373928+0000","last_became_active":"2023-07-11T00:00:16.385972+0000","last_became_peered":"2023-07-11T00:00:16.385972+0000","last_unstale":"2023-07-11T00:00:18.373928+0000","last_undegraded":"2023-07-11T00:00:18.373928+0000","last_fullsized":"2023-07-11T00:00:18.373928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:18:39.045974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506589+0000","last_change":"2023-07-11T00:00:17.397631+0000","last_active":"2023-07-11T00:00:18.506589+0000","last_peered":"2023-07-11T00:00:18.506589+0000","last_clean":"2023-07-11T00:00:18.506589+0000","last_became_active":"2023-07-11T00:00:17.397331+0000","last_became_peered":"2023-07-11T00:00:17.397331+0000","last_unstale":"2023-07-11T00:00:18.506589+0000","last_undegraded":"2023-07-11T00:00:18.506589+0000","last_fullsized":"2023-07-11T00:00:18.506589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008780+0000","last_change":"2023-07-11T00:00:16.385414+0000","last_active":"2023-07-11T00:00:19.008780+0000","last_peered":"2023-07-11T00:00:19.008780+0000","last_clean":"2023-07-11T00:00:19.008780+0000","last_became_active":"2023-07-11T00:00:16.385078+0000","last_became_peered":"2023-07-11T00:00:16.385078+0000","last_unstale":"2023-07-11T00:00:19.008780+0000","last_undegraded":"2023-07-11T00:00:19.008780+0000","last_fullsized":"2023-07-11T00:00:19.008780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:48.090690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009326+0000","last_change":"2023-07-11T00:00:17.394701+0000","last_active":"2023-07-11T00:00:19.009326+0000","last_peered":"2023-07-11T00:00:19.009326+0000","last_clean":"2023-07-11T00:00:19.009326+0000","last_became_active":"2023-07-11T00:00:17.394427+0000","last_became_peered":"2023-07-11T00:00:17.394427+0000","last_unstale":"2023-07-11T00:00:19.009326+0000","last_undegraded":"2023-07-11T00:00:19.009326+0000","last_fullsized":"2023-07-11T00:00:19.009326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:18:53.735358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374476+0000","last_change":"2023-07-11T00:00:16.379119+0000","last_active":"2023-07-11T00:00:18.374476+0000","last_peered":"2023-07-11T00:00:18.374476+0000","last_clean":"2023-07-11T00:00:18.374476+0000","last_became_active":"2023-07-11T00:00:16.378596+0000","last_became_peered":"2023-07-11T00:00:16.378596+0000","last_unstale":"2023-07-11T00:00:18.374476+0000","last_undegraded":"2023-07-11T00:00:18.374476+0000","last_fullsized":"2023-07-11T00:00:18.374476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:48.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009450+0000","last_change":"2023-07-11T00:00:17.392798+0000","last_active":"2023-07-11T00:00:19.009450+0000","last_peered":"2023-07-11T00:00:19.009450+0000","last_clean":"2023-07-11T00:00:19.009450+0000","last_became_active":"2023-07-11T00:00:17.392534+0000","last_became_peered":"2023-07-11T00:00:17.392534+0000","last_unstale":"2023-07-11T00:00:19.009450+0000","last_undegraded":"2023-07-11T00:00:19.009450+0000","last_fullsized":"2023-07-11T00:00:19.009450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:02:18.979975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008294+0000","last_change":"2023-07-11T00:00:16.381752+0000","last_active":"2023-07-11T00:00:19.008294+0000","last_peered":"2023-07-11T00:00:19.008294+0000","last_clean":"2023-07-11T00:00:19.008294+0000","last_became_active":"2023-07-11T00:00:16.381446+0000","last_became_peered":"2023-07-11T00:00:16.381446+0000","last_unstale":"2023-07-11T00:00:19.008294+0000","last_undegraded":"2023-07-11T00:00:19.008294+0000","last_fullsized":"2023-07-11T00:00:19.008294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:07:28.418665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009436+0000","last_change":"2023-07-11T00:00:17.381280+0000","last_active":"2023-07-11T00:00:19.009436+0000","last_peered":"2023-07-11T00:00:19.009436+0000","last_clean":"2023-07-11T00:00:19.009436+0000","last_became_active":"2023-07-11T00:00:17.380991+0000","last_became_peered":"2023-07-11T00:00:17.380991+0000","last_unstale":"2023-07-11T00:00:19.009436+0000","last_undegraded":"2023-07-11T00:00:19.009436+0000","last_fullsized":"2023-07-11T00:00:19.009436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:17:21.838060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008404+0000","last_change":"2023-07-11T00:00:16.385241+0000","last_active":"2023-07-11T00:00:19.008404+0000","last_peered":"2023-07-11T00:00:19.008404+0000","last_clean":"2023-07-11T00:00:19.008404+0000","last_became_active":"2023-07-11T00:00:16.384948+0000","last_became_peered":"2023-07-11T00:00:16.384948+0000","last_unstale":"2023-07-11T00:00:19.008404+0000","last_undegraded":"2023-07-11T00:00:19.008404+0000","last_fullsized":"2023-07-11T00:00:19.008404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:44.852995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373444+0000","last_change":"2023-07-11T00:00:17.394512+0000","last_active":"2023-07-11T00:00:18.373444+0000","last_peered":"2023-07-11T00:00:18.373444+0000","last_clean":"2023-07-11T00:00:18.373444+0000","last_became_active":"2023-07-11T00:00:17.394195+0000","last_became_peered":"2023-07-11T00:00:17.394195+0000","last_unstale":"2023-07-11T00:00:18.373444+0000","last_undegraded":"2023-07-11T00:00:18.373444+0000","last_fullsized":"2023-07-11T00:00:18.373444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008794+0000","last_change":"2023-07-11T00:00:16.385203+0000","last_active":"2023-07-11T00:00:19.008794+0000","last_peered":"2023-07-11T00:00:19.008794+0000","last_clean":"2023-07-11T00:00:19.008794+0000","last_became_active":"2023-07-11T00:00:16.384926+0000","last_became_peered":"2023-07-11T00:00:16.384926+0000","last_unstale":"2023-07-11T00:00:19.008794+0000","last_undegraded":"2023-07-11T00:00:19.008794+0000","last_fullsized":"2023-07-11T00:00:19.008794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:31:02.541167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009209+0000","last_change":"2023-07-11T00:00:11.737777+0000","last_active":"2023-07-11T00:00:19.009209+0000","last_peered":"2023-07-11T00:00:19.009209+0000","last_clean":"2023-07-11T00:00:19.009209+0000","last_became_active":"2023-07-11T00:00:11.737518+0000","last_became_peered":"2023-07-11T00:00:11.737518+0000","last_unstale":"2023-07-11T00:00:19.009209+0000","last_undegraded":"2023-07-11T00:00:19.009209+0000","last_fullsized":"2023-07-11T00:00:19.009209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:34:14.575826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007733+0000","last_change":"2023-07-11T00:00:17.392911+0000","last_active":"2023-07-11T00:00:19.007733+0000","last_peered":"2023-07-11T00:00:19.007733+0000","last_clean":"2023-07-11T00:00:19.007733+0000","last_became_active":"2023-07-11T00:00:17.392614+0000","last_became_peered":"2023-07-11T00:00:17.392614+0000","last_unstale":"2023-07-11T00:00:19.007733+0000","last_undegraded":"2023-07-11T00:00:19.007733+0000","last_fullsized":"2023-07-11T00:00:19.007733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:07.213325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008255+0000","last_change":"2023-07-11T00:00:11.270609+0000","last_active":"2023-07-11T00:00:19.008255+0000","last_peered":"2023-07-11T00:00:19.008255+0000","last_clean":"2023-07-11T00:00:19.008255+0000","last_became_active":"2023-07-11T00:00:11.270289+0000","last_became_peered":"2023-07-11T00:00:11.270289+0000","last_unstale":"2023-07-11T00:00:19.008255+0000","last_undegraded":"2023-07-11T00:00:19.008255+0000","last_fullsized":"2023-07-11T00:00:19.008255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:51.405247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.024738+0000","last_change":"2023-07-11T00:00:16.381972+0000","last_active":"2023-07-11T00:00:19.024738+0000","last_peered":"2023-07-11T00:00:19.024738+0000","last_clean":"2023-07-11T00:00:19.024738+0000","last_became_active":"2023-07-11T00:00:16.381691+0000","last_became_peered":"2023-07-11T00:00:16.381691+0000","last_unstale":"2023-07-11T00:00:19.024738+0000","last_undegraded":"2023-07-11T00:00:19.024738+0000","last_fullsized":"2023-07-11T00:00:19.024738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:04.291692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008189+0000","last_change":"2023-07-11T00:00:17.380382+0000","last_active":"2023-07-11T00:00:19.008189+0000","last_peered":"2023-07-11T00:00:19.008189+0000","last_clean":"2023-07-11T00:00:19.008189+0000","last_became_active":"2023-07-11T00:00:17.380071+0000","last_became_peered":"2023-07-11T00:00:17.380071+0000","last_unstale":"2023-07-11T00:00:19.008189+0000","last_undegraded":"2023-07-11T00:00:19.008189+0000","last_fullsized":"2023-07-11T00:00:19.008189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:16.918740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372829+0000","last_change":"2023-07-11T00:00:11.269546+0000","last_active":"2023-07-11T00:00:18.372829+0000","last_peered":"2023-07-11T00:00:18.372829+0000","last_clean":"2023-07-11T00:00:18.372829+0000","last_became_active":"2023-07-11T00:00:11.269178+0000","last_became_peered":"2023-07-11T00:00:11.269178+0000","last_unstale":"2023-07-11T00:00:18.372829+0000","last_undegraded":"2023-07-11T00:00:18.372829+0000","last_fullsized":"2023-07-11T00:00:18.372829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:48:43.866553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008074+0000","last_change":"2023-07-11T00:00:11.270402+0000","last_active":"2023-07-11T00:00:19.008074+0000","last_peered":"2023-07-11T00:00:19.008074+0000","last_clean":"2023-07-11T00:00:19.008074+0000","last_became_active":"2023-07-11T00:00:11.270024+0000","last_became_peered":"2023-07-11T00:00:11.270024+0000","last_unstale":"2023-07-11T00:00:19.008074+0000","last_undegraded":"2023-07-11T00:00:19.008074+0000","last_fullsized":"2023-07-11T00:00:19.008074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:44.333198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506429+0000","last_change":"2023-07-11T00:00:16.384464+0000","last_active":"2023-07-11T00:00:18.506429+0000","last_peered":"2023-07-11T00:00:18.506429+0000","last_clean":"2023-07-11T00:00:18.506429+0000","last_became_active":"2023-07-11T00:00:16.384194+0000","last_became_peered":"2023-07-11T00:00:16.384194+0000","last_unstale":"2023-07-11T00:00:18.506429+0000","last_undegraded":"2023-07-11T00:00:18.506429+0000","last_fullsized":"2023-07-11T00:00:18.506429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:16.741566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506745+0000","last_change":"2023-07-11T00:00:17.398420+0000","last_active":"2023-07-11T00:00:18.506745+0000","last_peered":"2023-07-11T00:00:18.506745+0000","last_clean":"2023-07-11T00:00:18.506745+0000","last_became_active":"2023-07-11T00:00:17.398014+0000","last_became_peered":"2023-07-11T00:00:17.398014+0000","last_unstale":"2023-07-11T00:00:18.506745+0000","last_undegraded":"2023-07-11T00:00:18.506745+0000","last_fullsized":"2023-07-11T00:00:18.506745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008280+0000","last_change":"2023-07-11T00:00:11.518743+0000","last_active":"2023-07-11T00:00:19.008280+0000","last_peered":"2023-07-11T00:00:19.008280+0000","last_clean":"2023-07-11T00:00:19.008280+0000","last_became_active":"2023-07-11T00:00:11.518395+0000","last_became_peered":"2023-07-11T00:00:11.518395+0000","last_unstale":"2023-07-11T00:00:19.008280+0000","last_undegraded":"2023-07-11T00:00:19.008280+0000","last_fullsized":"2023-07-11T00:00:19.008280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:17:42.982331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372725+0000","last_change":"2023-07-11T00:00:16.379506+0000","last_active":"2023-07-11T00:00:18.372725+0000","last_peered":"2023-07-11T00:00:18.372725+0000","last_clean":"2023-07-11T00:00:18.372725+0000","last_became_active":"2023-07-11T00:00:16.379263+0000","last_became_peered":"2023-07-11T00:00:16.379263+0000","last_unstale":"2023-07-11T00:00:18.372725+0000","last_undegraded":"2023-07-11T00:00:18.372725+0000","last_fullsized":"2023-07-11T00:00:18.372725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:43:40.599156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373432+0000","last_change":"2023-07-11T00:00:17.387290+0000","last_active":"2023-07-11T00:00:18.373432+0000","last_peered":"2023-07-11T00:00:18.373432+0000","last_clean":"2023-07-11T00:00:18.373432+0000","last_became_active":"2023-07-11T00:00:17.386701+0000","last_became_peered":"2023-07-11T00:00:17.386701+0000","last_unstale":"2023-07-11T00:00:18.373432+0000","last_undegraded":"2023-07-11T00:00:18.373432+0000","last_fullsized":"2023-07-11T00:00:18.373432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:18:50.354911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007892+0000","last_change":"2023-07-11T00:00:11.518875+0000","last_active":"2023-07-11T00:00:19.007892+0000","last_peered":"2023-07-11T00:00:19.007892+0000","last_clean":"2023-07-11T00:00:19.007892+0000","last_became_active":"2023-07-11T00:00:11.518595+0000","last_became_peered":"2023-07-11T00:00:11.518595+0000","last_unstale":"2023-07-11T00:00:19.007892+0000","last_undegraded":"2023-07-11T00:00:19.007892+0000","last_fullsized":"2023-07-11T00:00:19.007892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:50:51.405247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008089+0000","last_change":"2023-07-11T00:00:16.384893+0000","last_active":"2023-07-11T00:00:19.008089+0000","last_peered":"2023-07-11T00:00:19.008089+0000","last_clean":"2023-07-11T00:00:19.008089+0000","last_became_active":"2023-07-11T00:00:16.384614+0000","last_became_peered":"2023-07-11T00:00:16.384614+0000","last_unstale":"2023-07-11T00:00:19.008089+0000","last_undegraded":"2023-07-11T00:00:19.008089+0000","last_fullsized":"2023-07-11T00:00:19.008089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:15.913324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374261+0000","last_change":"2023-07-11T00:00:17.381906+0000","last_active":"2023-07-11T00:00:18.374261+0000","last_peered":"2023-07-11T00:00:18.374261+0000","last_clean":"2023-07-11T00:00:18.374261+0000","last_became_active":"2023-07-11T00:00:17.381630+0000","last_became_peered":"2023-07-11T00:00:17.381630+0000","last_unstale":"2023-07-11T00:00:18.374261+0000","last_undegraded":"2023-07-11T00:00:18.374261+0000","last_fullsized":"2023-07-11T00:00:18.374261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:12:05.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373405+0000","last_change":"2023-07-11T00:00:11.518769+0000","last_active":"2023-07-11T00:00:18.373405+0000","last_peered":"2023-07-11T00:00:18.373405+0000","last_clean":"2023-07-11T00:00:18.373405+0000","last_became_active":"2023-07-11T00:00:11.518440+0000","last_became_peered":"2023-07-11T00:00:11.518440+0000","last_unstale":"2023-07-11T00:00:18.373405+0000","last_undegraded":"2023-07-11T00:00:18.373405+0000","last_fullsized":"2023-07-11T00:00:18.373405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:11.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.009013+0000","last_change":"2023-07-11T00:00:16.384509+0000","last_active":"2023-07-11T00:00:19.009013+0000","last_peered":"2023-07-11T00:00:19.009013+0000","last_clean":"2023-07-11T00:00:19.009013+0000","last_became_active":"2023-07-11T00:00:16.384064+0000","last_became_peered":"2023-07-11T00:00:16.384064+0000","last_unstale":"2023-07-11T00:00:19.009013+0000","last_undegraded":"2023-07-11T00:00:19.009013+0000","last_fullsized":"2023-07-11T00:00:19.009013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:49.441556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373265+0000","last_change":"2023-07-11T00:00:17.393714+0000","last_active":"2023-07-11T00:00:18.373265+0000","last_peered":"2023-07-11T00:00:18.373265+0000","last_clean":"2023-07-11T00:00:18.373265+0000","last_became_active":"2023-07-11T00:00:17.392964+0000","last_became_peered":"2023-07-11T00:00:17.392964+0000","last_unstale":"2023-07-11T00:00:18.373265+0000","last_undegraded":"2023-07-11T00:00:18.373265+0000","last_fullsized":"2023-07-11T00:00:18.373265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:21:17.746982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374578+0000","last_change":"2023-07-11T00:00:11.518696+0000","last_active":"2023-07-11T00:00:18.374578+0000","last_peered":"2023-07-11T00:00:18.374578+0000","last_clean":"2023-07-11T00:00:18.374578+0000","last_became_active":"2023-07-11T00:00:11.518413+0000","last_became_peered":"2023-07-11T00:00:11.518413+0000","last_unstale":"2023-07-11T00:00:18.374578+0000","last_undegraded":"2023-07-11T00:00:18.374578+0000","last_fullsized":"2023-07-11T00:00:18.374578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:15:01.099550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373125+0000","last_change":"2023-07-11T00:00:16.379703+0000","last_active":"2023-07-11T00:00:18.373125+0000","last_peered":"2023-07-11T00:00:18.373125+0000","last_clean":"2023-07-11T00:00:18.373125+0000","last_became_active":"2023-07-11T00:00:16.379251+0000","last_became_peered":"2023-07-11T00:00:16.379251+0000","last_unstale":"2023-07-11T00:00:18.373125+0000","last_undegraded":"2023-07-11T00:00:18.373125+0000","last_fullsized":"2023-07-11T00:00:18.373125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:25.248576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506437+0000","last_change":"2023-07-11T00:00:17.390220+0000","last_active":"2023-07-11T00:00:18.506437+0000","last_peered":"2023-07-11T00:00:18.506437+0000","last_clean":"2023-07-11T00:00:18.506437+0000","last_became_active":"2023-07-11T00:00:17.389938+0000","last_became_peered":"2023-07-11T00:00:17.389938+0000","last_unstale":"2023-07-11T00:00:18.506437+0000","last_undegraded":"2023-07-11T00:00:18.506437+0000","last_fullsized":"2023-07-11T00:00:18.506437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:29.636904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.374335+0000","last_change":"2023-07-11T00:00:11.269674+0000","last_active":"2023-07-11T00:00:18.374335+0000","last_peered":"2023-07-11T00:00:18.374335+0000","last_clean":"2023-07-11T00:00:18.374335+0000","last_became_active":"2023-07-11T00:00:11.269355+0000","last_became_peered":"2023-07-11T00:00:11.269355+0000","last_unstale":"2023-07-11T00:00:18.374335+0000","last_undegraded":"2023-07-11T00:00:18.374335+0000","last_fullsized":"2023-07-11T00:00:18.374335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:37:20.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373947+0000","last_change":"2023-07-11T00:00:16.386828+0000","last_active":"2023-07-11T00:00:18.373947+0000","last_peered":"2023-07-11T00:00:18.373947+0000","last_clean":"2023-07-11T00:00:18.373947+0000","last_became_active":"2023-07-11T00:00:16.386586+0000","last_became_peered":"2023-07-11T00:00:16.386586+0000","last_unstale":"2023-07-11T00:00:18.373947+0000","last_undegraded":"2023-07-11T00:00:18.373947+0000","last_fullsized":"2023-07-11T00:00:18.373947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:51:15.913324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.372814+0000","last_change":"2023-07-11T00:00:17.393914+0000","last_active":"2023-07-11T00:00:18.372814+0000","last_peered":"2023-07-11T00:00:18.372814+0000","last_clean":"2023-07-11T00:00:18.372814+0000","last_became_active":"2023-07-11T00:00:17.392216+0000","last_became_peered":"2023-07-11T00:00:17.392216+0000","last_unstale":"2023-07-11T00:00:18.372814+0000","last_undegraded":"2023-07-11T00:00:18.372814+0000","last_fullsized":"2023-07-11T00:00:18.372814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:57:15.870619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506667+0000","last_change":"2023-07-11T00:00:16.383581+0000","last_active":"2023-07-11T00:00:18.506667+0000","last_peered":"2023-07-11T00:00:18.506667+0000","last_clean":"2023-07-11T00:00:18.506667+0000","last_became_active":"2023-07-11T00:00:16.383295+0000","last_became_peered":"2023-07-11T00:00:16.383295+0000","last_unstale":"2023-07-11T00:00:18.506667+0000","last_undegraded":"2023-07-11T00:00:18.506667+0000","last_fullsized":"2023-07-11T00:00:18.506667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:17.100187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008310+0000","last_change":"2023-07-11T00:00:17.398128+0000","last_active":"2023-07-11T00:00:19.008310+0000","last_peered":"2023-07-11T00:00:19.008310+0000","last_clean":"2023-07-11T00:00:19.008310+0000","last_became_active":"2023-07-11T00:00:17.397851+0000","last_became_peered":"2023-07-11T00:00:17.397851+0000","last_unstale":"2023-07-11T00:00:19.008310+0000","last_undegraded":"2023-07-11T00:00:19.008310+0000","last_fullsized":"2023-07-11T00:00:19.008310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:00:40.235957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373474+0000","last_change":"2023-07-11T00:00:16.382786+0000","last_active":"2023-07-11T00:00:18.373474+0000","last_peered":"2023-07-11T00:00:18.373474+0000","last_clean":"2023-07-11T00:00:18.373474+0000","last_became_active":"2023-07-11T00:00:16.382519+0000","last_became_peered":"2023-07-11T00:00:16.382519+0000","last_unstale":"2023-07-11T00:00:18.373474+0000","last_undegraded":"2023-07-11T00:00:18.373474+0000","last_fullsized":"2023-07-11T00:00:18.373474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:50:28.631488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008963+0000","last_change":"2023-07-11T00:00:17.396289+0000","last_active":"2023-07-11T00:00:19.008963+0000","last_peered":"2023-07-11T00:00:19.008963+0000","last_clean":"2023-07-11T00:00:19.008963+0000","last_became_active":"2023-07-11T00:00:17.395948+0000","last_became_peered":"2023-07-11T00:00:17.395948+0000","last_unstale":"2023-07-11T00:00:19.008963+0000","last_undegraded":"2023-07-11T00:00:19.008963+0000","last_fullsized":"2023-07-11T00:00:19.008963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:17:25.220101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373988+0000","last_change":"2023-07-11T00:00:16.381779+0000","last_active":"2023-07-11T00:00:18.373988+0000","last_peered":"2023-07-11T00:00:18.373988+0000","last_clean":"2023-07-11T00:00:18.373988+0000","last_became_active":"2023-07-11T00:00:16.381496+0000","last_became_peered":"2023-07-11T00:00:16.381496+0000","last_unstale":"2023-07-11T00:00:18.373988+0000","last_undegraded":"2023-07-11T00:00:18.373988+0000","last_fullsized":"2023-07-11T00:00:18.373988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:04.291692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008966+0000","last_change":"2023-07-11T00:00:17.392394+0000","last_active":"2023-07-11T00:00:19.008966+0000","last_peered":"2023-07-11T00:00:19.008966+0000","last_clean":"2023-07-11T00:00:19.008966+0000","last_became_active":"2023-07-11T00:00:17.391500+0000","last_became_peered":"2023-07-11T00:00:17.391500+0000","last_unstale":"2023-07-11T00:00:19.008966+0000","last_undegraded":"2023-07-11T00:00:19.008966+0000","last_fullsized":"2023-07-11T00:00:19.008966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:45.858410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008803+0000","last_change":"2023-07-11T00:00:16.384057+0000","last_active":"2023-07-11T00:00:19.008803+0000","last_peered":"2023-07-11T00:00:19.008803+0000","last_clean":"2023-07-11T00:00:19.008803+0000","last_became_active":"2023-07-11T00:00:16.383707+0000","last_became_peered":"2023-07-11T00:00:16.383707+0000","last_unstale":"2023-07-11T00:00:19.008803+0000","last_undegraded":"2023-07-11T00:00:19.008803+0000","last_fullsized":"2023-07-11T00:00:19.008803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:07:32.545716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007992+0000","last_change":"2023-07-11T00:00:17.393506+0000","last_active":"2023-07-11T00:00:19.007992+0000","last_peered":"2023-07-11T00:00:19.007992+0000","last_clean":"2023-07-11T00:00:19.007992+0000","last_became_active":"2023-07-11T00:00:17.392891+0000","last_became_peered":"2023-07-11T00:00:17.392891+0000","last_unstale":"2023-07-11T00:00:19.007992+0000","last_undegraded":"2023-07-11T00:00:19.007992+0000","last_fullsized":"2023-07-11T00:00:19.007992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:21:46.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.506934+0000","last_change":"2023-07-11T00:00:16.386794+0000","last_active":"2023-07-11T00:00:18.506934+0000","last_peered":"2023-07-11T00:00:18.506934+0000","last_clean":"2023-07-11T00:00:18.506934+0000","last_became_active":"2023-07-11T00:00:16.386581+0000","last_became_peered":"2023-07-11T00:00:16.386581+0000","last_unstale":"2023-07-11T00:00:18.506934+0000","last_undegraded":"2023-07-11T00:00:18.506934+0000","last_fullsized":"2023-07-11T00:00:18.506934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:15.354518+0000","last_clean_scrub_stamp":"2023-07-11T00:00:15.354518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:18:44.852995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007926+0000","last_change":"2023-07-11T00:00:17.383214+0000","last_active":"2023-07-11T00:00:19.007926+0000","last_peered":"2023-07-11T00:00:19.007926+0000","last_clean":"2023-07-11T00:00:19.007926+0000","last_became_active":"2023-07-11T00:00:17.381360+0000","last_became_peered":"2023-07-11T00:00:17.381360+0000","last_unstale":"2023-07-11T00:00:19.007926+0000","last_undegraded":"2023-07-11T00:00:19.007926+0000","last_fullsized":"2023-07-11T00:00:19.007926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373840+0000","last_change":"2023-07-11T00:00:17.392151+0000","last_active":"2023-07-11T00:00:18.373840+0000","last_peered":"2023-07-11T00:00:18.373840+0000","last_clean":"2023-07-11T00:00:18.373840+0000","last_became_active":"2023-07-11T00:00:17.391869+0000","last_became_peered":"2023-07-11T00:00:17.391869+0000","last_unstale":"2023-07-11T00:00:18.373840+0000","last_undegraded":"2023-07-11T00:00:18.373840+0000","last_fullsized":"2023-07-11T00:00:18.373840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:04:27.161083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.007854+0000","last_change":"2023-07-11T00:00:17.400395+0000","last_active":"2023-07-11T00:00:19.007854+0000","last_peered":"2023-07-11T00:00:19.007854+0000","last_clean":"2023-07-11T00:00:19.007854+0000","last_became_active":"2023-07-11T00:00:17.400124+0000","last_became_peered":"2023-07-11T00:00:17.400124+0000","last_unstale":"2023-07-11T00:00:19.007854+0000","last_undegraded":"2023-07-11T00:00:19.007854+0000","last_fullsized":"2023-07-11T00:00:19.007854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:18.105603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008468+0000","last_change":"2023-07-11T00:00:17.388655+0000","last_active":"2023-07-11T00:00:19.008468+0000","last_peered":"2023-07-11T00:00:19.008468+0000","last_clean":"2023-07-11T00:00:19.008468+0000","last_became_active":"2023-07-11T00:00:17.388372+0000","last_became_peered":"2023-07-11T00:00:17.388372+0000","last_unstale":"2023-07-11T00:00:19.008468+0000","last_undegraded":"2023-07-11T00:00:19.008468+0000","last_fullsized":"2023-07-11T00:00:19.008468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T11:15:05.297107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:19.008602+0000","last_change":"2023-07-11T00:00:17.394965+0000","last_active":"2023-07-11T00:00:19.008602+0000","last_peered":"2023-07-11T00:00:19.008602+0000","last_clean":"2023-07-11T00:00:19.008602+0000","last_became_active":"2023-07-11T00:00:17.394513+0000","last_became_peered":"2023-07-11T00:00:17.394513+0000","last_unstale":"2023-07-11T00:00:19.008602+0000","last_undegraded":"2023-07-11T00:00:19.008602+0000","last_fullsized":"2023-07-11T00:00:19.008602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:30:50.446972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-11T00:00:18.373114+0000","last_change":"2023-07-11T00:00:17.384534+0000","last_active":"2023-07-11T00:00:18.373114+0000","last_peered":"2023-07-11T00:00:18.373114+0000","last_clean":"2023-07-11T00:00:18.373114+0000","last_became_active":"2023-07-11T00:00:17.382062+0000","last_became_peered":"2023-07-11T00:00:17.382062+0000","last_unstale":"2023-07-11T00:00:18.373114+0000","last_undegraded":"2023-07-11T00:00:18.373114+0000","last_fullsized":"2023-07-11T00:00:18.373114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:16.359933+0000","last_clean_scrub_stamp":"2023-07-11T00:00:16.359933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:10:20.060069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":671247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":79681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":80719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:00:26.773 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-11T00:00:26.773 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-11T00:00:26.773 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-11T00:00:26.773 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-11T00:00:26.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.930+0000 7fe0ee6d8700 1 Processor -- start 2023-07-11T00:00:26.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.930+0000 7fe0ee6d8700 1 -- start start 2023-07-11T00:00:26.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.930+0000 7fe0ee6d8700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0e814bf30 0x7fe0e80b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.930+0000 7fe0ee6d8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0e8145fc0 0x7fe0e8153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.930+0000 7fe0ee6d8700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e8070130 con 0x7fe0e8071d20 2023-07-11T00:00:26.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.930+0000 7fe0ee6d8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e8070f80 con 0x7fe0e8145fc0 2023-07-11T00:00:26.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.930+0000 7fe0ee6d8700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8071260 con 0x7fe0e814bf30 2023-07-11T00:00:26.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.930+0000 7fe0ecc75700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0e8145fc0 0x7fe0e8153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.930+0000 7fe0ecc75700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0e8145fc0 0x7fe0e8153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53150/0 (socket says 172.21.15.38:53150) 2023-07-11T00:00:26.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.931+0000 7fe0ecc75700 1 -- 172.21.15.38:0/1106104846 learned_addr learned my addr 172.21.15.38:0/1106104846 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:26.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.931+0000 7fe0e7fff700 1 --2- 172.21.15.38:0/1106104846 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0e814bf30 0x7fe0e80b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.931+0000 7fe0ecc75700 1 -- 172.21.15.38:0/1106104846 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0e814bf30 msgr2=0x7fe0e80b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:26.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.931+0000 7fe0ecc75700 1 --2- 172.21.15.38:0/1106104846 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0e814bf30 0x7fe0e80b8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.931+0000 7fe0ecc75700 1 -- 172.21.15.38:0/1106104846 >> v1:172.21.15.70:6789/0 conn(0x7fe0e8071d20 legacy=0x7fe0e81458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:26.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.931+0000 7fe0ecc75700 1 -- 172.21.15.38:0/1106104846 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e8071540 con 0x7fe0e8145fc0 2023-07-11T00:00:26.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.931+0000 7fe0e7fff700 1 --2- 172.21.15.38:0/1106104846 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0e814bf30 0x7fe0e80b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:26.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.931+0000 7fe0ecc75700 1 --2- 172.21.15.38:0/1106104846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0e8145fc0 0x7fe0e8153080 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009e50 tx=0x7fe0e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbb6536f2f82f16 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:26.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.931+0000 7fe0e6ffd700 1 -- 172.21.15.38:0/1106104846 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000e070 con 0x7fe0e8145fc0 2023-07-11T00:00:26.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.931+0000 7fe0e6ffd700 1 -- 172.21.15.38:0/1106104846 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e0003a20 con 0x7fe0e8145fc0 2023-07-11T00:00:26.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.931+0000 7fe0e6ffd700 1 -- 172.21.15.38:0/1106104846 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0003dd0 con 0x7fe0e8145fc0 2023-07-11T00:00:26.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.932+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/1106104846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0e8145fc0 msgr2=0x7fe0e8153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.932+0000 7fe0ee6d8700 1 --2- 172.21.15.38:0/1106104846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0e8145fc0 0x7fe0e8153080 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009e50 tx=0x7fe0e000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:26.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.932+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/1106104846 shutdown_connections 2023-07-11T00:00:26.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.932+0000 7fe0ee6d8700 1 --2- 172.21.15.38:0/1106104846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0e8145fc0 0x7fe0e8153080 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.932+0000 7fe0ee6d8700 1 --2- 172.21.15.38:0/1106104846 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0e814bf30 0x7fe0e80b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.932+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/1106104846 >> 172.21.15.38:0/1106104846 conn(0x7fe0e80be670 msgr2=0x7fe0e80bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:26.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.932+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/1106104846 shutdown_connections 2023-07-11T00:00:26.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.932+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/1106104846 wait complete. 2023-07-11T00:00:26.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.933+0000 7fe0ee6d8700 1 Processor -- start 2023-07-11T00:00:26.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.933+0000 7fe0ee6d8700 1 -- start start 2023-07-11T00:00:26.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0ee6d8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0e8071d20 0x7fe0e8148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0ee6d8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0e8145fc0 0x7fe0e81e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0ee6d8700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0e814bf30 0x7fe0e80b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0ee6d8700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8148dd0 con 0x7fe0e8145fc0 2023-07-11T00:00:26.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0ee6d8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8146ed0 con 0x7fe0e8071d20 2023-07-11T00:00:26.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0ee6d8700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80b5500 con 0x7fe0e814bf30 2023-07-11T00:00:26.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0e8145fc0 0x7fe0e81e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0e8145fc0 0x7fe0e81e4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53154/0 (socket says 172.21.15.38:53154) 2023-07-11T00:00:26.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e77fe700 1 -- 172.21.15.38:0/68949188 learned_addr learned my addr 172.21.15.38:0/68949188 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:26.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e7fff700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0e8071d20 0x7fe0e8148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0ecc75700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0e814bf30 0x7fe0e80b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e77fe700 1 -- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0e814bf30 msgr2=0x7fe0e80b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e77fe700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0e814bf30 0x7fe0e80b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e77fe700 1 -- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0e8071d20 msgr2=0x7fe0e8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:26.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e77fe700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0e8071d20 0x7fe0e8148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:26.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e77fe700 1 -- 172.21.15.38:0/68949188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0009b30 con 0x7fe0e8145fc0 2023-07-11T00:00:26.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e77fe700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0e8145fc0 0x7fe0e81e4550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c500 tx=0x7fe0dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:26.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e4ff9700 1 -- 172.21.15.38:0/68949188 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc011790 con 0x7fe0e8145fc0 2023-07-11T00:00:26.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e4ff9700 1 -- 172.21.15.38:0/68949188 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc0118f0 con 0x7fe0e8145fc0 2023-07-11T00:00:26.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/68949188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e81e40c0 con 0x7fe0e8145fc0 2023-07-11T00:00:26.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0e4ff9700 1 -- 172.21.15.38:0/68949188 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc011ca0 con 0x7fe0e8145fc0 2023-07-11T00:00:26.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.934+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/68949188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e80b5220 con 0x7fe0e8145fc0 2023-07-11T00:00:26.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.935+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/68949188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e81e4250 con 0x7fe0e8145fc0 2023-07-11T00:00:26.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.936+0000 7fe0e4ff9700 1 -- 172.21.15.38:0/68949188 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe0dc01c460 con 0x7fe0e8145fc0 2023-07-11T00:00:26.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.936+0000 7fe0e4ff9700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe0d406ace0 0x7fe0d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:26.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.936+0000 7fe0e4ff9700 1 -- 172.21.15.38:0/68949188 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0dc089320 con 0x7fe0e8145fc0 2023-07-11T00:00:26.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.937+0000 7fe0e7fff700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe0d406ace0 0x7fe0d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:26.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.937+0000 7fe0e7fff700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe0d406ace0 0x7fe0d406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8006fd0 tx=0x7fe0d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:26.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:26.941+0000 7fe0e4ff9700 1 -- 172.21.15.38:0/68949188 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe0dc0543d0 con 0x7fe0e8145fc0 2023-07-11T00:00:27.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.180+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/68949188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe0e80b6350 con 0x7fe0e8145fc0 2023-07-11T00:00:27.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.181+0000 7fe0e4ff9700 1 -- 172.21.15.38:0/68949188 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe0dc0579f0 con 0x7fe0e8145fc0 2023-07-11T00:00:27.183 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:27.183 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-11T00:00:27.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe0d406ace0 msgr2=0x7fe0d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe0d406ace0 0x7fe0d406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8006fd0 tx=0x7fe0d8008040 comp rx=0 tx=0).stop 2023-07-11T00:00:27.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/68949188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0e8145fc0 msgr2=0x7fe0e81e4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0e8145fc0 0x7fe0e81e4550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c500 tx=0x7fe0dc00c8c0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/68949188 shutdown_connections 2023-07-11T00:00:27.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe0d406ace0 0x7fe0d406d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0e814bf30 0x7fe0e80b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0e8071d20 0x7fe0e8148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 --2- 172.21.15.38:0/68949188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0e8145fc0 0x7fe0e81e4550 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/68949188 >> 172.21.15.38:0/68949188 conn(0x7fe0e80be670 msgr2=0x7fe0e80bdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:27.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/68949188 shutdown_connections 2023-07-11T00:00:27.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.183+0000 7fe0ee6d8700 1 -- 172.21.15.38:0/68949188 wait complete. 2023-07-11T00:00:27.197 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-11T00:00:27.198 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.322+0000 7fd6bb5f0700 1 Processor -- start 2023-07-11T00:00:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.322+0000 7fd6bb5f0700 1 -- start start 2023-07-11T00:00:27.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.323+0000 7fd6bb5f0700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd6b406b120 0x7fd6b414bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.323+0000 7fd6bb5f0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6b4071590 0x7fd6b414c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.323+0000 7fd6bb5f0700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b4142310 0x7fd6b4142760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.323+0000 7fd6bb5f0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b4071c60 con 0x7fd6b4071590 2023-07-11T00:00:27.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.323+0000 7fd6bb5f0700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b4070fd0 con 0x7fd6b406b120 2023-07-11T00:00:27.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.323+0000 7fd6bb5f0700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40712b0 con 0x7fd6b4142310 2023-07-11T00:00:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.323+0000 7fd6b8b8b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6b4071590 0x7fd6b414c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6b8b8b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6b4071590 0x7fd6b414c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53170/0 (socket says 172.21.15.38:53170) 2023-07-11T00:00:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6b8b8b700 1 -- 172.21.15.38:0/3962388381 learned_addr learned my addr 172.21.15.38:0/3962388381 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6b9b8d700 1 --2- 172.21.15.38:0/3962388381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b4142310 0x7fd6b4142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6b938c700 1 --2- 172.21.15.38:0/3962388381 >> v2:172.21.15.70:3300/0 conn(0x7fd6b406b120 0x7fd6b414bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6b8b8b700 1 -- 172.21.15.38:0/3962388381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b4142310 msgr2=0x7fd6b4142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6b8b8b700 1 --2- 172.21.15.38:0/3962388381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b4142310 0x7fd6b4142760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6b8b8b700 1 -- 172.21.15.38:0/3962388381 >> v2:172.21.15.70:3300/0 conn(0x7fd6b406b120 msgr2=0x7fd6b414bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6b8b8b700 1 --2- 172.21.15.38:0/3962388381 >> v2:172.21.15.70:3300/0 conn(0x7fd6b406b120 0x7fd6b414bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6b8b8b700 1 -- 172.21.15.38:0/3962388381 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40ba240 con 0x7fd6b4071590 2023-07-11T00:00:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6b8b8b700 1 --2- 172.21.15.38:0/3962388381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6b4071590 0x7fd6b414c1d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd6b406e7d0 tx=0x7fd6a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9887eba5a51d318 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6abfff700 1 -- 172.21.15.38:0/3962388381 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a400b870 con 0x7fd6b4071590 2023-07-11T00:00:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6abfff700 1 -- 172.21.15.38:0/3962388381 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a400b9d0 con 0x7fd6b4071590 2023-07-11T00:00:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.324+0000 7fd6abfff700 1 -- 172.21.15.38:0/3962388381 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a400bd60 con 0x7fd6b4071590 2023-07-11T00:00:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.325+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/3962388381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6b4071590 msgr2=0x7fd6b414c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.325+0000 7fd6bb5f0700 1 --2- 172.21.15.38:0/3962388381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6b4071590 0x7fd6b414c1d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd6b406e7d0 tx=0x7fd6a4009bd0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.325+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/3962388381 shutdown_connections 2023-07-11T00:00:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.325+0000 7fd6bb5f0700 1 --2- 172.21.15.38:0/3962388381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b4142310 0x7fd6b4142760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.325+0000 7fd6bb5f0700 1 --2- 172.21.15.38:0/3962388381 >> v2:172.21.15.70:3300/0 conn(0x7fd6b406b120 0x7fd6b414bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.325+0000 7fd6bb5f0700 1 --2- 172.21.15.38:0/3962388381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6b4071590 0x7fd6b414c1d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.325+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/3962388381 >> 172.21.15.38:0/3962388381 conn(0x7fd6b40bd980 msgr2=0x7fd6b40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.325+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/3962388381 shutdown_connections 2023-07-11T00:00:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.325+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/3962388381 wait complete. 2023-07-11T00:00:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.326+0000 7fd6bb5f0700 1 Processor -- start 2023-07-11T00:00:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.326+0000 7fd6bb5f0700 1 -- start start 2023-07-11T00:00:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6bb5f0700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b406b120 0x7fd6b413d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6bb5f0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6b4071590 0x7fd6b41e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6bb5f0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6b4142310 0x7fd6b4146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6bb5f0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40703e0 con 0x7fd6b4071590 2023-07-11T00:00:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6bb5f0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40b4de0 con 0x7fd6b4142310 2023-07-11T00:00:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6bb5f0700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b413df00 con 0x7fd6b406b120 2023-07-11T00:00:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6b8b8b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6b4071590 0x7fd6b41e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6b8b8b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6b4071590 0x7fd6b41e32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53186/0 (socket says 172.21.15.38:53186) 2023-07-11T00:00:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6b8b8b700 1 -- 172.21.15.38:0/2191603939 learned_addr learned my addr 172.21.15.38:0/2191603939 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6b938c700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b406b120 0x7fd6b413d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6b9b8d700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6b4142310 0x7fd6b4146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6b8b8b700 1 -- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b406b120 msgr2=0x7fd6b413d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6b8b8b700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b406b120 0x7fd6b413d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6b8b8b700 1 -- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6b4142310 msgr2=0x7fd6b4146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.327+0000 7fd6b8b8b700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6b4142310 0x7fd6b4146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.328+0000 7fd6b8b8b700 1 -- 172.21.15.38:0/2191603939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4009550 con 0x7fd6b4071590 2023-07-11T00:00:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.328+0000 7fd6b8b8b700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6b4071590 0x7fd6b41e32d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4000c00 tx=0x7fd6a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.328+0000 7fd6a9ffb700 1 -- 172.21.15.38:0/2191603939 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4004540 con 0x7fd6b4071590 2023-07-11T00:00:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.328+0000 7fd6a9ffb700 1 -- 172.21.15.38:0/2191603939 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a40036a0 con 0x7fd6b4071590 2023-07-11T00:00:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.328+0000 7fd6a9ffb700 1 -- 172.21.15.38:0/2191603939 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4003a50 con 0x7fd6b4071590 2023-07-11T00:00:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.328+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/2191603939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b4147580 con 0x7fd6b4071590 2023-07-11T00:00:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.328+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/2191603939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b40b6d80 con 0x7fd6b4071590 2023-07-11T00:00:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.329+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/2191603939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b4074360 con 0x7fd6b4071590 2023-07-11T00:00:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.330+0000 7fd6a9ffb700 1 -- 172.21.15.38:0/2191603939 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6a4021070 con 0x7fd6b4071590 2023-07-11T00:00:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.330+0000 7fd6a9ffb700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd69806ace0 0x7fd69806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.331+0000 7fd6a9ffb700 1 -- 172.21.15.38:0/2191603939 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6a408ab70 con 0x7fd6b4071590 2023-07-11T00:00:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.331+0000 7fd6b938c700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd69806ace0 0x7fd69806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.331+0000 7fd6b938c700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd69806ace0 0x7fd69806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000c900 tx=0x7fd6b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.335+0000 7fd6a9ffb700 1 -- 172.21.15.38:0/2191603939 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd6a4055c10 con 0x7fd6b4071590 2023-07-11T00:00:27.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.537+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/2191603939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6b40b43c0 con 0x7fd6b4071590 2023-07-11T00:00:27.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.538+0000 7fd6a9ffb700 1 -- 172.21.15.38:0/2191603939 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7fd6a4015090 con 0x7fd6b4071590 2023-07-11T00:00:27.540 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:27.540 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:27.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd69806ace0 msgr2=0x7fd69806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd69806ace0 0x7fd69806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000c900 tx=0x7fd6b0008040 comp rx=0 tx=0).stop 2023-07-11T00:00:27.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/2191603939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6b4071590 msgr2=0x7fd6b41e32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6b4071590 0x7fd6b41e32d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4000c00 tx=0x7fd6a4004750 comp rx=0 tx=0).stop 2023-07-11T00:00:27.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/2191603939 shutdown_connections 2023-07-11T00:00:27.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fd69806ace0 0x7fd69806d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6b4142310 0x7fd6b4146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b406b120 0x7fd6b413d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 --2- 172.21.15.38:0/2191603939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6b4071590 0x7fd6b41e32d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/2191603939 >> 172.21.15.38:0/2191603939 conn(0x7fd6b40bd980 msgr2=0x7fd6b4069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:27.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/2191603939 shutdown_connections 2023-07-11T00:00:27.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.540+0000 7fd6bb5f0700 1 -- 172.21.15.38:0/2191603939 wait complete. 2023-07-11T00:00:27.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:00:14.572121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:00:15.763698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:00:27.555 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:00:27.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.682+0000 7f5a56551700 1 Processor -- start 2023-07-11T00:00:27.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.682+0000 7f5a56551700 1 -- start start 2023-07-11T00:00:27.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a56551700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5a501449d0 0x7f5a5014db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a56551700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5a500bc810 0x7f5a500ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a56551700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a500b8620 con 0x7f5a500b8d90 2023-07-11T00:00:27.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a56551700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a500b97a0 con 0x7f5a500bc810 2023-07-11T00:00:27.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a56551700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a50144da0 con 0x7f5a501449d0 2023-07-11T00:00:27.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a4f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5a500bc810 0x7f5a500ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a54aee700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5a500b8d90 0x7f5a5006ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54510/0 (socket says 172.21.15.38:54510) 2023-07-11T00:00:27.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a54aee700 1 -- 172.21.15.38:0/860538568 learned_addr learned my addr 172.21.15.38:0/860538568 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:27.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a4ffff700 1 --2- 172.21.15.38:0/860538568 >> v2:172.21.15.70:3300/0 conn(0x7f5a501449d0 0x7f5a5014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a4f7fe700 1 -- 172.21.15.38:0/860538568 >> v2:172.21.15.70:3300/0 conn(0x7f5a501449d0 msgr2=0x7f5a5014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:27.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a4f7fe700 1 --2- 172.21.15.38:0/860538568 >> v2:172.21.15.70:3300/0 conn(0x7f5a501449d0 0x7f5a5014db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a4f7fe700 1 -- 172.21.15.38:0/860538568 >> v1:172.21.15.38:6789/0 conn(0x7f5a500b8d90 legacy=0x7f5a5006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a4f7fe700 1 -- 172.21.15.38:0/860538568 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a500b8900 con 0x7f5a500bc810 2023-07-11T00:00:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.683+0000 7f5a4effd700 1 -- 172.21.15.38:0/860538568 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810119891 0 0) 0x7f5a500b8620 con 0x7f5a500b8d90 2023-07-11T00:00:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a4f7fe700 1 --2- 172.21.15.38:0/860538568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a500bc810 0x7f5a500ba530 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5a5006cbe0 tx=0x7f5a40009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3cd3deb601be9f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a4effd700 1 -- 172.21.15.38:0/860538568 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40011830 con 0x7f5a500bc810 2023-07-11T00:00:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a4effd700 1 -- 172.21.15.38:0/860538568 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a40011990 con 0x7f5a500bc810 2023-07-11T00:00:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a4effd700 1 -- 172.21.15.38:0/860538568 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40011d20 con 0x7f5a500bc810 2023-07-11T00:00:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a56551700 1 -- 172.21.15.38:0/860538568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a500bc810 msgr2=0x7f5a500ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a56551700 1 --2- 172.21.15.38:0/860538568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a500bc810 0x7f5a500ba530 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5a5006cbe0 tx=0x7f5a40009b20 comp rx=0 tx=0).stop 2023-07-11T00:00:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a56551700 1 -- 172.21.15.38:0/860538568 shutdown_connections 2023-07-11T00:00:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a56551700 1 --2- 172.21.15.38:0/860538568 >> v2:172.21.15.70:3300/0 conn(0x7f5a501449d0 0x7f5a5014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a56551700 1 --2- 172.21.15.38:0/860538568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a500bc810 0x7f5a500ba530 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a56551700 1 -- 172.21.15.38:0/860538568 >> 172.21.15.38:0/860538568 conn(0x7f5a500c0860 msgr2=0x7f5a500c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a56551700 1 -- 172.21.15.38:0/860538568 shutdown_connections 2023-07-11T00:00:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.684+0000 7f5a56551700 1 -- 172.21.15.38:0/860538568 wait complete. 2023-07-11T00:00:27.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.685+0000 7f5a56551700 1 Processor -- start 2023-07-11T00:00:27.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a56551700 1 -- start start 2023-07-11T00:00:27.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a56551700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a500b8d90 0x7f5a501e2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a56551700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a500bc810 0x7f5a501d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a56551700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a501449d0 0x7f5a50147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a56551700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a50147e80 con 0x7f5a500bc810 2023-07-11T00:00:27.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a56551700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a501d52e0 con 0x7f5a500b8d90 2023-07-11T00:00:27.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a56551700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a500b6320 con 0x7f5a501449d0 2023-07-11T00:00:27.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a4f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a500bc810 0x7f5a501d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a4f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a500bc810 0x7f5a501d5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53192/0 (socket says 172.21.15.38:53192) 2023-07-11T00:00:27.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a4f7fe700 1 -- 172.21.15.38:0/288717612 learned_addr learned my addr 172.21.15.38:0/288717612 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:27.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a54aee700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a501449d0 0x7f5a50147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.686+0000 7f5a4ffff700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a500b8d90 0x7f5a501e2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a4f7fe700 1 -- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a501449d0 msgr2=0x7f5a50147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a4f7fe700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a501449d0 0x7f5a50147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a4f7fe700 1 -- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a500b8d90 msgr2=0x7f5a501e2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a4f7fe700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a500b8d90 0x7f5a501e2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a4f7fe700 1 -- 172.21.15.38:0/288717612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400094a0 con 0x7f5a500bc810 2023-07-11T00:00:27.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a4ffff700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a500b8d90 0x7f5a501e2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:27.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a4f7fe700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a500bc810 0x7f5a501d5db0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009b60 tx=0x7f5a40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:27.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a4cff9700 1 -- 172.21.15.38:0/288717612 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400045d0 con 0x7f5a500bc810 2023-07-11T00:00:27.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a4cff9700 1 -- 172.21.15.38:0/288717612 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4001f070 con 0x7f5a500bc810 2023-07-11T00:00:27.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a56551700 1 -- 172.21.15.38:0/288717612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a501d5920 con 0x7f5a500bc810 2023-07-11T00:00:27.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a4cff9700 1 -- 172.21.15.38:0/288717612 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400038e0 con 0x7f5a500bc810 2023-07-11T00:00:27.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.687+0000 7f5a56551700 1 -- 172.21.15.38:0/288717612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a501d7280 con 0x7f5a500bc810 2023-07-11T00:00:27.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.688+0000 7f5a56551700 1 -- 172.21.15.38:0/288717612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a50074360 con 0x7f5a500bc810 2023-07-11T00:00:27.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.688+0000 7f5a4cff9700 1 -- 172.21.15.38:0/288717612 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a40003a40 con 0x7f5a500bc810 2023-07-11T00:00:27.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.689+0000 7f5a4cff9700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a3006ace0 0x7f5a3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:27.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.689+0000 7f5a4cff9700 1 -- 172.21.15.38:0/288717612 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a40021070 con 0x7f5a500bc810 2023-07-11T00:00:27.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.689+0000 7f5a4ffff700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a3006ace0 0x7f5a3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:27.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.689+0000 7f5a4ffff700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a3006ace0 0x7f5a3006d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800ba70 tx=0x7f5a38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:27.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.693+0000 7f5a4cff9700 1 -- 172.21.15.38:0/288717612 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5a40091080 con 0x7f5a500bc810 2023-07-11T00:00:27.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.892+0000 7f5a56551700 1 -- 172.21.15.38:0/288717612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a500bc330 con 0x7f5a500bc810 2023-07-11T00:00:27.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.892+0000 7f5a4cff9700 1 -- 172.21.15.38:0/288717612 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a400150a0 con 0x7f5a500bc810 2023-07-11T00:00:27.895 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:00:27.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 -- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a3006ace0 msgr2=0x7f5a3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a3006ace0 0x7f5a3006d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800ba70 tx=0x7f5a38008040 comp rx=0 tx=0).stop 2023-07-11T00:00:27.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 -- 172.21.15.38:0/288717612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a500bc810 msgr2=0x7f5a501d5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:27.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a500bc810 0x7f5a501d5db0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009b60 tx=0x7f5a40004750 comp rx=0 tx=0).stop 2023-07-11T00:00:27.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 -- 172.21.15.38:0/288717612 shutdown_connections 2023-07-11T00:00:27.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a3006ace0 0x7f5a3006d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a501449d0 0x7f5a50147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a500b8d90 0x7f5a501e2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 --2- 172.21.15.38:0/288717612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a500bc810 0x7f5a501d5db0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:27.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 -- 172.21.15.38:0/288717612 >> 172.21.15.38:0/288717612 conn(0x7f5a500c0860 msgr2=0x7f5a500baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:27.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 -- 172.21.15.38:0/288717612 shutdown_connections 2023-07-11T00:00:27.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:27.895+0000 7f5a56551700 1 -- 172.21.15.38:0/288717612 wait complete. 2023-07-11T00:00:27.908 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:00:28.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.035+0000 7f7699e4a700 1 Processor -- start 2023-07-11T00:00:28.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.035+0000 7f7699e4a700 1 -- start start 2023-07-11T00:00:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.036+0000 7f7699e4a700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f76940b8d90 0x7f769406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.036+0000 7f7699e4a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76940b8620 con 0x7f76940bc810 2023-07-11T00:00:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.036+0000 7f7699e4a700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76940b8900 con 0x7f76941449d0 2023-07-11T00:00:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.036+0000 7f7692ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f76940bc810 0x7f76940ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54518/0 (socket says 172.21.15.38:54518) 2023-07-11T00:00:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.036+0000 7f7692ffd700 1 -- 172.21.15.38:0/754447710 learned_addr learned my addr 172.21.15.38:0/754447710 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.036+0000 7f7699e4a700 1 -- 172.21.15.38:0/754447710 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76940b97a0 con 0x7f76940b8d90 2023-07-11T00:00:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.036+0000 7f7693fff700 1 --2- 172.21.15.38:0/754447710 >> v2:172.21.15.70:3300/0 conn(0x7f76940b8d90 0x7f769406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.036+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214519128 0 0) 0x7f76940b8620 con 0x7f76940bc810 2023-07-11T00:00:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.036+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76800035b0 con 0x7f76940bc810 2023-07-11T00:00:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271133540 0 0) 0x7f76940b8900 con 0x7f76941449d0 2023-07-11T00:00:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76940b8620 con 0x7f76941449d0 2023-07-11T00:00:28.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88100918 0 0) 0x7f76800035b0 con 0x7f76940bc810 2023-07-11T00:00:28.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 >> v2:172.21.15.70:3300/0 conn(0x7f76940b8d90 msgr2=0x7f769406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:28.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 --2- 172.21.15.38:0/754447710 >> v2:172.21.15.70:3300/0 conn(0x7f76940b8d90 0x7f769406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 >> v1:172.21.15.70:6789/0 conn(0x7f76941449d0 legacy=0x7f769414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76940bac40 con 0x7f76940bc810 2023-07-11T00:00:28.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f767c001670 con 0x7f76940bc810 2023-07-11T00:00:28.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 >> v1:172.21.15.38:6789/0 conn(0x7f76940bc810 legacy=0x7f76940ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 --2- 172.21.15.38:0/754447710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 0x7f7680003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 --2- 172.21.15.38:0/754447710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7680004850 0x7f7680004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 --2- 172.21.15.38:0/754447710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7680005200 0x7f768000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76940b97a0 con 0x7f7680003b90 2023-07-11T00:00:28.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768000c000 con 0x7f7680004850 2023-07-11T00:00:28.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768000c190 con 0x7f7680005200 2023-07-11T00:00:28.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f7693fff700 1 --2- 172.21.15.38:0/754447710 >> v2:172.21.15.70:3300/0 conn(0x7f76940b8d90 0x7f769406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:28.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76937fe700 1 --2- 172.21.15.38:0/754447710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 0x7f7680003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f7692ffd700 1 --2- 172.21.15.38:0/754447710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7680004850 0x7f7680004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f7693fff700 1 --2- 172.21.15.38:0/754447710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7680005200 0x7f768000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76937fe700 1 -- 172.21.15.38:0/754447710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7680005200 msgr2=0x7f768000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76937fe700 1 --2- 172.21.15.38:0/754447710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7680005200 0x7f768000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76937fe700 1 -- 172.21.15.38:0/754447710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7680004850 msgr2=0x7f7680004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76937fe700 1 --2- 172.21.15.38:0/754447710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7680004850 0x7f7680004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76937fe700 1 -- 172.21.15.38:0/754447710 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76800035b0 con 0x7f7680003b90 2023-07-11T00:00:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f7693fff700 1 -- 172.21.15.38:0/754447710 reap_dead start 2023-07-11T00:00:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76937fe700 1 --2- 172.21.15.38:0/754447710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 0x7f7680003f80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7684001930 tx=0x7f7680005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce2bcef203d0144 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76840052d0 con 0x7f7680003b90 2023-07-11T00:00:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7684005430 con 0x7f7680003b90 2023-07-11T00:00:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.037+0000 7f76927fc700 1 -- 172.21.15.38:0/754447710 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76840038c0 con 0x7f7680003b90 2023-07-11T00:00:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.038+0000 7f7699e4a700 1 -- 172.21.15.38:0/754447710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 msgr2=0x7f7680003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.038+0000 7f7699e4a700 1 --2- 172.21.15.38:0/754447710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 0x7f7680003f80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7684001930 tx=0x7f7680005880 comp rx=0 tx=0).stop 2023-07-11T00:00:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.038+0000 7f7699e4a700 1 -- 172.21.15.38:0/754447710 shutdown_connections 2023-07-11T00:00:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.038+0000 7f7699e4a700 1 --2- 172.21.15.38:0/754447710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 0x7f7680003f80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.038+0000 7f7699e4a700 1 -- 172.21.15.38:0/754447710 >> 172.21.15.38:0/754447710 conn(0x7f76940c0860 msgr2=0x7f76940c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.038+0000 7f7699e4a700 1 -- 172.21.15.38:0/754447710 shutdown_connections 2023-07-11T00:00:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.038+0000 7f7699e4a700 1 -- 172.21.15.38:0/754447710 wait complete. 2023-07-11T00:00:28.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.039+0000 7f7699e4a700 1 Processor -- start 2023-07-11T00:00:28.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.039+0000 7f7699e4a700 1 -- start start 2023-07-11T00:00:28.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f7699e4a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 0x7f7694148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f7699e4a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76940b2d70 0x7f76940b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f7699e4a700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76940b39a0 0x7f76940a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f7699e4a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76940b31e0 con 0x7f7680003b90 2023-07-11T00:00:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f7699e4a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76940b25f0 con 0x7f76940b2d70 2023-07-11T00:00:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f7699e4a700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76940b4320 con 0x7f76940b39a0 2023-07-11T00:00:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f76937fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 0x7f7694148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f76937fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 0x7f7694148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53208/0 (socket says 172.21.15.38:53208) 2023-07-11T00:00:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f76937fe700 1 -- 172.21.15.38:0/2562822221 learned_addr learned my addr 172.21.15.38:0/2562822221 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f7693fff700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76940b39a0 0x7f76940a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f7692ffd700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76940b2d70 0x7f76940b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f76937fe700 1 -- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76940b39a0 msgr2=0x7f76940a5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f76937fe700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76940b39a0 0x7f76940a5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f76937fe700 1 -- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76940b2d70 msgr2=0x7f76940b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f76937fe700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76940b2d70 0x7f76940b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.040+0000 7f76937fe700 1 -- 172.21.15.38:0/2562822221 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769414b110 con 0x7f7680003b90 2023-07-11T00:00:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.041+0000 7f76937fe700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 0x7f7694148420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7684005040 tx=0x7f76840012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.041+0000 7f768bfff700 1 -- 172.21.15.38:0/2562822221 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684006ea0 con 0x7f7680003b90 2023-07-11T00:00:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.041+0000 7f768bfff700 1 -- 172.21.15.38:0/2562822221 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7684001d60 con 0x7f7680003b90 2023-07-11T00:00:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.041+0000 7f768bfff700 1 -- 172.21.15.38:0/2562822221 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684007260 con 0x7f7680003b90 2023-07-11T00:00:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.041+0000 7f7699e4a700 1 -- 172.21.15.38:0/2562822221 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76940b2850 con 0x7f7680003b90 2023-07-11T00:00:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.041+0000 7f7699e4a700 1 -- 172.21.15.38:0/2562822221 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769414a580 con 0x7f7680003b90 2023-07-11T00:00:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.042+0000 7f7699e4a700 1 -- 172.21.15.38:0/2562822221 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7694074360 con 0x7f7680003b90 2023-07-11T00:00:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.042+0000 7f768bfff700 1 -- 172.21.15.38:0/2562822221 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76840073c0 con 0x7f7680003b90 2023-07-11T00:00:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.043+0000 7f768bfff700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f767406ace0 0x7f767406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.043+0000 7f768bfff700 1 -- 172.21.15.38:0/2562822221 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7684089c30 con 0x7f7680003b90 2023-07-11T00:00:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.043+0000 7f7692ffd700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f767406ace0 0x7f767406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.043+0000 7f7692ffd700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f767406ace0 0x7f767406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f76940b6f10 tx=0x7f767c001e00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.047+0000 7f768bfff700 1 -- 172.21.15.38:0/2562822221 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7684054cd0 con 0x7f7680003b90 2023-07-11T00:00:28.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.245+0000 7f7699e4a700 1 -- 172.21.15.38:0/2562822221 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f769414a580 con 0x7f7680003b90 2023-07-11T00:00:28.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.245+0000 7f768bfff700 1 -- 172.21.15.38:0/2562822221 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7684017020 con 0x7f7680003b90 2023-07-11T00:00:28.247 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:00:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.247+0000 7f7699e4a700 1 -- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f767406ace0 msgr2=0x7f767406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.247+0000 7f7699e4a700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f767406ace0 0x7f767406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f76940b6f10 tx=0x7f767c001e00 comp rx=0 tx=0).stop 2023-07-11T00:00:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.248+0000 7f7699e4a700 1 -- 172.21.15.38:0/2562822221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 msgr2=0x7f7694148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.248+0000 7f7699e4a700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 0x7f7694148420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7684005040 tx=0x7f76840012d0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.248+0000 7f7699e4a700 1 -- 172.21.15.38:0/2562822221 shutdown_connections 2023-07-11T00:00:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.248+0000 7f7699e4a700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f767406ace0 0x7f767406d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.248+0000 7f7699e4a700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76940b39a0 0x7f76940a5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.248+0000 7f7699e4a700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7680003b90 0x7f7694148420 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.248+0000 7f7699e4a700 1 --2- 172.21.15.38:0/2562822221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76940b2d70 0x7f76940b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.248+0000 7f7699e4a700 1 -- 172.21.15.38:0/2562822221 >> 172.21.15.38:0/2562822221 conn(0x7f76940c0860 msgr2=0x7f76940bae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:28.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.248+0000 7f7699e4a700 1 -- 172.21.15.38:0/2562822221 shutdown_connections 2023-07-11T00:00:28.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.248+0000 7f7699e4a700 1 -- 172.21.15.38:0/2562822221 wait complete. 2023-07-11T00:00:28.261 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:00:28.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.388+0000 7f2daea27700 1 Processor -- start 2023-07-11T00:00:28.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.388+0000 7f2daea27700 1 -- start start 2023-07-11T00:00:28.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2daea27700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2da806b120 0x7f2da80b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2daea27700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2da81444c0 0x7f2da8144920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2daea27700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da8070410 con 0x7f2da814aa40 2023-07-11T00:00:28.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2daea27700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da80b9590 con 0x7f2da806b120 2023-07-11T00:00:28.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2daea27700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da806ef60 con 0x7f2da81444c0 2023-07-11T00:00:28.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2da7fff700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2da806b120 0x7f2da80b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2dacfc4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2da81444c0 0x7f2da8144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2da77fe700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f2da814aa40 0x7f2da814aec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:57322/0 (socket says 172.21.15.38:57322) 2023-07-11T00:00:28.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2da77fe700 1 -- 172.21.15.38:0/2777541576 learned_addr learned my addr 172.21.15.38:0/2777541576 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:28.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2da7fff700 1 -- 172.21.15.38:0/2777541576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2da81444c0 msgr2=0x7f2da8144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:28.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2da7fff700 1 --2- 172.21.15.38:0/2777541576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2da81444c0 0x7f2da8144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2da7fff700 1 -- 172.21.15.38:0/2777541576 >> v1:172.21.15.70:6789/0 conn(0x7f2da814aa40 legacy=0x7f2da814aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2da7fff700 1 -- 172.21.15.38:0/2777541576 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da806f240 con 0x7f2da806b120 2023-07-11T00:00:28.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.389+0000 7f2da6ffd700 1 -- 172.21.15.38:0/2777541576 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291109655 0 0) 0x7f2da8070410 con 0x7f2da814aa40 2023-07-11T00:00:28.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2da7fff700 1 --2- 172.21.15.38:0/2777541576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806b120 0x7f2da80b8cd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009840 tx=0x7f2d98009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b44623480056d0eb server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:28.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2da6ffd700 1 -- 172.21.15.38:0/2777541576 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98011830 con 0x7f2da806b120 2023-07-11T00:00:28.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2da6ffd700 1 -- 172.21.15.38:0/2777541576 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d98011990 con 0x7f2da806b120 2023-07-11T00:00:28.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2da6ffd700 1 -- 172.21.15.38:0/2777541576 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98011d20 con 0x7f2da806b120 2023-07-11T00:00:28.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2daea27700 1 -- 172.21.15.38:0/2777541576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806b120 msgr2=0x7f2da80b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2daea27700 1 --2- 172.21.15.38:0/2777541576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806b120 0x7f2da80b8cd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009840 tx=0x7f2d98009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:28.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2daea27700 1 -- 172.21.15.38:0/2777541576 shutdown_connections 2023-07-11T00:00:28.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2daea27700 1 --2- 172.21.15.38:0/2777541576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2da81444c0 0x7f2da8144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2daea27700 1 --2- 172.21.15.38:0/2777541576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806b120 0x7f2da80b8cd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2daea27700 1 -- 172.21.15.38:0/2777541576 >> 172.21.15.38:0/2777541576 conn(0x7f2da80bd980 msgr2=0x7f2da80b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:28.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2daea27700 1 -- 172.21.15.38:0/2777541576 shutdown_connections 2023-07-11T00:00:28.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.390+0000 7f2daea27700 1 -- 172.21.15.38:0/2777541576 wait complete. 2023-07-11T00:00:28.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.391+0000 7f2daea27700 1 Processor -- start 2023-07-11T00:00:28.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2daea27700 1 -- start start 2023-07-11T00:00:28.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2daea27700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806b120 0x7f2da813f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2daea27700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2da81444c0 0x7f2da81475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2daea27700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2da814aa40 0x7f2da81e3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2daea27700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da813f7d0 con 0x7f2da81444c0 2023-07-11T00:00:28.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2daea27700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8147b10 con 0x7f2da806b120 2023-07-11T00:00:28.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2daea27700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da81e3390 con 0x7f2da814aa40 2023-07-11T00:00:28.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2da77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2da81444c0 0x7f2da81475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2da77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2da81444c0 0x7f2da81475d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53220/0 (socket says 172.21.15.38:53220) 2023-07-11T00:00:28.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2da77fe700 1 -- 172.21.15.38:0/2478932966 learned_addr learned my addr 172.21.15.38:0/2478932966 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:28.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2da7fff700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806b120 0x7f2da813f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.392+0000 7f2dacfc4700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2da814aa40 0x7f2da81e3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.393+0000 7f2da77fe700 1 -- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2da814aa40 msgr2=0x7f2da81e3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.393+0000 7f2da77fe700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2da814aa40 0x7f2da81e3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.393+0000 7f2da77fe700 1 -- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806b120 msgr2=0x7f2da813f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.393+0000 7f2da77fe700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806b120 0x7f2da813f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.393+0000 7f2da77fe700 1 -- 172.21.15.38:0/2478932966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d980094a0 con 0x7f2da81444c0 2023-07-11T00:00:28.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.393+0000 7f2da77fe700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2da81444c0 0x7f2da81475d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00c550 tx=0x7f2d9c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:28.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.393+0000 7f2da4ff9700 1 -- 172.21.15.38:0/2478932966 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c004c80 con 0x7f2da81444c0 2023-07-11T00:00:28.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.393+0000 7f2da4ff9700 1 -- 172.21.15.38:0/2478932966 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c004e00 con 0x7f2da81444c0 2023-07-11T00:00:28.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.393+0000 7f2daea27700 1 -- 172.21.15.38:0/2478932966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da8148000 con 0x7f2da81444c0 2023-07-11T00:00:28.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.393+0000 7f2da4ff9700 1 -- 172.21.15.38:0/2478932966 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c007310 con 0x7f2da81444c0 2023-07-11T00:00:28.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.393+0000 7f2daea27700 1 -- 172.21.15.38:0/2478932966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da81e3020 con 0x7f2da81444c0 2023-07-11T00:00:28.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.394+0000 7f2daea27700 1 -- 172.21.15.38:0/2478932966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da81e3dc0 con 0x7f2da81444c0 2023-07-11T00:00:28.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.394+0000 7f2da4ff9700 1 -- 172.21.15.38:0/2478932966 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d9c007470 con 0x7f2da81444c0 2023-07-11T00:00:28.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.395+0000 7f2da4ff9700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2d9406ace0 0x7f2d9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.395+0000 7f2da4ff9700 1 -- 172.21.15.38:0/2478932966 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d9c0891c0 con 0x7f2da81444c0 2023-07-11T00:00:28.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.395+0000 7f2da7fff700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2d9406ace0 0x7f2d9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.396+0000 7f2da7fff700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2d9406ace0 0x7f2d9406d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d980090b0 tx=0x7f2d98008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:28.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.399+0000 7f2da4ff9700 1 -- 172.21.15.38:0/2478932966 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2d9c054160 con 0x7f2da81444c0 2023-07-11T00:00:28.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.593+0000 7f2daea27700 1 -- 172.21.15.38:0/2478932966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2da8074360 con 0x7f2da81444c0 2023-07-11T00:00:28.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.594+0000 7f2da4ff9700 1 -- 172.21.15.38:0/2478932966 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d9c057780 con 0x7f2da81444c0 2023-07-11T00:00:28.596 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-07-11T00:00:28.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 -- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2d9406ace0 msgr2=0x7f2d9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2d9406ace0 0x7f2d9406d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d980090b0 tx=0x7f2d98008030 comp rx=0 tx=0).stop 2023-07-11T00:00:28.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 -- 172.21.15.38:0/2478932966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2da81444c0 msgr2=0x7f2da81475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2da81444c0 0x7f2da81475d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00c550 tx=0x7f2d9c00c860 comp rx=0 tx=0).stop 2023-07-11T00:00:28.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 -- 172.21.15.38:0/2478932966 shutdown_connections 2023-07-11T00:00:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2d9406ace0 0x7f2d9406d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2da814aa40 0x7f2da81e3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806b120 0x7f2da813f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 --2- 172.21.15.38:0/2478932966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2da81444c0 0x7f2da81475d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 -- 172.21.15.38:0/2478932966 >> 172.21.15.38:0/2478932966 conn(0x7f2da80bd980 msgr2=0x7f2da813fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 -- 172.21.15.38:0/2478932966 shutdown_connections 2023-07-11T00:00:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.596+0000 7f2daea27700 1 -- 172.21.15.38:0/2478932966 wait complete. 2023-07-11T00:00:28.610 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:00:28.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.736+0000 7f7c33e77700 1 Processor -- start 2023-07-11T00:00:28.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.737+0000 7f7c33e77700 1 -- start start 2023-07-11T00:00:28.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c33e77700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c2c0b96b0 0x7f7c2c152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c33e77700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c070e70 con 0x7f7c2c071a30 2023-07-11T00:00:28.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c33e77700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0ba720 con 0x7f7c2c141780 2023-07-11T00:00:28.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c33e77700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c071ea0 con 0x7f7c2c0b96b0 2023-07-11T00:00:28.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c32414700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c2c0b96b0 0x7f7c2c152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c31412700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7c2c071a30 0x7f7c2c14ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54526/0 (socket says 172.21.15.38:54526) 2023-07-11T00:00:28.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c31412700 1 -- 172.21.15.38:0/2057135884 learned_addr learned my addr 172.21.15.38:0/2057135884 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:28.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c32414700 1 -- 172.21.15.38:0/2057135884 >> v1:172.21.15.70:6789/0 conn(0x7f7c2c141780 legacy=0x7f7c2c0ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c32414700 1 -- 172.21.15.38:0/2057135884 >> v1:172.21.15.38:6789/0 conn(0x7f7c2c071a30 legacy=0x7f7c2c14ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c30c11700 1 -- 172.21.15.38:0/2057135884 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397766329 0 0) 0x7f7c2c070e70 con 0x7f7c2c071a30 2023-07-11T00:00:28.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c32414700 1 -- 172.21.15.38:0/2057135884 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0b9b40 con 0x7f7c2c0b96b0 2023-07-11T00:00:28.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c32414700 1 --2- 172.21.15.38:0/2057135884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2c0b96b0 0x7f7c2c152ec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009d90 tx=0x7f7c2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241b15decc05d626 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:28.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c30c11700 1 -- 172.21.15.38:0/2057135884 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400e070 con 0x7f7c2c0b96b0 2023-07-11T00:00:28.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c30c11700 1 -- 172.21.15.38:0/2057135884 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2400bbd0 con 0x7f7c2c0b96b0 2023-07-11T00:00:28.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.738+0000 7f7c30c11700 1 -- 172.21.15.38:0/2057135884 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24012430 con 0x7f7c2c0b96b0 2023-07-11T00:00:28.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.739+0000 7f7c33e77700 1 -- 172.21.15.38:0/2057135884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2c0b96b0 msgr2=0x7f7c2c152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.739+0000 7f7c33e77700 1 --2- 172.21.15.38:0/2057135884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2c0b96b0 0x7f7c2c152ec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009d90 tx=0x7f7c2400b330 comp rx=0 tx=0).stop 2023-07-11T00:00:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.739+0000 7f7c33e77700 1 -- 172.21.15.38:0/2057135884 shutdown_connections 2023-07-11T00:00:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.739+0000 7f7c33e77700 1 --2- 172.21.15.38:0/2057135884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2c0b96b0 0x7f7c2c152ec0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.739+0000 7f7c33e77700 1 -- 172.21.15.38:0/2057135884 >> 172.21.15.38:0/2057135884 conn(0x7f7c2c06d0e0 msgr2=0x7f7c2c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.739+0000 7f7c33e77700 1 -- 172.21.15.38:0/2057135884 shutdown_connections 2023-07-11T00:00:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.739+0000 7f7c33e77700 1 -- 172.21.15.38:0/2057135884 wait complete. 2023-07-11T00:00:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.741+0000 7f7c33e77700 1 Processor -- start 2023-07-11T00:00:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.741+0000 7f7c33e77700 1 -- start start 2023-07-11T00:00:28.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.741+0000 7f7c33e77700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2c071a30 0x7f7c2c147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.741+0000 7f7c33e77700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7c2c0b96b0 0x7f7c2c13ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.741+0000 7f7c33e77700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c141780 0x7f7c2c1e1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.741+0000 7f7c33e77700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c148500 con 0x7f7c2c071a30 2023-07-11T00:00:28.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.741+0000 7f7c33e77700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c13d210 con 0x7f7c2c141780 2023-07-11T00:00:28.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.741+0000 7f7c33e77700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0b48e0 con 0x7f7c2c0b96b0 2023-07-11T00:00:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c31c13700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2c071a30 0x7f7c2c147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c31c13700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2c071a30 0x7f7c2c147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53232/0 (socket says 172.21.15.38:53232) 2023-07-11T00:00:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c31c13700 1 -- 172.21.15.38:0/4069809158 learned_addr learned my addr 172.21.15.38:0/4069809158 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c31412700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7c2c0b96b0 0x7f7c2c13ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c32414700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c141780 0x7f7c2c1e1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c31c13700 1 -- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7c2c0b96b0 msgr2=0x7f7c2c13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c31c13700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7c2c0b96b0 0x7f7c2c13ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c31c13700 1 -- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c141780 msgr2=0x7f7c2c1e1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c31c13700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c141780 0x7f7c2c1e1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c31c13700 1 -- 172.21.15.38:0/4069809158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c24009a70 con 0x7f7c2c071a30 2023-07-11T00:00:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c31c13700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2c071a30 0x7f7c2c147920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c450 tx=0x7f7c2800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c227fc700 1 -- 172.21.15.38:0/4069809158 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280052d0 con 0x7f7c2c071a30 2023-07-11T00:00:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c227fc700 1 -- 172.21.15.38:0/4069809158 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c28005430 con 0x7f7c2c071a30 2023-07-11T00:00:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c33e77700 1 -- 172.21.15.38:0/4069809158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c1e0d70 con 0x7f7c2c071a30 2023-07-11T00:00:28.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c227fc700 1 -- 172.21.15.38:0/4069809158 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280038c0 con 0x7f7c2c071a30 2023-07-11T00:00:28.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.742+0000 7f7c33e77700 1 -- 172.21.15.38:0/4069809158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c147ff0 con 0x7f7c2c071a30 2023-07-11T00:00:28.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.743+0000 7f7c33e77700 1 -- 172.21.15.38:0/4069809158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c1e1050 con 0x7f7c2c071a30 2023-07-11T00:00:28.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.744+0000 7f7c227fc700 1 -- 172.21.15.38:0/4069809158 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c28003a20 con 0x7f7c2c071a30 2023-07-11T00:00:28.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.744+0000 7f7c227fc700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f7c1006ace0 0x7f7c1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:28.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.744+0000 7f7c227fc700 1 -- 172.21.15.38:0/4069809158 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7c28088790 con 0x7f7c2c071a30 2023-07-11T00:00:28.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.744+0000 7f7c31412700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f7c1006ace0 0x7f7c1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:28.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.745+0000 7f7c31412700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f7c1006ace0 0x7f7c1006d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c007fd0 tx=0x7f7c1c007c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.749+0000 7f7c227fc700 1 -- 172.21.15.38:0/4069809158 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7c280538d0 con 0x7f7c2c071a30 2023-07-11T00:00:28.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.944+0000 7f7c33e77700 1 -- 172.21.15.38:0/4069809158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7c2c074360 con 0x7f7c2c071a30 2023-07-11T00:00:28.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.944+0000 7f7c227fc700 1 -- 172.21.15.38:0/4069809158 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7c28056ef0 con 0x7f7c2c071a30 2023-07-11T00:00:28.946 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-07-11T00:00:28.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 -- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f7c1006ace0 msgr2=0x7f7c1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f7c1006ace0 0x7f7c1006d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c007fd0 tx=0x7f7c1c007c20 comp rx=0 tx=0).stop 2023-07-11T00:00:28.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 -- 172.21.15.38:0/4069809158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2c071a30 msgr2=0x7f7c2c147920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:28.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2c071a30 0x7f7c2c147920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c450 tx=0x7f7c2800c810 comp rx=0 tx=0).stop 2023-07-11T00:00:28.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 -- 172.21.15.38:0/4069809158 shutdown_connections 2023-07-11T00:00:28.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f7c1006ace0 0x7f7c1006d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c141780 0x7f7c2c1e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2c071a30 0x7f7c2c147920 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 --2- 172.21.15.38:0/4069809158 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7c2c0b96b0 0x7f7c2c13ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:28.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 -- 172.21.15.38:0/4069809158 >> 172.21.15.38:0/4069809158 conn(0x7f7c2c06d0e0 msgr2=0x7f7c2c069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:28.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 -- 172.21.15.38:0/4069809158 shutdown_connections 2023-07-11T00:00:28.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:28.946+0000 7f7c33e77700 1 -- 172.21.15.38:0/4069809158 wait complete. 2023-07-11T00:00:28.960 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:00:29.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.084+0000 7fca7db6f700 1 Processor -- start 2023-07-11T00:00:29.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.084+0000 7fca7db6f700 1 -- start start 2023-07-11T00:00:29.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca7db6f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca780717f0 0x7fca780b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca7db6f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fca78071bc0 0x7fca780ba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca7db6f700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca780ba010 con 0x7fca780b8e60 2023-07-11T00:00:29.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca7db6f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca780b85a0 con 0x7fca780717f0 2023-07-11T00:00:29.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca7db6f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca780b7470 con 0x7fca78071bc0 2023-07-11T00:00:29.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca777fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca780717f0 0x7fca780b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca777fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca780717f0 0x7fca780b7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53234/0 (socket says 172.21.15.38:53234) 2023-07-11T00:00:29.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca777fe700 1 -- 172.21.15.38:0/3164163570 learned_addr learned my addr 172.21.15.38:0/3164163570 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:29.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca76ffd700 1 --2- 172.21.15.38:0/3164163570 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fca78071bc0 0x7fca780ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca777fe700 1 -- 172.21.15.38:0/3164163570 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fca78071bc0 msgr2=0x7fca780ba3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:29.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca777fe700 1 --2- 172.21.15.38:0/3164163570 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fca78071bc0 0x7fca780ba3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca777fe700 1 -- 172.21.15.38:0/3164163570 >> v1:172.21.15.70:6789/0 conn(0x7fca780b8e60 legacy=0x7fca78142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:29.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.085+0000 7fca777fe700 1 -- 172.21.15.38:0/3164163570 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca780b7750 con 0x7fca780717f0 2023-07-11T00:00:29.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca777fe700 1 --2- 172.21.15.38:0/3164163570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca780717f0 0x7fca780b7f80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca68009920 tx=0x7fca68009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7df0b8da9a138e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:29.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca767fc700 1 -- 172.21.15.38:0/3164163570 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68004230 con 0x7fca780717f0 2023-07-11T00:00:29.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca767fc700 1 -- 172.21.15.38:0/3164163570 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca68004390 con 0x7fca780717f0 2023-07-11T00:00:29.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca767fc700 1 -- 172.21.15.38:0/3164163570 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68009e70 con 0x7fca780717f0 2023-07-11T00:00:29.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca7db6f700 1 -- 172.21.15.38:0/3164163570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca780717f0 msgr2=0x7fca780b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca7db6f700 1 --2- 172.21.15.38:0/3164163570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca780717f0 0x7fca780b7f80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca68009920 tx=0x7fca68009c30 comp rx=0 tx=0).stop 2023-07-11T00:00:29.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca7db6f700 1 -- 172.21.15.38:0/3164163570 shutdown_connections 2023-07-11T00:00:29.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca7db6f700 1 --2- 172.21.15.38:0/3164163570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca780717f0 0x7fca780b7f80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca7db6f700 1 --2- 172.21.15.38:0/3164163570 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fca78071bc0 0x7fca780ba3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca7db6f700 1 -- 172.21.15.38:0/3164163570 >> 172.21.15.38:0/3164163570 conn(0x7fca7806d0e0 msgr2=0x7fca7806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:29.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca7db6f700 1 -- 172.21.15.38:0/3164163570 shutdown_connections 2023-07-11T00:00:29.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.086+0000 7fca7db6f700 1 -- 172.21.15.38:0/3164163570 wait complete. 2023-07-11T00:00:29.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.087+0000 7fca7db6f700 1 Processor -- start 2023-07-11T00:00:29.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca7db6f700 1 -- start start 2023-07-11T00:00:29.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca7db6f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca780717f0 0x7fca780bc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca7db6f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca78071bc0 0x7fca781e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca7db6f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fca780b8e60 0x7fca781e0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca7db6f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca780bc720 con 0x7fca780717f0 2023-07-11T00:00:29.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca7db6f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7813e790 con 0x7fca78071bc0 2023-07-11T00:00:29.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca7db6f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca781d0f60 con 0x7fca780b8e60 2023-07-11T00:00:29.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca777fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca780717f0 0x7fca780bc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca777fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca780717f0 0x7fca780bc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53236/0 (socket says 172.21.15.38:53236) 2023-07-11T00:00:29.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca777fe700 1 -- 172.21.15.38:0/1118453743 learned_addr learned my addr 172.21.15.38:0/1118453743 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:29.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca76ffd700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca78071bc0 0x7fca781e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.088+0000 7fca77fff700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fca780b8e60 0x7fca781e0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.089+0000 7fca777fe700 1 -- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fca780b8e60 msgr2=0x7fca781e0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.089+0000 7fca777fe700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fca780b8e60 0x7fca781e0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.089+0000 7fca777fe700 1 -- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca78071bc0 msgr2=0x7fca781e0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.089+0000 7fca777fe700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca78071bc0 0x7fca781e0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.089+0000 7fca777fe700 1 -- 172.21.15.38:0/1118453743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009550 con 0x7fca780717f0 2023-07-11T00:00:29.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.089+0000 7fca777fe700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca780717f0 0x7fca780bc1e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fca68009fd0 tx=0x7fca68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:29.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.089+0000 7fca6ffff700 1 -- 172.21.15.38:0/1118453743 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6800bce0 con 0x7fca780717f0 2023-07-11T00:00:29.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.089+0000 7fca6ffff700 1 -- 172.21.15.38:0/1118453743 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6801f070 con 0x7fca780717f0 2023-07-11T00:00:29.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.089+0000 7fca7db6f700 1 -- 172.21.15.38:0/1118453743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca781d1200 con 0x7fca780717f0 2023-07-11T00:00:29.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.089+0000 7fca6ffff700 1 -- 172.21.15.38:0/1118453743 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca680038e0 con 0x7fca780717f0 2023-07-11T00:00:29.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.089+0000 7fca7db6f700 1 -- 172.21.15.38:0/1118453743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca781d17c0 con 0x7fca780717f0 2023-07-11T00:00:29.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.090+0000 7fca7db6f700 1 -- 172.21.15.38:0/1118453743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca78074360 con 0x7fca780717f0 2023-07-11T00:00:29.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.090+0000 7fca6ffff700 1 -- 172.21.15.38:0/1118453743 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca68021030 con 0x7fca780717f0 2023-07-11T00:00:29.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.091+0000 7fca6ffff700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fca5806ace0 0x7fca5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.091+0000 7fca6ffff700 1 -- 172.21.15.38:0/1118453743 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca6808aa30 con 0x7fca780717f0 2023-07-11T00:00:29.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.091+0000 7fca76ffd700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fca5806ace0 0x7fca5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.092+0000 7fca76ffd700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fca5806ace0 0x7fca5806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fca781cf640 tx=0x7fca60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:29.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.095+0000 7fca6ffff700 1 -- 172.21.15.38:0/1118453743 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fca68055c10 con 0x7fca780717f0 2023-07-11T00:00:29.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.336+0000 7fca7db6f700 1 -- 172.21.15.38:0/1118453743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca78074360 con 0x7fca780717f0 2023-07-11T00:00:29.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.337+0000 7fca6ffff700 1 -- 172.21.15.38:0/1118453743 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3909 (secure 0 0 0) 0x7fca68059230 con 0x7fca780717f0 2023-07-11T00:00:29.339 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:29.339 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3612343661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3612343661},{"type":"v1","addr":"172.21.15.38:6834","nonce":3612343661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3097729806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3097729806},{"type":"v1","addr":"172.21.15.70:6835","nonce":3097729806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:00:16.787420+0000","modified":"2023-07-11T00:00:19.806642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3594015619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3594015619},{"type":"v1","addr":"172.21.15.38:6835","nonce":3594015619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:00:29.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 -- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fca5806ace0 msgr2=0x7fca5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fca5806ace0 0x7fca5806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fca781cf640 tx=0x7fca60008040 comp rx=0 tx=0).stop 2023-07-11T00:00:29.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 -- 172.21.15.38:0/1118453743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca780717f0 msgr2=0x7fca780bc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca780717f0 0x7fca780bc1e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fca68009fd0 tx=0x7fca68004750 comp rx=0 tx=0).stop 2023-07-11T00:00:29.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 -- 172.21.15.38:0/1118453743 shutdown_connections 2023-07-11T00:00:29.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fca5806ace0 0x7fca5806d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fca780b8e60 0x7fca781e0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca780717f0 0x7fca780bc1e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 --2- 172.21.15.38:0/1118453743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca78071bc0 0x7fca781e0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 -- 172.21.15.38:0/1118453743 >> 172.21.15.38:0/1118453743 conn(0x7fca7806d0e0 msgr2=0x7fca78073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:29.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 -- 172.21.15.38:0/1118453743 shutdown_connections 2023-07-11T00:00:29.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.339+0000 7fca7db6f700 1 -- 172.21.15.38:0/1118453743 wait complete. 2023-07-11T00:00:29.342 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 7 2023-07-11T00:00:29.353 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:29.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.477+0000 7fcb9e157700 1 Processor -- start 2023-07-11T00:00:29.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.477+0000 7fcb9e157700 1 -- start start 2023-07-11T00:00:29.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.477+0000 7fcb9e157700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb980bc810 0x7fcb980ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.477+0000 7fcb9e157700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcb980b8d90 0x7fcb9806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.477+0000 7fcb9e157700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb980b8620 con 0x7fcb981449d0 2023-07-11T00:00:29.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb9e157700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb980b97a0 con 0x7fcb980b8d90 2023-07-11T00:00:29.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb9e157700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98144da0 con 0x7fcb980bc810 2023-07-11T00:00:29.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb96ffd700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb980bc810 0x7fcb980ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb97fff700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcb980b8d90 0x7fcb9806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb977fe700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fcb981449d0 0x7fcb9814db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:57350/0 (socket says 172.21.15.38:57350) 2023-07-11T00:00:29.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb977fe700 1 -- 172.21.15.38:0/1443925321 learned_addr learned my addr 172.21.15.38:0/1443925321 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:29.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb97fff700 1 -- 172.21.15.38:0/1443925321 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb980bc810 msgr2=0x7fcb980ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:29.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb97fff700 1 --2- 172.21.15.38:0/1443925321 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb980bc810 0x7fcb980ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb97fff700 1 -- 172.21.15.38:0/1443925321 >> v1:172.21.15.70:6789/0 conn(0x7fcb981449d0 legacy=0x7fcb9814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb97fff700 1 -- 172.21.15.38:0/1443925321 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb980b8900 con 0x7fcb980b8d90 2023-07-11T00:00:29.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb967fc700 1 -- 172.21.15.38:0/1443925321 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430135554 0 0) 0x7fcb980b8620 con 0x7fcb981449d0 2023-07-11T00:00:29.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.478+0000 7fcb97fff700 1 --2- 172.21.15.38:0/1443925321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb980b8d90 0x7fcb9806ade0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009d90 tx=0x7fcb9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4360d0a404c1871e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:29.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.479+0000 7fcb967fc700 1 -- 172.21.15.38:0/1443925321 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000e070 con 0x7fcb980b8d90 2023-07-11T00:00:29.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.479+0000 7fcb967fc700 1 -- 172.21.15.38:0/1443925321 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9000bb20 con 0x7fcb980b8d90 2023-07-11T00:00:29.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.479+0000 7fcb967fc700 1 -- 172.21.15.38:0/1443925321 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90012430 con 0x7fcb980b8d90 2023-07-11T00:00:29.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.479+0000 7fcb9e157700 1 -- 172.21.15.38:0/1443925321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb980b8d90 msgr2=0x7fcb9806ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.479+0000 7fcb9e157700 1 --2- 172.21.15.38:0/1443925321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb980b8d90 0x7fcb9806ade0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009d90 tx=0x7fcb9000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:29.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.479+0000 7fcb9e157700 1 -- 172.21.15.38:0/1443925321 shutdown_connections 2023-07-11T00:00:29.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.479+0000 7fcb9e157700 1 --2- 172.21.15.38:0/1443925321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb980b8d90 0x7fcb9806ade0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.479+0000 7fcb9e157700 1 --2- 172.21.15.38:0/1443925321 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb980bc810 0x7fcb980ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.479+0000 7fcb9e157700 1 -- 172.21.15.38:0/1443925321 >> 172.21.15.38:0/1443925321 conn(0x7fcb980c0860 msgr2=0x7fcb980c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:29.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.479+0000 7fcb9e157700 1 -- 172.21.15.38:0/1443925321 shutdown_connections 2023-07-11T00:00:29.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.479+0000 7fcb9e157700 1 -- 172.21.15.38:0/1443925321 wait complete. 2023-07-11T00:00:29.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.480+0000 7fcb9e157700 1 Processor -- start 2023-07-11T00:00:29.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.480+0000 7fcb9e157700 1 -- start start 2023-07-11T00:00:29.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb9e157700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb980b8d90 0x7fcb981e29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb9e157700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb980bc810 0x7fcb9814d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb9e157700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb981449d0 0x7fcb980b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb9e157700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9814da30 con 0x7fcb981449d0 2023-07-11T00:00:29.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb9e157700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980a3d30 con 0x7fcb980b8d90 2023-07-11T00:00:29.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb9e157700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9814b260 con 0x7fcb980bc810 2023-07-11T00:00:29.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb97fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb981449d0 0x7fcb980b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb97fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb981449d0 0x7fcb980b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53238/0 (socket says 172.21.15.38:53238) 2023-07-11T00:00:29.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb97fff700 1 -- 172.21.15.38:0/3951173052 learned_addr learned my addr 172.21.15.38:0/3951173052 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:29.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb96ffd700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb980bc810 0x7fcb9814d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb977fe700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb980b8d90 0x7fcb981e29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb97fff700 1 -- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb980bc810 msgr2=0x7fcb9814d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb97fff700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb980bc810 0x7fcb9814d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb97fff700 1 -- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb980b8d90 msgr2=0x7fcb981e29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb97fff700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb980b8d90 0x7fcb981e29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.481+0000 7fcb97fff700 1 -- 172.21.15.38:0/3951173052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90009a70 con 0x7fcb981449d0 2023-07-11T00:00:29.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.482+0000 7fcb97fff700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb981449d0 0x7fcb980b3040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb90014040 tx=0x7fcb90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:29.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.482+0000 7fcb7ffff700 1 -- 172.21.15.38:0/3951173052 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90012430 con 0x7fcb981449d0 2023-07-11T00:00:29.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.482+0000 7fcb7ffff700 1 -- 172.21.15.38:0/3951173052 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb90020070 con 0x7fcb981449d0 2023-07-11T00:00:29.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.482+0000 7fcb9e157700 1 -- 172.21.15.38:0/3951173052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb98149a90 con 0x7fcb981449d0 2023-07-11T00:00:29.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.482+0000 7fcb7ffff700 1 -- 172.21.15.38:0/3951173052 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90004280 con 0x7fcb981449d0 2023-07-11T00:00:29.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.482+0000 7fcb9e157700 1 -- 172.21.15.38:0/3951173052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9814a050 con 0x7fcb981449d0 2023-07-11T00:00:29.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.483+0000 7fcb9e157700 1 -- 172.21.15.38:0/3951173052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb98074360 con 0x7fcb981449d0 2023-07-11T00:00:29.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.483+0000 7fcb7ffff700 1 -- 172.21.15.38:0/3951173052 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb900043e0 con 0x7fcb981449d0 2023-07-11T00:00:29.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.483+0000 7fcb7ffff700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcb8406ace0 0x7fcb8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.484+0000 7fcb7ffff700 1 -- 172.21.15.38:0/3951173052 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb90022070 con 0x7fcb981449d0 2023-07-11T00:00:29.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.484+0000 7fcb977fe700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcb8406ace0 0x7fcb8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.484+0000 7fcb977fe700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcb8406ace0 0x7fcb8406d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcb88000f60 tx=0x7fcb88007e70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:29.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.488+0000 7fcb7ffff700 1 -- 172.21.15.38:0/3951173052 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fcb900561b0 con 0x7fcb981449d0 2023-07-11T00:00:29.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.689+0000 7fcb9e157700 1 -- 172.21.15.38:0/3951173052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb980bc330 con 0x7fcb981449d0 2023-07-11T00:00:29.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.690+0000 7fcb7ffff700 1 -- 172.21.15.38:0/3951173052 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7fcb90012e60 con 0x7fcb981449d0 2023-07-11T00:00:29.692 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:29.693 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:29.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.692+0000 7fcb9e157700 1 -- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcb8406ace0 msgr2=0x7fcb8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.692+0000 7fcb9e157700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcb8406ace0 0x7fcb8406d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcb88000f60 tx=0x7fcb88007e70 comp rx=0 tx=0).stop 2023-07-11T00:00:29.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.692+0000 7fcb9e157700 1 -- 172.21.15.38:0/3951173052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb981449d0 msgr2=0x7fcb980b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.692+0000 7fcb9e157700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb981449d0 0x7fcb980b3040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb90014040 tx=0x7fcb90004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.692+0000 7fcb9e157700 1 -- 172.21.15.38:0/3951173052 shutdown_connections 2023-07-11T00:00:29.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.692+0000 7fcb9e157700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcb8406ace0 0x7fcb8406d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.692+0000 7fcb9e157700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb981449d0 0x7fcb980b3040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.692+0000 7fcb9e157700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb980b8d90 0x7fcb981e29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.693+0000 7fcb9e157700 1 --2- 172.21.15.38:0/3951173052 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb980bc810 0x7fcb9814d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.693+0000 7fcb9e157700 1 -- 172.21.15.38:0/3951173052 >> 172.21.15.38:0/3951173052 conn(0x7fcb980c0860 msgr2=0x7fcb980baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:29.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.693+0000 7fcb9e157700 1 -- 172.21.15.38:0/3951173052 shutdown_connections 2023-07-11T00:00:29.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.693+0000 7fcb9e157700 1 -- 172.21.15.38:0/3951173052 wait complete. 2023-07-11T00:00:29.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:00:14.572121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:00:15.763698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:00:29.707 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:00:29.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.834+0000 7f01a0152700 1 Processor -- start 2023-07-11T00:00:29.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.834+0000 7f01a0152700 1 -- start start 2023-07-11T00:00:29.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f01a0152700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01981449d0 0x7f019814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f01a0152700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f01980bc810 0x7f01980ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f01a0152700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f01980b8d90 0x7f019806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f01a0152700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01980b97a0 con 0x7f01980b8d90 2023-07-11T00:00:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f01a0152700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0198144da0 con 0x7f01980bc810 2023-07-11T00:00:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f01a0152700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980b8620 con 0x7f01981449d0 2023-07-11T00:00:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f019e6ef700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f01980b8d90 0x7f019806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f019e6ef700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f01980b8d90 0x7f019806ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53242/0 (socket says 172.21.15.38:53242) 2023-07-11T00:00:29.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f019e6ef700 1 -- 172.21.15.38:0/957755260 learned_addr learned my addr 172.21.15.38:0/957755260 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:29.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f019deee700 1 --2- 172.21.15.38:0/957755260 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01981449d0 0x7f019814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f019d6ed700 1 --2- 172.21.15.38:0/957755260 >> v2:172.21.15.70:3300/0 conn(0x7f01980bc810 0x7f01980ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f019e6ef700 1 -- 172.21.15.38:0/957755260 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01981449d0 msgr2=0x7f019814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:29.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f019e6ef700 1 --2- 172.21.15.38:0/957755260 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01981449d0 0x7f019814db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f019e6ef700 1 -- 172.21.15.38:0/957755260 >> v2:172.21.15.70:3300/0 conn(0x7f01980bc810 msgr2=0x7f01980ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:29.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f019e6ef700 1 --2- 172.21.15.38:0/957755260 >> v2:172.21.15.70:3300/0 conn(0x7f01980bc810 0x7f01980ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.835+0000 7f019e6ef700 1 -- 172.21.15.38:0/957755260 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980b8900 con 0x7f01980b8d90 2023-07-11T00:00:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f019e6ef700 1 --2- 172.21.15.38:0/957755260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01980b8d90 0x7f019806ade0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f019806cc10 tx=0x7f019000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d95ba89ebe1f82 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f019ceec700 1 -- 172.21.15.38:0/957755260 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000e070 con 0x7f01980b8d90 2023-07-11T00:00:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f019ceec700 1 -- 172.21.15.38:0/957755260 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000b910 con 0x7f01980b8d90 2023-07-11T00:00:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f019ceec700 1 -- 172.21.15.38:0/957755260 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000bcc0 con 0x7f01980b8d90 2023-07-11T00:00:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f01a0152700 1 -- 172.21.15.38:0/957755260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01980b8d90 msgr2=0x7f019806ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f01a0152700 1 --2- 172.21.15.38:0/957755260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01980b8d90 0x7f019806ade0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f019806cc10 tx=0x7f019000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f01a0152700 1 -- 172.21.15.38:0/957755260 shutdown_connections 2023-07-11T00:00:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f01a0152700 1 --2- 172.21.15.38:0/957755260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01980b8d90 0x7f019806ade0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f01a0152700 1 --2- 172.21.15.38:0/957755260 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01981449d0 0x7f019814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f01a0152700 1 --2- 172.21.15.38:0/957755260 >> v2:172.21.15.70:3300/0 conn(0x7f01980bc810 0x7f01980ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f01a0152700 1 -- 172.21.15.38:0/957755260 >> 172.21.15.38:0/957755260 conn(0x7f01980c0860 msgr2=0x7f01980c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.836+0000 7f01a0152700 1 -- 172.21.15.38:0/957755260 shutdown_connections 2023-07-11T00:00:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.837+0000 7f01a0152700 1 -- 172.21.15.38:0/957755260 wait complete. 2023-07-11T00:00:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.838+0000 7f01a0152700 1 Processor -- start 2023-07-11T00:00:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.838+0000 7f01a0152700 1 -- start start 2023-07-11T00:00:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.838+0000 7f01a0152700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01980b8d90 0x7f01980b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.838+0000 7f01a0152700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01980bc810 0x7f01981488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.838+0000 7f01a0152700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01981449d0 0x7f0198148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.838+0000 7f01a0152700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019814dc70 con 0x7f01980b8d90 2023-07-11T00:00:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.838+0000 7f01a0152700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019814a8f0 con 0x7f01980bc810 2023-07-11T00:00:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.838+0000 7f01a0152700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980b7730 con 0x7f01981449d0 2023-07-11T00:00:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.838+0000 7f019deee700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01980b8d90 0x7f01980b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.838+0000 7f019deee700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01980b8d90 0x7f01980b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53254/0 (socket says 172.21.15.38:53254) 2023-07-11T00:00:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.838+0000 7f019deee700 1 -- 172.21.15.38:0/4280833923 learned_addr learned my addr 172.21.15.38:0/4280833923 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f019d6ed700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01980bc810 0x7f01981488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f019e6ef700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01981449d0 0x7f0198148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f019deee700 1 -- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01981449d0 msgr2=0x7f0198148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f019deee700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01981449d0 0x7f0198148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f019deee700 1 -- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01980bc810 msgr2=0x7f01981488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f019deee700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01980bc810 0x7f01981488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f019deee700 1 -- 172.21.15.38:0/4280833923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190009b30 con 0x7f01980b8d90 2023-07-11T00:00:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f019d6ed700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01980bc810 0x7f01981488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f019e6ef700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01981449d0 0x7f0198148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f019deee700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01980b8d90 0x7f01980b2780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f018800e870 tx=0x7f018800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f018e7fc700 1 -- 172.21.15.38:0/4280833923 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188009590 con 0x7f01980b8d90 2023-07-11T00:00:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f018e7fc700 1 -- 172.21.15.38:0/4280833923 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018800ee70 con 0x7f01980b8d90 2023-07-11T00:00:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f01a0152700 1 -- 172.21.15.38:0/4280833923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019814ab00 con 0x7f01980b8d90 2023-07-11T00:00:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f018e7fc700 1 -- 172.21.15.38:0/4280833923 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018800c9f0 con 0x7f01980b8d90 2023-07-11T00:00:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.839+0000 7f01a0152700 1 -- 172.21.15.38:0/4280833923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01981495d0 con 0x7f01980b8d90 2023-07-11T00:00:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.840+0000 7f01a0152700 1 -- 172.21.15.38:0/4280833923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019814b300 con 0x7f01980b8d90 2023-07-11T00:00:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.840+0000 7f018e7fc700 1 -- 172.21.15.38:0/4280833923 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f018800cb50 con 0x7f01980b8d90 2023-07-11T00:00:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.841+0000 7f018e7fc700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f017c06ace0 0x7f017c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.841+0000 7f018e7fc700 1 -- 172.21.15.38:0/4280833923 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0188089350 con 0x7f01980b8d90 2023-07-11T00:00:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.841+0000 7f019d6ed700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f017c06ace0 0x7f017c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.841+0000 7f019d6ed700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f017c06ace0 0x7f017c06d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f01980a5c70 tx=0x7f0194008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:29.845+0000 7f018e7fc700 1 -- 172.21.15.38:0/4280833923 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0188057f20 con 0x7f01980b8d90 2023-07-11T00:00:30.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.042+0000 7f01a0152700 1 -- 172.21.15.38:0/4280833923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f019814aef0 con 0x7f01980b8d90 2023-07-11T00:00:30.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.042+0000 7f018e7fc700 1 -- 172.21.15.38:0/4280833923 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0188057ab0 con 0x7f01980b8d90 2023-07-11T00:00:30.044 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:00:30.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.044+0000 7f01a0152700 1 -- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f017c06ace0 msgr2=0x7f017c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.044+0000 7f01a0152700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f017c06ace0 0x7f017c06d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f01980a5c70 tx=0x7f0194008040 comp rx=0 tx=0).stop 2023-07-11T00:00:30.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.044+0000 7f01a0152700 1 -- 172.21.15.38:0/4280833923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01980b8d90 msgr2=0x7f01980b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.044+0000 7f01a0152700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01980b8d90 0x7f01980b2780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f018800e870 tx=0x7f018800ec30 comp rx=0 tx=0).stop 2023-07-11T00:00:30.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.044+0000 7f01a0152700 1 -- 172.21.15.38:0/4280833923 shutdown_connections 2023-07-11T00:00:30.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.044+0000 7f01a0152700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f017c06ace0 0x7f017c06d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.044+0000 7f01a0152700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01981449d0 0x7f0198148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.044+0000 7f01a0152700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01980b8d90 0x7f01980b2780 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.044+0000 7f01a0152700 1 --2- 172.21.15.38:0/4280833923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01980bc810 0x7f01981488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.044+0000 7f01a0152700 1 -- 172.21.15.38:0/4280833923 >> 172.21.15.38:0/4280833923 conn(0x7f01980c0860 msgr2=0x7f01980baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:30.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.045+0000 7f01a0152700 1 -- 172.21.15.38:0/4280833923 shutdown_connections 2023-07-11T00:00:30.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.045+0000 7f01a0152700 1 -- 172.21.15.38:0/4280833923 wait complete. 2023-07-11T00:00:30.058 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:00:30.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.185+0000 7f508fd0c700 1 Processor -- start 2023-07-11T00:00:30.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.185+0000 7f508fd0c700 1 -- start start 2023-07-11T00:00:30.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.186+0000 7f508fd0c700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f50880717f0 0x7f50880b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.186+0000 7f508fd0c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f50880ba3e0 0x7f5088142410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.186+0000 7f508fd0c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50880ba010 con 0x7f5088071bc0 2023-07-11T00:00:30.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.186+0000 7f508fd0c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50880b9570 con 0x7f50880ba3e0 2023-07-11T00:00:30.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.186+0000 7f508fd0c700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50880ba820 con 0x7f50880717f0 2023-07-11T00:00:30.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508e2a9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f50880ba3e0 0x7f5088142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508d2a7700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5088071bc0 0x7f50880b8e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53292/0 (socket says 172.21.15.38:53292) 2023-07-11T00:00:30.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508d2a7700 1 -- 172.21.15.38:0/4093861873 learned_addr learned my addr 172.21.15.38:0/4093861873 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:30.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508daa8700 1 --2- 172.21.15.38:0/4093861873 >> v2:172.21.15.70:3300/0 conn(0x7f50880717f0 0x7f50880b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508e2a9700 1 -- 172.21.15.38:0/4093861873 >> v2:172.21.15.70:3300/0 conn(0x7f50880717f0 msgr2=0x7f50880b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:30.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508e2a9700 1 --2- 172.21.15.38:0/4093861873 >> v2:172.21.15.70:3300/0 conn(0x7f50880717f0 0x7f50880b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508e2a9700 1 -- 172.21.15.38:0/4093861873 >> v1:172.21.15.38:6789/0 conn(0x7f5088071bc0 legacy=0x7f50880b8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508e2a9700 1 -- 172.21.15.38:0/4093861873 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50880b85a0 con 0x7f50880ba3e0 2023-07-11T00:00:30.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508caa6700 1 -- 172.21.15.38:0/4093861873 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298899903 0 0) 0x7f50880ba010 con 0x7f5088071bc0 2023-07-11T00:00:30.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508e2a9700 1 --2- 172.21.15.38:0/4093861873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50880ba3e0 0x7f5088142410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f50880ba370 tx=0x7f508000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc04b91a0440bf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:30.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508caa6700 1 -- 172.21.15.38:0/4093861873 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508000e070 con 0x7f50880ba3e0 2023-07-11T00:00:30.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508caa6700 1 -- 172.21.15.38:0/4093861873 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508000bb20 con 0x7f50880ba3e0 2023-07-11T00:00:30.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.187+0000 7f508caa6700 1 -- 172.21.15.38:0/4093861873 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080012430 con 0x7f50880ba3e0 2023-07-11T00:00:30.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.188+0000 7f508fd0c700 1 -- 172.21.15.38:0/4093861873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50880ba3e0 msgr2=0x7f5088142410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.188+0000 7f508fd0c700 1 --2- 172.21.15.38:0/4093861873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50880ba3e0 0x7f5088142410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f50880ba370 tx=0x7f508000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:30.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.188+0000 7f508fd0c700 1 -- 172.21.15.38:0/4093861873 shutdown_connections 2023-07-11T00:00:30.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.188+0000 7f508fd0c700 1 --2- 172.21.15.38:0/4093861873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50880ba3e0 0x7f5088142410 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.188+0000 7f508fd0c700 1 --2- 172.21.15.38:0/4093861873 >> v2:172.21.15.70:3300/0 conn(0x7f50880717f0 0x7f50880b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.188+0000 7f508fd0c700 1 -- 172.21.15.38:0/4093861873 >> 172.21.15.38:0/4093861873 conn(0x7f508806d0e0 msgr2=0x7f508806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:30.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.188+0000 7f508fd0c700 1 -- 172.21.15.38:0/4093861873 shutdown_connections 2023-07-11T00:00:30.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.188+0000 7f508fd0c700 1 -- 172.21.15.38:0/4093861873 wait complete. 2023-07-11T00:00:30.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.189+0000 7f508fd0c700 1 Processor -- start 2023-07-11T00:00:30.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.189+0000 7f508fd0c700 1 -- start start 2023-07-11T00:00:30.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508fd0c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f50880717f0 0x7f50880bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508fd0c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5088071bc0 0x7f50880aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508fd0c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50880ba3e0 0x7f50881401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508fd0c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50880be140 con 0x7f50880ba3e0 2023-07-11T00:00:30.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508fd0c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50880ac850 con 0x7f5088071bc0 2023-07-11T00:00:30.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508fd0c700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50880acaa0 con 0x7f50880717f0 2023-07-11T00:00:30.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508e2a9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50880ba3e0 0x7f50881401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508e2a9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50880ba3e0 0x7f50881401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41014/0 (socket says 172.21.15.38:41014) 2023-07-11T00:00:30.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508e2a9700 1 -- 172.21.15.38:0/3323673140 learned_addr learned my addr 172.21.15.38:0/3323673140 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:30.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508daa8700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f50880717f0 0x7f50880bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508d2a7700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5088071bc0 0x7f50880aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508e2a9700 1 -- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f50880717f0 msgr2=0x7f50880bdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508e2a9700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f50880717f0 0x7f50880bdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508e2a9700 1 -- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5088071bc0 msgr2=0x7f50880aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508e2a9700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5088071bc0 0x7f50880aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508e2a9700 1 -- 172.21.15.38:0/3323673140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5080009a70 con 0x7f50880ba3e0 2023-07-11T00:00:30.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508e2a9700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50880ba3e0 0x7f50881401b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5080014040 tx=0x7f5080004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:30.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f507e7fc700 1 -- 172.21.15.38:0/3323673140 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080012430 con 0x7f50880ba3e0 2023-07-11T00:00:30.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f507e7fc700 1 -- 172.21.15.38:0/3323673140 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080020070 con 0x7f50880ba3e0 2023-07-11T00:00:30.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508fd0c700 1 -- 172.21.15.38:0/3323673140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50880acd80 con 0x7f50880ba3e0 2023-07-11T00:00:30.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f507e7fc700 1 -- 172.21.15.38:0/3323673140 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080004280 con 0x7f50880ba3e0 2023-07-11T00:00:30.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.190+0000 7f508fd0c700 1 -- 172.21.15.38:0/3323673140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5088145a50 con 0x7f50880ba3e0 2023-07-11T00:00:30.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.191+0000 7f508fd0c700 1 -- 172.21.15.38:0/3323673140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50880ad390 con 0x7f50880ba3e0 2023-07-11T00:00:30.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.192+0000 7f507e7fc700 1 -- 172.21.15.38:0/3323673140 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f50800043e0 con 0x7f50880ba3e0 2023-07-11T00:00:30.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.192+0000 7f507e7fc700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f506c06ace0 0x7f506c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.192+0000 7f507e7fc700 1 -- 172.21.15.38:0/3323673140 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5080022070 con 0x7f50880ba3e0 2023-07-11T00:00:30.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.192+0000 7f508daa8700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f506c06ace0 0x7f506c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.193+0000 7f508daa8700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f506c06ace0 0x7f506c06d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5084009b40 tx=0x7f5084009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:30.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.197+0000 7f507e7fc700 1 -- 172.21.15.38:0/3323673140 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5080056130 con 0x7f50880ba3e0 2023-07-11T00:00:30.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.394+0000 7f508fd0c700 1 -- 172.21.15.38:0/3323673140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50880b4d10 con 0x7f50880ba3e0 2023-07-11T00:00:30.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.394+0000 7f507e7fc700 1 -- 172.21.15.38:0/3323673140 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f508002c0a0 con 0x7f50880ba3e0 2023-07-11T00:00:30.396 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:00:30.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 -- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f506c06ace0 msgr2=0x7f506c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f506c06ace0 0x7f506c06d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5084009b40 tx=0x7f5084009210 comp rx=0 tx=0).stop 2023-07-11T00:00:30.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 -- 172.21.15.38:0/3323673140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50880ba3e0 msgr2=0x7f50881401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50880ba3e0 0x7f50881401b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5080014040 tx=0x7f5080004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 -- 172.21.15.38:0/3323673140 shutdown_connections 2023-07-11T00:00:30.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f506c06ace0 0x7f506c06d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50880ba3e0 0x7f50881401b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f50880717f0 0x7f50880bdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 --2- 172.21.15.38:0/3323673140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5088071bc0 0x7f50880aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 -- 172.21.15.38:0/3323673140 >> 172.21.15.38:0/3323673140 conn(0x7f508806d0e0 msgr2=0x7f508806d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:30.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 -- 172.21.15.38:0/3323673140 shutdown_connections 2023-07-11T00:00:30.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.396+0000 7f508fd0c700 1 -- 172.21.15.38:0/3323673140 wait complete. 2023-07-11T00:00:30.410 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:00:30.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.538+0000 7f458c557700 1 Processor -- start 2023-07-11T00:00:30.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.538+0000 7f458c557700 1 -- start start 2023-07-11T00:00:30.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.538+0000 7f458c557700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f45840b8d90 0x7f458406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.538+0000 7f458c557700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45840b8620 con 0x7f45840bc810 2023-07-11T00:00:30.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.538+0000 7f458c557700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45840b8900 con 0x7f45841449d0 2023-07-11T00:00:30.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.538+0000 7f458c557700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45840b97a0 con 0x7f45840b8d90 2023-07-11T00:00:30.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.539+0000 7f458aaf4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f45840b8d90 0x7f458406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.539+0000 7f4589af2700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f45840bc810 0x7f45840ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53296/0 (socket says 172.21.15.38:53296) 2023-07-11T00:00:30.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.539+0000 7f4589af2700 1 -- 172.21.15.38:0/851444807 learned_addr learned my addr 172.21.15.38:0/851444807 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:30.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.539+0000 7f458aaf4700 1 -- 172.21.15.38:0/851444807 >> v1:172.21.15.70:6789/0 conn(0x7f45841449d0 legacy=0x7f458414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.539+0000 7f458aaf4700 1 -- 172.21.15.38:0/851444807 >> v1:172.21.15.38:6789/0 conn(0x7f45840bc810 legacy=0x7f45840ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.539+0000 7f458aaf4700 1 -- 172.21.15.38:0/851444807 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45840bac40 con 0x7f45840b8d90 2023-07-11T00:00:30.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.539+0000 7f458aaf4700 1 --2- 172.21.15.38:0/851444807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45840b8d90 0x7f458406ade0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f457c009d90 tx=0x7f457c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95649bb9aaefd96 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:30.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.539+0000 7f45892f1700 1 -- 172.21.15.38:0/851444807 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c00e070 con 0x7f45840b8d90 2023-07-11T00:00:30.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.539+0000 7f45892f1700 1 -- 172.21.15.38:0/851444807 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c00bbd0 con 0x7f45840b8d90 2023-07-11T00:00:30.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.539+0000 7f45892f1700 1 -- 172.21.15.38:0/851444807 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c012430 con 0x7f45840b8d90 2023-07-11T00:00:30.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.540+0000 7f458c557700 1 -- 172.21.15.38:0/851444807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45840b8d90 msgr2=0x7f458406ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.540+0000 7f458c557700 1 --2- 172.21.15.38:0/851444807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45840b8d90 0x7f458406ade0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f457c009d90 tx=0x7f457c00b330 comp rx=0 tx=0).stop 2023-07-11T00:00:30.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.540+0000 7f458c557700 1 -- 172.21.15.38:0/851444807 shutdown_connections 2023-07-11T00:00:30.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.540+0000 7f458c557700 1 --2- 172.21.15.38:0/851444807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45840b8d90 0x7f458406ade0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.540+0000 7f458c557700 1 -- 172.21.15.38:0/851444807 >> 172.21.15.38:0/851444807 conn(0x7f45840c0860 msgr2=0x7f45840c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:30.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.540+0000 7f458c557700 1 -- 172.21.15.38:0/851444807 shutdown_connections 2023-07-11T00:00:30.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.540+0000 7f458c557700 1 -- 172.21.15.38:0/851444807 wait complete. 2023-07-11T00:00:30.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.541+0000 7f458c557700 1 Processor -- start 2023-07-11T00:00:30.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.541+0000 7f458c557700 1 -- start start 2023-07-11T00:00:30.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458c557700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45840b8d90 0x7f45841e3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458c557700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45840bc810 0x7f45841e11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458c557700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841449d0 0x7f45841d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458c557700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45841d4120 con 0x7f45841449d0 2023-07-11T00:00:30.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458c557700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45841e39a0 con 0x7f45840b8d90 2023-07-11T00:00:30.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458c557700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45840b4610 con 0x7f45840bc810 2023-07-11T00:00:30.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458aaf4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841449d0 0x7f45841d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458aaf4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841449d0 0x7f45841d3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41032/0 (socket says 172.21.15.38:41032) 2023-07-11T00:00:30.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458aaf4700 1 -- 172.21.15.38:0/4228218267 learned_addr learned my addr 172.21.15.38:0/4228218267 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:30.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458a2f3700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45840b8d90 0x7f45841e3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f4589af2700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45840bc810 0x7f45841e11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458aaf4700 1 -- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45840bc810 msgr2=0x7f45841e11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458aaf4700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45840bc810 0x7f45841e11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458aaf4700 1 -- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45840b8d90 msgr2=0x7f45841e3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458aaf4700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45840b8d90 0x7f45841e3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458aaf4700 1 -- 172.21.15.38:0/4228218267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c009a70 con 0x7f45841449d0 2023-07-11T00:00:30.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458a2f3700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45840b8d90 0x7f45841e3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:30.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458aaf4700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841449d0 0x7f45841d3be0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f457c014040 tx=0x7f457c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:30.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f457affd700 1 -- 172.21.15.38:0/4228218267 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c0098f0 con 0x7f45841449d0 2023-07-11T00:00:30.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f457affd700 1 -- 172.21.15.38:0/4228218267 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c020070 con 0x7f45841449d0 2023-07-11T00:00:30.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458c557700 1 -- 172.21.15.38:0/4228218267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45841e3350 con 0x7f45841449d0 2023-07-11T00:00:30.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f457affd700 1 -- 172.21.15.38:0/4228218267 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c004280 con 0x7f45841449d0 2023-07-11T00:00:30.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.542+0000 7f458c557700 1 -- 172.21.15.38:0/4228218267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45840b33b0 con 0x7f45841449d0 2023-07-11T00:00:30.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.543+0000 7f458c557700 1 -- 172.21.15.38:0/4228218267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45841e3b50 con 0x7f45841449d0 2023-07-11T00:00:30.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.544+0000 7f457affd700 1 -- 172.21.15.38:0/4228218267 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f457c0043e0 con 0x7f45841449d0 2023-07-11T00:00:30.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.544+0000 7f457affd700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f456806ace0 0x7f456806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.544+0000 7f457affd700 1 -- 172.21.15.38:0/4228218267 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f457c022070 con 0x7f45841449d0 2023-07-11T00:00:30.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.544+0000 7f458a2f3700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f456806ace0 0x7f456806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.545+0000 7f458a2f3700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f456806ace0 0x7f456806d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4580000f60 tx=0x7f4580009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:30.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.548+0000 7f457affd700 1 -- 172.21.15.38:0/4228218267 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f45841e3b50 con 0x7f45841449d0 2023-07-11T00:00:30.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.744+0000 7f458c557700 1 -- 172.21.15.38:0/4228218267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45841e3b50 con 0x7f45841449d0 2023-07-11T00:00:30.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.744+0000 7f457affd700 1 -- 172.21.15.38:0/4228218267 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45841e3b50 con 0x7f45841449d0 2023-07-11T00:00:30.746 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-07-11T00:00:30.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 -- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f456806ace0 msgr2=0x7f456806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f456806ace0 0x7f456806d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4580000f60 tx=0x7f4580009040 comp rx=0 tx=0).stop 2023-07-11T00:00:30.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 -- 172.21.15.38:0/4228218267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841449d0 msgr2=0x7f45841d3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841449d0 0x7f45841d3be0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f457c014040 tx=0x7f457c004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 -- 172.21.15.38:0/4228218267 shutdown_connections 2023-07-11T00:00:30.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f456806ace0 0x7f456806d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45841449d0 0x7f45841d3be0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45840b8d90 0x7f45841e3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 --2- 172.21.15.38:0/4228218267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45840bc810 0x7f45841e11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 -- 172.21.15.38:0/4228218267 >> 172.21.15.38:0/4228218267 conn(0x7f45840c0860 msgr2=0x7f4584143a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:30.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 -- 172.21.15.38:0/4228218267 shutdown_connections 2023-07-11T00:00:30.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.746+0000 7f458c557700 1 -- 172.21.15.38:0/4228218267 wait complete. 2023-07-11T00:00:30.760 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:00:30.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.887+0000 7f6f87abc700 1 Processor -- start 2023-07-11T00:00:30.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.887+0000 7f6f87abc700 1 -- start start 2023-07-11T00:00:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f87abc700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6f801449d0 0x7f6f8014db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f87abc700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f800b8d90 0x7f6f8006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f87abc700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f800b8620 con 0x7f6f800bc810 2023-07-11T00:00:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f87abc700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f800b97a0 con 0x7f6f801449d0 2023-07-11T00:00:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f87abc700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80144da0 con 0x7f6f800b8d90 2023-07-11T00:00:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f85858700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6f801449d0 0x7f6f8014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f86059700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f800b8d90 0x7f6f8006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f85858700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6f801449d0 0x7f6f8014db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:38578/0 (socket says 172.21.15.38:38578) 2023-07-11T00:00:30.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f85057700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6f800bc810 0x7f6f800ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:35654/0 (socket says 172.21.15.38:35654) 2023-07-11T00:00:30.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f85858700 1 -- 172.21.15.38:0/1524790118 learned_addr learned my addr 172.21.15.38:0/1524790118 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:30.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f85858700 1 -- 172.21.15.38:0/1524790118 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f800b8d90 msgr2=0x7f6f8006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:30.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f85858700 1 --2- 172.21.15.38:0/1524790118 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f800b8d90 0x7f6f8006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f85858700 1 -- 172.21.15.38:0/1524790118 >> v1:172.21.15.70:6789/0 conn(0x7f6f800bc810 legacy=0x7f6f800ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.888+0000 7f6f85858700 1 -- 172.21.15.38:0/1524790118 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800b8900 con 0x7f6f801449d0 2023-07-11T00:00:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.889+0000 7f6f85858700 1 --2- 172.21.15.38:0/1524790118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f801449d0 0x7f6f8014db50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0098f0 tx=0x7f6f7c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69003c917911aa82 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.889+0000 7f6f84856700 1 -- 172.21.15.38:0/1524790118 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c011830 con 0x7f6f801449d0 2023-07-11T00:00:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.889+0000 7f6f84856700 1 -- 172.21.15.38:0/1524790118 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c011990 con 0x7f6f801449d0 2023-07-11T00:00:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.889+0000 7f6f84856700 1 -- 172.21.15.38:0/1524790118 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c011d20 con 0x7f6f801449d0 2023-07-11T00:00:30.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.889+0000 7f6f87abc700 1 -- 172.21.15.38:0/1524790118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f801449d0 msgr2=0x7f6f8014db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.889+0000 7f6f87abc700 1 --2- 172.21.15.38:0/1524790118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f801449d0 0x7f6f8014db50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0098f0 tx=0x7f6f7c009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:30.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.889+0000 7f6f87abc700 1 -- 172.21.15.38:0/1524790118 shutdown_connections 2023-07-11T00:00:30.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.889+0000 7f6f87abc700 1 --2- 172.21.15.38:0/1524790118 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f800b8d90 0x7f6f8006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.889+0000 7f6f87abc700 1 --2- 172.21.15.38:0/1524790118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f801449d0 0x7f6f8014db50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.889+0000 7f6f87abc700 1 -- 172.21.15.38:0/1524790118 >> 172.21.15.38:0/1524790118 conn(0x7f6f800c0860 msgr2=0x7f6f800c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.890+0000 7f6f87abc700 1 -- 172.21.15.38:0/1524790118 shutdown_connections 2023-07-11T00:00:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.890+0000 7f6f87abc700 1 -- 172.21.15.38:0/1524790118 wait complete. 2023-07-11T00:00:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f87abc700 1 Processor -- start 2023-07-11T00:00:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f87abc700 1 -- start start 2023-07-11T00:00:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f87abc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f800b8d90 0x7f6f801d7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f87abc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800bc810 0x7f6f801e2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f87abc700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f801449d0 0x7f6f800a6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f87abc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f801d7840 con 0x7f6f800bc810 2023-07-11T00:00:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f87abc700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f800b25a0 con 0x7f6f800b8d90 2023-07-11T00:00:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f87abc700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f800b39c0 con 0x7f6f801449d0 2023-07-11T00:00:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f85057700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800bc810 0x7f6f801e2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f85858700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f800b8d90 0x7f6f801d7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f85057700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800bc810 0x7f6f801e2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41034/0 (socket says 172.21.15.38:41034) 2023-07-11T00:00:30.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f85057700 1 -- 172.21.15.38:0/3464247880 learned_addr learned my addr 172.21.15.38:0/3464247880 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.891+0000 7f6f86059700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f801449d0 0x7f6f800a6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f85858700 1 -- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f801449d0 msgr2=0x7f6f800a6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f85858700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f801449d0 0x7f6f800a6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f85858700 1 -- 172.21.15.38:0/3464247880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800bc810 msgr2=0x7f6f801e2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f85858700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800bc810 0x7f6f801e2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f85858700 1 -- 172.21.15.38:0/3464247880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c009550 con 0x7f6f800b8d90 2023-07-11T00:00:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f85057700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800bc810 0x7f6f801e2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f85858700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f800b8d90 0x7f6f801d7300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c016000 tx=0x7f6f7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f767fc700 1 -- 172.21.15.38:0/3464247880 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c004590 con 0x7f6f800b8d90 2023-07-11T00:00:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f767fc700 1 -- 172.21.15.38:0/3464247880 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c01e070 con 0x7f6f800b8d90 2023-07-11T00:00:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f87abc700 1 -- 172.21.15.38:0/3464247880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f800b4460 con 0x7f6f800b8d90 2023-07-11T00:00:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f767fc700 1 -- 172.21.15.38:0/3464247880 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c0038a0 con 0x7f6f800b8d90 2023-07-11T00:00:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.892+0000 7f6f87abc700 1 -- 172.21.15.38:0/3464247880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f800b3c60 con 0x7f6f800b8d90 2023-07-11T00:00:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.893+0000 7f6f87abc700 1 -- 172.21.15.38:0/3464247880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f80074360 con 0x7f6f800b8d90 2023-07-11T00:00:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.893+0000 7f6f767fc700 1 -- 172.21.15.38:0/3464247880 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f7c003a00 con 0x7f6f800b8d90 2023-07-11T00:00:30.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.894+0000 7f6f767fc700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6f6406ace0 0x7f6f6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:30.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.894+0000 7f6f767fc700 1 -- 172.21.15.38:0/3464247880 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f7c08a4e0 con 0x7f6f800b8d90 2023-07-11T00:00:30.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.894+0000 7f6f85057700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6f6406ace0 0x7f6f6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:30.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.894+0000 7f6f85057700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6f6406ace0 0x7f6f6406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6f8014ddc0 tx=0x7f6f70007f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:30.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:30.899+0000 7f6f767fc700 1 -- 172.21.15.38:0/3464247880 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6f7c0554f0 con 0x7f6f800b8d90 2023-07-11T00:00:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.093+0000 7f6f87abc700 1 -- 172.21.15.38:0/3464247880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f800bbe90 con 0x7f6f800b8d90 2023-07-11T00:00:31.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.093+0000 7f6f767fc700 1 -- 172.21.15.38:0/3464247880 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f7c020020 con 0x7f6f800b8d90 2023-07-11T00:00:31.095 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-07-11T00:00:31.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 -- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6f6406ace0 msgr2=0x7f6f6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6f6406ace0 0x7f6f6406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6f8014ddc0 tx=0x7f6f70007f90 comp rx=0 tx=0).stop 2023-07-11T00:00:31.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 -- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f800b8d90 msgr2=0x7f6f801d7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f800b8d90 0x7f6f801d7300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c016000 tx=0x7f6f7c004750 comp rx=0 tx=0).stop 2023-07-11T00:00:31.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 -- 172.21.15.38:0/3464247880 shutdown_connections 2023-07-11T00:00:31.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6f6406ace0 0x7f6f6406d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f801449d0 0x7f6f800a6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f800b8d90 0x7f6f801d7300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 --2- 172.21.15.38:0/3464247880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800bc810 0x7f6f801e2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 -- 172.21.15.38:0/3464247880 >> 172.21.15.38:0/3464247880 conn(0x7f6f800c0860 msgr2=0x7f6f800baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:31.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 -- 172.21.15.38:0/3464247880 shutdown_connections 2023-07-11T00:00:31.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.096+0000 7f6f87abc700 1 -- 172.21.15.38:0/3464247880 wait complete. 2023-07-11T00:00:31.109 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:00:31.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.233+0000 7f28a1cc7700 1 Processor -- start 2023-07-11T00:00:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.233+0000 7f28a1cc7700 1 -- start start 2023-07-11T00:00:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.234+0000 7f28a1cc7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f289c147dc0 0x7f289c0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.234+0000 7f28a1cc7700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c06f680 con 0x7f289c071840 2023-07-11T00:00:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.234+0000 7f28a1cc7700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c06f920 con 0x7f289c069f30 2023-07-11T00:00:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.234+0000 7f28a1cc7700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289c070950 con 0x7f289c147dc0 2023-07-11T00:00:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.234+0000 7f289b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f289c147dc0 0x7f289c0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.234+0000 7f289b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f289c147dc0 0x7f289c0721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41050/0 (socket says 172.21.15.38:41050) 2023-07-11T00:00:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.234+0000 7f289bfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f289c071840 0x7f289c154ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53300/0 (socket says 172.21.15.38:53300) 2023-07-11T00:00:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.234+0000 7f289b7fe700 1 -- 172.21.15.38:0/126625552 learned_addr learned my addr 172.21.15.38:0/126625552 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f289b7fe700 1 -- 172.21.15.38:0/126625552 >> v1:172.21.15.70:6789/0 conn(0x7f289c069f30 legacy=0x7f289c071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f289b7fe700 1 -- 172.21.15.38:0/126625552 >> v1:172.21.15.38:6789/0 conn(0x7f289c071840 legacy=0x7f289c154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f289b7fe700 1 -- 172.21.15.38:0/126625552 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c0b9660 con 0x7f289c147dc0 2023-07-11T00:00:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f289b7fe700 1 --2- 172.21.15.38:0/126625552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f289c147dc0 0x7f289c0721e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f288c0098f0 tx=0x7f288c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c6b825afae1e08 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f289a7fc700 1 -- 172.21.15.38:0/126625552 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c004230 con 0x7f289c147dc0 2023-07-11T00:00:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f289a7fc700 1 -- 172.21.15.38:0/126625552 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c004390 con 0x7f289c147dc0 2023-07-11T00:00:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f289a7fc700 1 -- 172.21.15.38:0/126625552 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0036a0 con 0x7f289c147dc0 2023-07-11T00:00:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f28a1cc7700 1 -- 172.21.15.38:0/126625552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f289c147dc0 msgr2=0x7f289c0721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f28a1cc7700 1 --2- 172.21.15.38:0/126625552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f289c147dc0 0x7f289c0721e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f288c0098f0 tx=0x7f288c009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f28a1cc7700 1 -- 172.21.15.38:0/126625552 shutdown_connections 2023-07-11T00:00:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f28a1cc7700 1 --2- 172.21.15.38:0/126625552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f289c147dc0 0x7f289c0721e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f28a1cc7700 1 -- 172.21.15.38:0/126625552 >> 172.21.15.38:0/126625552 conn(0x7f289c06d0e0 msgr2=0x7f289c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.235+0000 7f28a1cc7700 1 -- 172.21.15.38:0/126625552 shutdown_connections 2023-07-11T00:00:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.236+0000 7f28a1cc7700 1 -- 172.21.15.38:0/126625552 wait complete. 2023-07-11T00:00:31.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.237+0000 7f28a1cc7700 1 Processor -- start 2023-07-11T00:00:31.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.237+0000 7f28a1cc7700 1 -- start start 2023-07-11T00:00:31.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.237+0000 7f28a1cc7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f289c069f30 0x7f289c0b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.237+0000 7f28a1cc7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f289c071840 0x7f289c149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.237+0000 7f28a1cc7700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f289c147dc0 0x7f289c148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.237+0000 7f28a1cc7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c14a160 con 0x7f289c069f30 2023-07-11T00:00:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.237+0000 7f28a1cc7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0b69b0 con 0x7f289c071840 2023-07-11T00:00:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.237+0000 7f28a1cc7700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c148400 con 0x7f289c147dc0 2023-07-11T00:00:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.237+0000 7f289b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f289c069f30 0x7f289c0b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.237+0000 7f289b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f289c069f30 0x7f289c0b7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41058/0 (socket says 172.21.15.38:41058) 2023-07-11T00:00:31.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.237+0000 7f289b7fe700 1 -- 172.21.15.38:0/3996455898 learned_addr learned my addr 172.21.15.38:0/3996455898 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:31.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f289bfff700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f289c147dc0 0x7f289c148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f289affd700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f289c071840 0x7f289c149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f289b7fe700 1 -- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f289c147dc0 msgr2=0x7f289c148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f289b7fe700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f289c147dc0 0x7f289c148e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f289b7fe700 1 -- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f289c071840 msgr2=0x7f289c149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f289b7fe700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f289c071840 0x7f289c149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f289b7fe700 1 -- 172.21.15.38:0/3996455898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c009550 con 0x7f289c069f30 2023-07-11T00:00:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f289affd700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f289c071840 0x7f289c149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f289b7fe700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f289c069f30 0x7f289c0b7600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f289c070840 tx=0x7f288c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f2893fff700 1 -- 172.21.15.38:0/3996455898 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00b660 con 0x7f289c069f30 2023-07-11T00:00:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f2893fff700 1 -- 172.21.15.38:0/3996455898 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c00b7e0 con 0x7f289c069f30 2023-07-11T00:00:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f28a1cc7700 1 -- 172.21.15.38:0/3996455898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c0b6bc0 con 0x7f289c069f30 2023-07-11T00:00:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f2893fff700 1 -- 172.21.15.38:0/3996455898 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00bb90 con 0x7f289c069f30 2023-07-11T00:00:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.238+0000 7f28a1cc7700 1 -- 172.21.15.38:0/3996455898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c0b4d20 con 0x7f289c069f30 2023-07-11T00:00:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.239+0000 7f28a1cc7700 1 -- 172.21.15.38:0/3996455898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289c148760 con 0x7f289c069f30 2023-07-11T00:00:31.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.240+0000 7f2893fff700 1 -- 172.21.15.38:0/3996455898 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f288c00bcf0 con 0x7f289c069f30 2023-07-11T00:00:31.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.240+0000 7f2893fff700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f287c06ace0 0x7f287c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.240+0000 7f2893fff700 1 -- 172.21.15.38:0/3996455898 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f288c08add0 con 0x7f289c069f30 2023-07-11T00:00:31.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.240+0000 7f289affd700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f287c06ace0 0x7f287c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.241+0000 7f289affd700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f287c06ace0 0x7f287c06d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f289c1e4310 tx=0x7f2884009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:31.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.244+0000 7f2893fff700 1 -- 172.21.15.38:0/3996455898 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f288c055f10 con 0x7f289c069f30 2023-07-11T00:00:31.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.486+0000 7f28a1cc7700 1 -- 172.21.15.38:0/3996455898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f289c148540 con 0x7f289c069f30 2023-07-11T00:00:31.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.486+0000 7f2893fff700 1 -- 172.21.15.38:0/3996455898 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3909 (secure 0 0 0) 0x7f288c08cf60 con 0x7f289c069f30 2023-07-11T00:00:31.488 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:31.489 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3612343661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3612343661},{"type":"v1","addr":"172.21.15.38:6834","nonce":3612343661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3097729806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3097729806},{"type":"v1","addr":"172.21.15.70:6835","nonce":3097729806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:00:16.787420+0000","modified":"2023-07-11T00:00:19.806642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3594015619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3594015619},{"type":"v1","addr":"172.21.15.38:6835","nonce":3594015619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:00:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 -- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f287c06ace0 msgr2=0x7f287c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f287c06ace0 0x7f287c06d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f289c1e4310 tx=0x7f2884009040 comp rx=0 tx=0).stop 2023-07-11T00:00:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 -- 172.21.15.38:0/3996455898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f289c069f30 msgr2=0x7f289c0b7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f289c069f30 0x7f289c0b7600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f289c070840 tx=0x7f288c004750 comp rx=0 tx=0).stop 2023-07-11T00:00:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 -- 172.21.15.38:0/3996455898 shutdown_connections 2023-07-11T00:00:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f287c06ace0 0x7f287c06d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f289c147dc0 0x7f289c148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f289c069f30 0x7f289c0b7600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 --2- 172.21.15.38:0/3996455898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f289c071840 0x7f289c149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 -- 172.21.15.38:0/3996455898 >> 172.21.15.38:0/3996455898 conn(0x7f289c06d0e0 msgr2=0x7f289c143490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 -- 172.21.15.38:0/3996455898 shutdown_connections 2023-07-11T00:00:31.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.488+0000 7f28a1cc7700 1 -- 172.21.15.38:0/3996455898 wait complete. 2023-07-11T00:00:31.492 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 7 2023-07-11T00:00:31.502 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:31.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.625+0000 7f203091e700 1 Processor -- start 2023-07-11T00:00:31.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.625+0000 7f203091e700 1 -- start start 2023-07-11T00:00:31.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.626+0000 7f203091e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f202c0bc810 0x7f202c0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.626+0000 7f203091e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f202c0b8d90 0x7f202c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.626+0000 7f203091e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0b8620 con 0x7f202c1449d0 2023-07-11T00:00:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.626+0000 7f203091e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c0b97a0 con 0x7f202c0b8d90 2023-07-11T00:00:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.626+0000 7f203091e700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c144da0 con 0x7f202c0bc810 2023-07-11T00:00:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.626+0000 7f202ad9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f202c0b8d90 0x7f202c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.626+0000 7f202a59c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f202c1449d0 0x7f202c14db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53304/0 (socket says 172.21.15.38:53304) 2023-07-11T00:00:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.626+0000 7f202a59c700 1 -- 172.21.15.38:0/1280717424 learned_addr learned my addr 172.21.15.38:0/1280717424 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.627+0000 7f2029d9b700 1 --2- 172.21.15.38:0/1280717424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f202c0bc810 0x7f202c0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.627+0000 7f202ad9d700 1 -- 172.21.15.38:0/1280717424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f202c0bc810 msgr2=0x7f202c0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:31.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.627+0000 7f202ad9d700 1 --2- 172.21.15.38:0/1280717424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f202c0bc810 0x7f202c0ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.627+0000 7f202ad9d700 1 -- 172.21.15.38:0/1280717424 >> v1:172.21.15.38:6789/0 conn(0x7f202c1449d0 legacy=0x7f202c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.627+0000 7f202959a700 1 -- 172.21.15.38:0/1280717424 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597739568 0 0) 0x7f202c0b8620 con 0x7f202c1449d0 2023-07-11T00:00:31.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.627+0000 7f202ad9d700 1 -- 172.21.15.38:0/1280717424 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0b8900 con 0x7f202c0b8d90 2023-07-11T00:00:31.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.627+0000 7f202ad9d700 1 --2- 172.21.15.38:0/1280717424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f202c0b8d90 0x7f202c06ade0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2024009d90 tx=0x7f202400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508bffb06c5093bd server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:31.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.627+0000 7f202959a700 1 -- 172.21.15.38:0/1280717424 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202400e070 con 0x7f202c0b8d90 2023-07-11T00:00:31.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.627+0000 7f202959a700 1 -- 172.21.15.38:0/1280717424 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202400bb20 con 0x7f202c0b8d90 2023-07-11T00:00:31.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.627+0000 7f202959a700 1 -- 172.21.15.38:0/1280717424 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024012430 con 0x7f202c0b8d90 2023-07-11T00:00:31.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.628+0000 7f203091e700 1 -- 172.21.15.38:0/1280717424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f202c0b8d90 msgr2=0x7f202c06ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.628+0000 7f203091e700 1 --2- 172.21.15.38:0/1280717424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f202c0b8d90 0x7f202c06ade0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2024009d90 tx=0x7f202400b330 comp rx=0 tx=0).stop 2023-07-11T00:00:31.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.628+0000 7f203091e700 1 -- 172.21.15.38:0/1280717424 shutdown_connections 2023-07-11T00:00:31.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.628+0000 7f203091e700 1 --2- 172.21.15.38:0/1280717424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f202c0b8d90 0x7f202c06ade0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.628+0000 7f203091e700 1 --2- 172.21.15.38:0/1280717424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f202c0bc810 0x7f202c0ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.628+0000 7f203091e700 1 -- 172.21.15.38:0/1280717424 >> 172.21.15.38:0/1280717424 conn(0x7f202c0c0860 msgr2=0x7f202c0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.628+0000 7f203091e700 1 -- 172.21.15.38:0/1280717424 shutdown_connections 2023-07-11T00:00:31.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.628+0000 7f203091e700 1 -- 172.21.15.38:0/1280717424 wait complete. 2023-07-11T00:00:31.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.629+0000 7f203091e700 1 Processor -- start 2023-07-11T00:00:31.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.629+0000 7f203091e700 1 -- start start 2023-07-11T00:00:31.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f203091e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f202c0b8d90 0x7f202c1d3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f203091e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f202c0bc810 0x7f202c0b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f203091e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f202c1449d0 0x7f202c0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f203091e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0b69c0 con 0x7f202c0b8d90 2023-07-11T00:00:31.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f203091e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0b7470 con 0x7f202c0bc810 2023-07-11T00:00:31.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f203091e700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c1d7350 con 0x7f202c1449d0 2023-07-11T00:00:31.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f202a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f202c0b8d90 0x7f202c1d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f202a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f202c0b8d90 0x7f202c1d3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41074/0 (socket says 172.21.15.38:41074) 2023-07-11T00:00:31.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f202a59c700 1 -- 172.21.15.38:0/2774136738 learned_addr learned my addr 172.21.15.38:0/2774136738 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:31.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f202ad9d700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f202c1449d0 0x7f202c0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f2029d9b700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f202c0bc810 0x7f202c0b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f202a59c700 1 -- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f202c1449d0 msgr2=0x7f202c0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f202a59c700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f202c1449d0 0x7f202c0b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f202a59c700 1 -- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f202c0bc810 msgr2=0x7f202c0b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f202a59c700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f202c0bc810 0x7f202c0b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f202a59c700 1 -- 172.21.15.38:0/2774136738 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2024009a70 con 0x7f202c0b8d90 2023-07-11T00:00:31.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f202ad9d700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f202c1449d0 0x7f202c0b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:31.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f202a59c700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f202c0b8d90 0x7f202c1d3860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f201c00c550 tx=0x7f201c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:31.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f201affd700 1 -- 172.21.15.38:0/2774136738 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c004c80 con 0x7f202c0b8d90 2023-07-11T00:00:31.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f201affd700 1 -- 172.21.15.38:0/2774136738 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c004e00 con 0x7f202c0b8d90 2023-07-11T00:00:31.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f203091e700 1 -- 172.21.15.38:0/2774136738 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c1d7630 con 0x7f202c0b8d90 2023-07-11T00:00:31.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f201affd700 1 -- 172.21.15.38:0/2774136738 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c007310 con 0x7f202c0b8d90 2023-07-11T00:00:31.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.630+0000 7f203091e700 1 -- 172.21.15.38:0/2774136738 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c0b4e10 con 0x7f202c0b8d90 2023-07-11T00:00:31.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.631+0000 7f203091e700 1 -- 172.21.15.38:0/2774136738 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c074360 con 0x7f202c0b8d90 2023-07-11T00:00:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.632+0000 7f201affd700 1 -- 172.21.15.38:0/2774136738 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f201c007470 con 0x7f202c0b8d90 2023-07-11T00:00:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.632+0000 7f201affd700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f200c06ace0 0x7f200c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.633+0000 7f201affd700 1 -- 172.21.15.38:0/2774136738 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f201c0891a0 con 0x7f202c0b8d90 2023-07-11T00:00:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.633+0000 7f2029d9b700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f200c06ace0 0x7f200c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.633+0000 7f2029d9b700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f200c06ace0 0x7f200c06d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f202c147e00 tx=0x7f2020008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:31.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.637+0000 7f201affd700 1 -- 172.21.15.38:0/2774136738 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f201c054240 con 0x7f202c0b8d90 2023-07-11T00:00:31.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.834+0000 7f203091e700 1 -- 172.21.15.38:0/2774136738 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f202c0a6960 con 0x7f202c0b8d90 2023-07-11T00:00:31.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.836+0000 7f201affd700 1 -- 172.21.15.38:0/2774136738 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f201c057860 con 0x7f202c0b8d90 2023-07-11T00:00:31.838 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:31.838 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:31.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 -- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f200c06ace0 msgr2=0x7f200c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f200c06ace0 0x7f200c06d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f202c147e00 tx=0x7f2020008040 comp rx=0 tx=0).stop 2023-07-11T00:00:31.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 -- 172.21.15.38:0/2774136738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f202c0b8d90 msgr2=0x7f202c1d3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f202c0b8d90 0x7f202c1d3860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f201c00c550 tx=0x7f201c00c910 comp rx=0 tx=0).stop 2023-07-11T00:00:31.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 -- 172.21.15.38:0/2774136738 shutdown_connections 2023-07-11T00:00:31.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f200c06ace0 0x7f200c06d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f202c1449d0 0x7f202c0b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f202c0b8d90 0x7f202c1d3860 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 --2- 172.21.15.38:0/2774136738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f202c0bc810 0x7f202c0b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 -- 172.21.15.38:0/2774136738 >> 172.21.15.38:0/2774136738 conn(0x7f202c0c0860 msgr2=0x7f202c1438e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:31.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 -- 172.21.15.38:0/2774136738 shutdown_connections 2023-07-11T00:00:31.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.838+0000 7f203091e700 1 -- 172.21.15.38:0/2774136738 wait complete. 2023-07-11T00:00:31.852 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:00:31.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.976+0000 7f86678be700 1 Processor -- start 2023-07-11T00:00:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.976+0000 7f86678be700 1 -- start start 2023-07-11T00:00:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.977+0000 7f86678be700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8660071a30 0x7f866014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.977+0000 7f86678be700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86600b96b0 0x7f8660151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.977+0000 7f86678be700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8660070e70 con 0x7f8660141780 2023-07-11T00:00:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.977+0000 7f86678be700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86600ba720 con 0x7f8660071a30 2023-07-11T00:00:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.977+0000 7f86678be700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8660071ea0 con 0x7f86600b96b0 2023-07-11T00:00:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.977+0000 7f866565a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8660141780 0x7f86600ba010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53312/0 (socket says 172.21.15.38:53312) 2023-07-11T00:00:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.977+0000 7f866565a700 1 -- 172.21.15.38:0/1941614189 learned_addr learned my addr 172.21.15.38:0/1941614189 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.977+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880812525 0 0) 0x7f8660070e70 con 0x7f8660141780 2023-07-11T00:00:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f864c0035b0 con 0x7f8660141780 2023-07-11T00:00:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8664e59700 1 --2- 172.21.15.38:0/1941614189 >> v2:172.21.15.70:3300/0 conn(0x7f8660071a30 0x7f866014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8665e5b700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86600b96b0 0x7f8660151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1028309552 0 0) 0x7f864c0035b0 con 0x7f8660141780 2023-07-11T00:00:31.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86600b96b0 msgr2=0x7f8660151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:31.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86600b96b0 0x7f8660151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 >> v2:172.21.15.70:3300/0 conn(0x7f8660071a30 msgr2=0x7f866014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:31.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 --2- 172.21.15.38:0/1941614189 >> v2:172.21.15.70:3300/0 conn(0x7f8660071a30 0x7f866014ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600b9b40 con 0x7f8660141780 2023-07-11T00:00:31.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f8650001670 con 0x7f8660141780 2023-07-11T00:00:31.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 >> v1:172.21.15.38:6789/0 conn(0x7f8660141780 legacy=0x7f86600ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 0x7f864c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86600b96b0 0x7f864c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f864c004d90 0x7f864c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86600ba720 con 0x7f864c003a00 2023-07-11T00:00:31.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660071ea0 con 0x7f864c004d90 2023-07-11T00:00:31.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c00bac0 con 0x7f86600b96b0 2023-07-11T00:00:31.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f866565a700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 0x7f864c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8664e59700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86600b96b0 0x7f864c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8665e5b700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f864c004d90 0x7f864c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f866565a700 1 -- 172.21.15.38:0/1941614189 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86600b96b0 msgr2=0x7f864c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:31.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f866565a700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86600b96b0 0x7f864c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f866565a700 1 -- 172.21.15.38:0/1941614189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f864c004d90 msgr2=0x7f864c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:31.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f866565a700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f864c004d90 0x7f864c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f866565a700 1 -- 172.21.15.38:0/1941614189 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0035b0 con 0x7f864c003a00 2023-07-11T00:00:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f866565a700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 0x7f864c003e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f865000c2f0 tx=0x7f864c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb14d9303f66d7e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650007c40 con 0x7f864c003a00 2023-07-11T00:00:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865000ce30 con 0x7f864c003a00 2023-07-11T00:00:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.978+0000 7f8657fff700 1 -- 172.21.15.38:0/1941614189 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650005ba0 con 0x7f864c003a00 2023-07-11T00:00:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.979+0000 7f86678be700 1 -- 172.21.15.38:0/1941614189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 msgr2=0x7f864c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.979+0000 7f86678be700 1 --2- 172.21.15.38:0/1941614189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 0x7f864c003e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f865000c2f0 tx=0x7f864c005880 comp rx=0 tx=0).stop 2023-07-11T00:00:31.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.979+0000 7f8665e5b700 1 -- 172.21.15.38:0/1941614189 reap_dead start 2023-07-11T00:00:31.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.979+0000 7f86678be700 1 -- 172.21.15.38:0/1941614189 shutdown_connections 2023-07-11T00:00:31.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.979+0000 7f86678be700 1 -- 172.21.15.38:0/1941614189 >> 172.21.15.38:0/1941614189 conn(0x7f866006d0e0 msgr2=0x7f866006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:31.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.979+0000 7f86678be700 1 -- 172.21.15.38:0/1941614189 shutdown_connections 2023-07-11T00:00:31.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.979+0000 7f86678be700 1 -- 172.21.15.38:0/1941614189 wait complete. 2023-07-11T00:00:31.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.980+0000 7f86678be700 1 Processor -- start 2023-07-11T00:00:31.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.980+0000 7f86678be700 1 -- start start 2023-07-11T00:00:31.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f86678be700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 0x7f866014ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f86678be700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8660144c10 0x7f86600b6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f86678be700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86601e1290 0x7f8660135690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:31.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f86678be700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866014b280 con 0x7f864c003a00 2023-07-11T00:00:31.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f86678be700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86601444a0 con 0x7f8660144c10 2023-07-11T00:00:31.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f86678be700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86600b75a0 con 0x7f86601e1290 2023-07-11T00:00:31.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f866565a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 0x7f866014ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f866565a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 0x7f866014ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41090/0 (socket says 172.21.15.38:41090) 2023-07-11T00:00:31.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f866565a700 1 -- 172.21.15.38:0/219446679 learned_addr learned my addr 172.21.15.38:0/219446679 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:31.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f8664e59700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8660144c10 0x7f86600b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:31.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f8665e5b700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86601e1290 0x7f8660135690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f866565a700 1 -- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86601e1290 msgr2=0x7f8660135690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f866565a700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86601e1290 0x7f8660135690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f866565a700 1 -- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8660144c10 msgr2=0x7f86600b6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f866565a700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8660144c10 0x7f86600b6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f866565a700 1 -- 172.21.15.38:0/219446679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600b7180 con 0x7f864c003a00 2023-07-11T00:00:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.981+0000 7f866565a700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 0x7f866014ad40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f864c00ba10 tx=0x7f86600701a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.982+0000 7f8655ffb700 1 -- 172.21.15.38:0/219446679 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500070d0 con 0x7f864c003a00 2023-07-11T00:00:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.982+0000 7f8655ffb700 1 -- 172.21.15.38:0/219446679 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8650007250 con 0x7f864c003a00 2023-07-11T00:00:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.982+0000 7f86678be700 1 -- 172.21.15.38:0/219446679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86600bcbd0 con 0x7f864c003a00 2023-07-11T00:00:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.982+0000 7f8655ffb700 1 -- 172.21.15.38:0/219446679 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650007600 con 0x7f864c003a00 2023-07-11T00:00:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.982+0000 7f86678be700 1 -- 172.21.15.38:0/219446679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86601446f0 con 0x7f864c003a00 2023-07-11T00:00:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.983+0000 7f86678be700 1 -- 172.21.15.38:0/219446679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8660074360 con 0x7f864c003a00 2023-07-11T00:00:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.983+0000 7f8655ffb700 1 -- 172.21.15.38:0/219446679 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f865001e430 con 0x7f864c003a00 2023-07-11T00:00:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.984+0000 7f8655ffb700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f864406ace0 0x7f864406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.984+0000 7f8655ffb700 1 -- 172.21.15.38:0/219446679 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f865008aa50 con 0x7f864c003a00 2023-07-11T00:00:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.984+0000 7f8664e59700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f864406ace0 0x7f864406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.984+0000 7f8664e59700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f864406ace0 0x7f864406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86601dee50 tx=0x7f865c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:31.988+0000 7f8655ffb700 1 -- 172.21.15.38:0/219446679 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8650055c50 con 0x7f864c003a00 2023-07-11T00:00:32.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.230+0000 7f86678be700 1 -- 172.21.15.38:0/219446679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f866014b930 con 0x7f864c003a00 2023-07-11T00:00:32.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.231+0000 7f8655ffb700 1 -- 172.21.15.38:0/219446679 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3909 (secure 0 0 0) 0x7f8650007da0 con 0x7f864c003a00 2023-07-11T00:00:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:32.233 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3612343661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3612343661},{"type":"v1","addr":"172.21.15.38:6834","nonce":3612343661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3097729806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3097729806},{"type":"v1","addr":"172.21.15.70:6835","nonce":3097729806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:00:16.787420+0000","modified":"2023-07-11T00:00:19.806642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3594015619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3594015619},{"type":"v1","addr":"172.21.15.38:6835","nonce":3594015619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:00:32.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 -- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f864406ace0 msgr2=0x7f864406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f864406ace0 0x7f864406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86601dee50 tx=0x7f865c008040 comp rx=0 tx=0).stop 2023-07-11T00:00:32.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 -- 172.21.15.38:0/219446679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 msgr2=0x7f866014ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 0x7f866014ad40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f864c00ba10 tx=0x7f86600701a0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 -- 172.21.15.38:0/219446679 shutdown_connections 2023-07-11T00:00:32.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f864406ace0 0x7f864406d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86601e1290 0x7f8660135690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f864c003a00 0x7f866014ad40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 --2- 172.21.15.38:0/219446679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8660144c10 0x7f86600b6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 -- 172.21.15.38:0/219446679 >> 172.21.15.38:0/219446679 conn(0x7f866006d0e0 msgr2=0x7f86601406b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:32.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 -- 172.21.15.38:0/219446679 shutdown_connections 2023-07-11T00:00:32.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.233+0000 7f86678be700 1 -- 172.21.15.38:0/219446679 wait complete. 2023-07-11T00:00:32.237 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 7 2023-07-11T00:00:32.549 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-11T00:00:16.787420+0000', 'modified': '2023-07-11T00:00:19.806642+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.38:6835/3594015619', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6833', 'nonce': 3594015619}, {'type': 'v1', 'addr': '172.21.15.38:6835', 'nonce': 3594015619}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-11T00:00:32.549 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-11T00:00:32.549 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-11T00:00:32.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.678+0000 7f87bd752700 1 Processor -- start 2023-07-11T00:00:32.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.678+0000 7f87bd752700 1 -- start start 2023-07-11T00:00:32.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.678+0000 7f87bd752700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f87b81449d0 0x7f87b814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.678+0000 7f87bd752700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f87b80bc810 0x7f87b80ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.678+0000 7f87bd752700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b80b8620 con 0x7f87b80b8d90 2023-07-11T00:00:32.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.678+0000 7f87bd752700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b80b97a0 con 0x7f87b80bc810 2023-07-11T00:00:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.678+0000 7f87bd752700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b8144da0 con 0x7f87b81449d0 2023-07-11T00:00:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.678+0000 7f87b67fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f87b80bc810 0x7f87b80ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.679+0000 7f87b67fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f87b80bc810 0x7f87b80ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41104/0 (socket says 172.21.15.38:41104) 2023-07-11T00:00:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.679+0000 7f87b67fc700 1 -- 172.21.15.38:0/1880011145 learned_addr learned my addr 172.21.15.38:0/1880011145 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:32.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.679+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/1880011145 >> v2:172.21.15.70:3300/0 conn(0x7f87b81449d0 0x7f87b814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.679+0000 7f87b67fc700 1 -- 172.21.15.38:0/1880011145 >> v2:172.21.15.70:3300/0 conn(0x7f87b81449d0 msgr2=0x7f87b814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:32.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.679+0000 7f87b67fc700 1 --2- 172.21.15.38:0/1880011145 >> v2:172.21.15.70:3300/0 conn(0x7f87b81449d0 0x7f87b814db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.679+0000 7f87b67fc700 1 -- 172.21.15.38:0/1880011145 >> v1:172.21.15.70:6789/0 conn(0x7f87b80b8d90 legacy=0x7f87b806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:32.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.679+0000 7f87b67fc700 1 -- 172.21.15.38:0/1880011145 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b80b8900 con 0x7f87b80bc810 2023-07-11T00:00:32.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.679+0000 7f87b67fc700 1 --2- 172.21.15.38:0/1880011145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87b80bc810 0x7f87b80ba530 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f87b806cbe0 tx=0x7f87a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9274f1daad931a6e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:32.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.679+0000 7f87b5ffb700 1 -- 172.21.15.38:0/1880011145 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8004230 con 0x7f87b80bc810 2023-07-11T00:00:32.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.679+0000 7f87b5ffb700 1 -- 172.21.15.38:0/1880011145 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a8004390 con 0x7f87b80bc810 2023-07-11T00:00:32.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.679+0000 7f87b5ffb700 1 -- 172.21.15.38:0/1880011145 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a80036a0 con 0x7f87b80bc810 2023-07-11T00:00:32.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.680+0000 7f87bd752700 1 -- 172.21.15.38:0/1880011145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87b80bc810 msgr2=0x7f87b80ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.680+0000 7f87bd752700 1 --2- 172.21.15.38:0/1880011145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87b80bc810 0x7f87b80ba530 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f87b806cbe0 tx=0x7f87a8009bd0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.680+0000 7f87bd752700 1 -- 172.21.15.38:0/1880011145 shutdown_connections 2023-07-11T00:00:32.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.680+0000 7f87bd752700 1 --2- 172.21.15.38:0/1880011145 >> v2:172.21.15.70:3300/0 conn(0x7f87b81449d0 0x7f87b814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.680+0000 7f87bd752700 1 --2- 172.21.15.38:0/1880011145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87b80bc810 0x7f87b80ba530 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.680+0000 7f87bd752700 1 -- 172.21.15.38:0/1880011145 >> 172.21.15.38:0/1880011145 conn(0x7f87b80c0860 msgr2=0x7f87b80c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:32.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.680+0000 7f87bd752700 1 -- 172.21.15.38:0/1880011145 shutdown_connections 2023-07-11T00:00:32.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.680+0000 7f87bd752700 1 -- 172.21.15.38:0/1880011145 wait complete. 2023-07-11T00:00:32.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.681+0000 7f87bd752700 1 Processor -- start 2023-07-11T00:00:32.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.681+0000 7f87bd752700 1 -- start start 2023-07-11T00:00:32.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.681+0000 7f87bd752700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87b80b8d90 0x7f87b80b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87bd752700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87b80bc810 0x7f87b81e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87bd752700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b81449d0 0x7f87b81450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87bd752700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b81e3220 con 0x7f87b80bc810 2023-07-11T00:00:32.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87bd752700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b8145980 con 0x7f87b81449d0 2023-07-11T00:00:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87bd752700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b81e3470 con 0x7f87b80b8d90 2023-07-11T00:00:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b67fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87b80bc810 0x7f87b81e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b67fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87b80bc810 0x7f87b81e3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41106/0 (socket says 172.21.15.38:41106) 2023-07-11T00:00:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b67fc700 1 -- 172.21.15.38:0/1414635698 learned_addr learned my addr 172.21.15.38:0/1414635698 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87b80b8d90 0x7f87b80b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b77fe700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b81449d0 0x7f87b81450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b67fc700 1 -- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87b80b8d90 msgr2=0x7f87b80b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b67fc700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87b80b8d90 0x7f87b80b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b67fc700 1 -- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b81449d0 msgr2=0x7f87b81450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b67fc700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b81449d0 0x7f87b81450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b67fc700 1 -- 172.21.15.38:0/1414635698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8009550 con 0x7f87b80bc810 2023-07-11T00:00:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b77fe700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b81449d0 0x7f87b81450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:32.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87b80b8d90 0x7f87b80b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:32.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87b67fc700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87b80bc810 0x7f87b81e3c70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f87b806d000 tx=0x7f87a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:32.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87af7fe700 1 -- 172.21.15.38:0/1414635698 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8003d80 con 0x7f87b80bc810 2023-07-11T00:00:32.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87af7fe700 1 -- 172.21.15.38:0/1414635698 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a801f070 con 0x7f87b80bc810 2023-07-11T00:00:32.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87af7fe700 1 -- 172.21.15.38:0/1414635698 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8011870 con 0x7f87b80bc810 2023-07-11T00:00:32.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87bd752700 1 -- 172.21.15.38:0/1414635698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b81e3750 con 0x7f87b80bc810 2023-07-11T00:00:32.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.682+0000 7f87bd752700 1 -- 172.21.15.38:0/1414635698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b80c0d30 con 0x7f87b80bc810 2023-07-11T00:00:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.684+0000 7f87af7fe700 1 -- 172.21.15.38:0/1414635698 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87a8021030 con 0x7f87b80bc810 2023-07-11T00:00:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.685+0000 7f87af7fe700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f879806ace0 0x7f879806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.685+0000 7f87af7fe700 1 -- 172.21.15.38:0/1414635698 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87a808ab80 con 0x7f87b80bc810 2023-07-11T00:00:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.685+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f879806ace0 0x7f879806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.685+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f879806ace0 0x7f879806d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f87a0006fd0 tx=0x7f87a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.686+0000 7f87c98ebb80 1 Processor -- start 2023-07-11T00:00:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.686+0000 7f87c98ebb80 1 -- start start 2023-07-11T00:00:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196e3650 0x55f4196e09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196dfac0 0x55f4196dff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f419710de0 0x55f419711250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f419659ea0 con 0x55f4196e3650 2023-07-11T00:00:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4195cd600 con 0x55f419710de0 2023-07-11T00:00:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f41963c910 con 0x55f4196dfac0 2023-07-11T00:00:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87b6ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196e3650 0x55f4196e09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87b6ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196e3650 0x55f4196e09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41108/0 (socket says 172.21.15.38:41108) 2023-07-11T00:00:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87b6ffd700 1 -- 172.21.15.38:0/425593619 learned_addr learned my addr 172.21.15.38:0/425593619 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87b67fc700 1 --2- 172.21.15.38:0/425593619 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196dfac0 0x55f4196dff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87b77fe700 1 --2- 172.21.15.38:0/425593619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f419710de0 0x55f419711250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87b6ffd700 1 -- 172.21.15.38:0/425593619 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196dfac0 msgr2=0x55f4196dff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/425593619 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196dfac0 0x55f4196dff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87b6ffd700 1 -- 172.21.15.38:0/425593619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f419710de0 msgr2=0x55f419711250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:32.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/425593619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f419710de0 0x55f419711250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.687+0000 7f87b6ffd700 1 -- 172.21.15.38:0/425593619 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f419429790 con 0x55f4196e3650 2023-07-11T00:00:32.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.688+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/425593619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196e3650 0x55f4196e09e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f87a0012940 tx=0x7f87a0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906c07e3874611f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:32.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.688+0000 7f87acff9700 1 -- 172.21.15.38:0/425593619 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a000b050 con 0x55f4196e3650 2023-07-11T00:00:32.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.688+0000 7f87acff9700 1 -- 172.21.15.38:0/425593619 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a0017070 con 0x55f4196e3650 2023-07-11T00:00:32.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.688+0000 7f87acff9700 1 -- 172.21.15.38:0/425593619 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0013b00 con 0x55f4196e3650 2023-07-11T00:00:32.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.688+0000 7f87c98ebb80 1 -- 172.21.15.38:0/425593619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196e3650 msgr2=0x55f4196e09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.688+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/425593619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196e3650 0x55f4196e09e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f87a0012940 tx=0x7f87a0010000 comp rx=0 tx=0).stop 2023-07-11T00:00:32.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.688+0000 7f87c98ebb80 1 -- 172.21.15.38:0/425593619 shutdown_connections 2023-07-11T00:00:32.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.688+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/425593619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f419710de0 0x55f419711250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.688+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/425593619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196e3650 0x55f4196e09e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.688+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/425593619 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196dfac0 0x55f4196dff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.688+0000 7f87c98ebb80 1 -- 172.21.15.38:0/425593619 >> 172.21.15.38:0/425593619 conn(0x55f4196da320 msgr2=0x55f4196e4380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:32.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.689+0000 7f87c98ebb80 1 -- 172.21.15.38:0/425593619 shutdown_connections 2023-07-11T00:00:32.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.689+0000 7f87c98ebb80 1 -- 172.21.15.38:0/425593619 wait complete. 2023-07-11T00:00:32.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.689+0000 7f87c98ebb80 1 -- start start 2023-07-11T00:00:32.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.689+0000 7f87c98ebb80 1 Processor -- start 2023-07-11T00:00:32.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f419727dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4196e3650 0x55f419702720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f419710de0 0x55f419702c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f419635be0 con 0x55f4196dfac0 2023-07-11T00:00:32.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4195f35b0 con 0x55f4196e3650 2023-07-11T00:00:32.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4195d9910 con 0x55f419710de0 2023-07-11T00:00:32.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87c98ebb80 10 client.0 _ll_register_callbacks cb 0x55f4195f1b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-11T00:00:32.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87b6ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f419727dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87b6ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f419727dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41124/0 (socket says 172.21.15.38:41124) 2023-07-11T00:00:32.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87b6ffd700 1 -- 172.21.15.38:0/2260424099 learned_addr learned my addr 172.21.15.38:0/2260424099 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:32.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87b77fe700 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f419710de0 0x55f419702c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87b67fc700 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4196e3650 0x55f419702720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87b6ffd700 1 -- 172.21.15.38:0/2260424099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f419710de0 msgr2=0x55f419702c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:32.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f419710de0 0x55f419702c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87b6ffd700 1 -- 172.21.15.38:0/2260424099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4196e3650 msgr2=0x55f419702720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:32.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4196e3650 0x55f419702720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87b6ffd700 1 -- 172.21.15.38:0/2260424099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a00125f0 con 0x55f4196dfac0 2023-07-11T00:00:32.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f419727dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f87a0020040 tx=0x7f87a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a524f809279f0430 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:32.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f8795ffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-07-11T00:00:32.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f8795ffb700 1 -- 172.21.15.38:0/2260424099 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a000b040 con 0x55f4196dfac0 2023-07-11T00:00:32.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f8795ffb700 1 -- 172.21.15.38:0/2260424099 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87a002e070 con 0x55f4196dfac0 2023-07-11T00:00:32.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.690+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2260424099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4196d7930 con 0x55f4196dfac0 2023-07-11T00:00:32.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f8795ffb700 1 -- 172.21.15.38:0/2260424099 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87a00085f0 con 0x55f4196dfac0 2023-07-11T00:00:32.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f87c98ebb80 10 client.4626 fetch_fsmap learned FSMap version 7 2023-07-11T00:00:32.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2260424099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f4195160a0 con 0x55f4196dfac0 2023-07-11T00:00:32.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f8795ffb700 1 -- 172.21.15.38:0/2260424099 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f4196d7930 con 0x55f4196dfac0 2023-07-11T00:00:32.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f8795ffb700 1 -- 172.21.15.38:0/2260424099 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f87a001e850 con 0x55f4196dfac0 2023-07-11T00:00:32.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f87c98ebb80 10 client.4626 fetch_fsmap finished waiting for FSMap version 7 2023-07-11T00:00:32.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f87c98ebb80 10 client.4626 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-11T00:00:32.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f87c98ebb80 20 client.4626 populate_metadata read hostname 'smithi038' 2023-07-11T00:00:32.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.38:6833/3594015619,v1:172.21.15.38:6835/3594015619] conn(0x55f41972ad00 0x55f41972b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f87c98ebb80 4 client.4626 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-11T00:00:32.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2260424099 --> [v2:172.21.15.38:6833/3594015619,v1:172.21.15.38:6835/3594015619] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4196b40e0 con 0x55f41972ad00 2023-07-11T00:00:32.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f87b67fc700 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.38:6833/3594015619,v1:172.21.15.38:6835/3594015619] conn(0x55f41972ad00 0x55f41972b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f8795ffb700 10 client.4626 ms_handle_connect on v2:172.21.15.38:6833/3594015619 2023-07-11T00:00:32.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.691+0000 7f87b67fc700 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.38:6833/3594015619,v1:172.21.15.38:6835/3594015619] conn(0x55f41972ad00 0x55f41972b0d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cdea5cac734338a server_cookie=fa20b5970a64955a in_seq=0 out_seq=0 2023-07-11T00:00:32.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f8795ffb700 1 -- 172.21.15.38:0/2260424099 <== mds.0 v2:172.21.15.38:6833/3594015619 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f4196b40e0 con 0x55f41972ad00 2023-07-11T00:00:32.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f8795ffb700 10 client.4626 handle_command_reply: tid=0 2023-07-11T00:00:32.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 1 client.4626 shutdown 2023-07-11T00:00:32.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2260424099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 msgr2=0x55f419727dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f419727dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f87a0020040 tx=0x7f87a00047c0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2260424099 shutdown_connections 2023-07-11T00:00:32.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.38:6833/3594015619,v1:172.21.15.38:6835/3594015619] conn(0x55f41972ad00 0x55f41972b0d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f419710de0 0x55f419702c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f419727dc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2260424099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4196e3650 0x55f419702720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f8795ffb700 0 client.4626 ms_handle_reset on v2:172.21.15.38:6833/3594015619 2023-07-11T00:00:32.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2260424099 >> 172.21.15.38:0/2260424099 conn(0x55f4196da320 msgr2=0x55f419711250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:32.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2260424099 shutdown_connections 2023-07-11T00:00:32.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2260424099 wait complete. 2023-07-11T00:00:32.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.692+0000 7f87c98ebb80 20 client.4626 trim_cache size 0 max 16384 2023-07-11T00:00:32.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.710+0000 7f87c98ebb80 1 Processor -- start 2023-07-11T00:00:32.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.710+0000 7f87c98ebb80 1 -- start start 2023-07-11T00:00:32.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.710+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f4197111b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.710+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 0x55f419710000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.710+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f419710de0 0x55f419710540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.710+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f41942a390 con 0x55f4196dfac0 2023-07-11T00:00:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.710+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4196c1bf0 con 0x55f419710de0 2023-07-11T00:00:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.710+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f419713fe0 con 0x55f4196e3650 2023-07-11T00:00:32.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.710+0000 7f87b6ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f4197111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b6ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f4197111b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41134/0 (socket says 172.21.15.38:41134) 2023-07-11T00:00:32.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b6ffd700 1 -- 172.21.15.38:0/715274052 learned_addr learned my addr 172.21.15.38:0/715274052 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:32.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b77fe700 1 --2- 172.21.15.38:0/715274052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f419710de0 0x55f419710540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b67fc700 1 --2- 172.21.15.38:0/715274052 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 0x55f419710000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b6ffd700 1 -- 172.21.15.38:0/715274052 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 msgr2=0x55f419710000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:32.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/715274052 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 0x55f419710000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b6ffd700 1 -- 172.21.15.38:0/715274052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f419710de0 msgr2=0x55f419710540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:32.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/715274052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f419710de0 0x55f419710540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b6ffd700 1 -- 172.21.15.38:0/715274052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f419711e80 con 0x55f4196dfac0 2023-07-11T00:00:32.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b77fe700 1 --2- 172.21.15.38:0/715274052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f419710de0 0x55f419710540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:32.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b67fc700 1 --2- 172.21.15.38:0/715274052 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 0x55f419710000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:32.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/715274052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f4197111b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f87a0012940 tx=0x7f87a002a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6093ca688b4da704 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:32.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87ad7fa700 1 -- 172.21.15.38:0/715274052 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a001ed10 con 0x55f4196dfac0 2023-07-11T00:00:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87ad7fa700 1 -- 172.21.15.38:0/715274052 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a002c070 con 0x55f4196dfac0 2023-07-11T00:00:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.711+0000 7f87ad7fa700 1 -- 172.21.15.38:0/715274052 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0013a10 con 0x55f4196dfac0 2023-07-11T00:00:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.712+0000 7f87c98ebb80 1 -- 172.21.15.38:0/715274052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 msgr2=0x55f4197111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.712+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/715274052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f4197111b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f87a0012940 tx=0x7f87a002a070 comp rx=0 tx=0).stop 2023-07-11T00:00:32.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.712+0000 7f87c98ebb80 1 -- 172.21.15.38:0/715274052 shutdown_connections 2023-07-11T00:00:32.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.712+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/715274052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f419710de0 0x55f419710540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.712+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/715274052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f4196dfac0 0x55f4197111b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.712+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/715274052 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 0x55f419710000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.712+0000 7f87c98ebb80 1 -- 172.21.15.38:0/715274052 >> 172.21.15.38:0/715274052 conn(0x55f4196da320 msgr2=0x55f41973a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:32.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.712+0000 7f87c98ebb80 1 -- 172.21.15.38:0/715274052 shutdown_connections 2023-07-11T00:00:32.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.712+0000 7f87c98ebb80 1 -- 172.21.15.38:0/715274052 wait complete. 2023-07-11T00:00:32.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.712+0000 7f87c98ebb80 1 -- start start 2023-07-11T00:00:32.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.712+0000 7f87c98ebb80 1 Processor -- start 2023-07-11T00:00:32.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4196dfac0 0x55f419708610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 0x55f419778570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87c98ebb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f419710de0 0x55f419778ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f419731c30 con 0x55f419710de0 2023-07-11T00:00:32.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f419782630 con 0x55f4196dfac0 2023-07-11T00:00:32.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87c98ebb80 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f419708b50 con 0x55f4196e3650 2023-07-11T00:00:32.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87c98ebb80 10 client.0 _ll_register_callbacks cb 0x7f87b0001600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-11T00:00:32.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f419710de0 0x55f419778ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f419710de0 0x55f419778ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41148/0 (socket says 172.21.15.38:41148) 2023-07-11T00:00:32.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b77fe700 1 -- 172.21.15.38:0/2020207532 learned_addr learned my addr 172.21.15.38:0/2020207532 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:32.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4196dfac0 0x55f419708610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b67fc700 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 0x55f419778570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b77fe700 1 -- 172.21.15.38:0/2020207532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 msgr2=0x55f419778570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:32.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b77fe700 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 0x55f419778570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b77fe700 1 -- 172.21.15.38:0/2020207532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4196dfac0 msgr2=0x55f419708610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b77fe700 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4196dfac0 0x55f419708610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b77fe700 1 -- 172.21.15.38:0/2020207532 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4195160a0 con 0x55f419710de0 2023-07-11T00:00:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b67fc700 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 0x55f419778570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f87b77fe700 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f419710de0 0x55f419778ab0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55f419718fa0 tx=0x7f87b0002060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9da9cfc178a2744 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.713+0000 7f8795ffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-07-11T00:00:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f8795ffb700 1 -- 172.21.15.38:0/2020207532 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b001f420 con 0x55f419710de0 2023-07-11T00:00:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f8795ffb700 1 -- 172.21.15.38:0/2020207532 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87b001f580 con 0x55f419710de0 2023-07-11T00:00:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2020207532 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87a0017070 con 0x55f419710de0 2023-07-11T00:00:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f8795ffb700 1 -- 172.21.15.38:0/2020207532 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87b001f740 con 0x55f419710de0 2023-07-11T00:00:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f87c98ebb80 10 client.4632 fetch_fsmap learned FSMap version 7 2023-07-11T00:00:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2020207532 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f4197124f0 con 0x55f419710de0 2023-07-11T00:00:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f8795ffb700 1 -- 172.21.15.38:0/2020207532 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a0017070 con 0x55f419710de0 2023-07-11T00:00:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f8795ffb700 1 -- 172.21.15.38:0/2020207532 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f87b001f8a0 con 0x55f419710de0 2023-07-11T00:00:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f87c98ebb80 10 client.4632 fetch_fsmap finished waiting for FSMap version 7 2023-07-11T00:00:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f87c98ebb80 10 client.4632 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-11T00:00:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f87c98ebb80 20 client.4632 populate_metadata read hostname 'smithi038' 2023-07-11T00:00:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.38:6833/3594015619,v1:172.21.15.38:6835/3594015619] conn(0x55f419778ff0 0x55f419712f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f87c98ebb80 4 client.4632 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-07-11T00:00:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2020207532 --> [v2:172.21.15.38:6833/3594015619,v1:172.21.15.38:6835/3594015619] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f41962ed20 con 0x55f419778ff0 2023-07-11T00:00:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.38:6833/3594015619,v1:172.21.15.38:6835/3594015619] conn(0x55f419778ff0 0x55f419712f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f8795ffb700 10 client.4632 ms_handle_connect on v2:172.21.15.38:6833/3594015619 2023-07-11T00:00:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.714+0000 7f87b6ffd700 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.38:6833/3594015619,v1:172.21.15.38:6835/3594015619] conn(0x55f419778ff0 0x55f419712f30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=557cc1dd0d457f2b server_cookie=bf9e0c6144084a6d in_seq=0 out_seq=0 2023-07-11T00:00:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f8795ffb700 1 -- 172.21.15.38:0/2020207532 <== mds.0 v2:172.21.15.38:6833/3594015619 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f41962ed20 con 0x55f419778ff0 2023-07-11T00:00:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f8795ffb700 10 client.4632 handle_command_reply: tid=0 2023-07-11T00:00:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 1 client.4632 shutdown 2023-07-11T00:00:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2020207532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f419710de0 msgr2=0x55f419778ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f419710de0 0x55f419778ab0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55f419718fa0 tx=0x7f87b0002060 comp rx=0 tx=0).stop 2023-07-11T00:00:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2020207532 shutdown_connections 2023-07-11T00:00:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.38:6833/3594015619,v1:172.21.15.38:6835/3594015619] conn(0x55f419778ff0 0x55f419712f30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f419710de0 0x55f419778ab0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4196dfac0 0x55f419708610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 1 --2- 172.21.15.38:0/2020207532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55f4196e3650 0x55f419778570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f8795ffb700 0 client.4632 ms_handle_reset on v2:172.21.15.38:6833/3594015619 2023-07-11T00:00:32.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2020207532 >> 172.21.15.38:0/2020207532 conn(0x55f4196da320 msgr2=0x55f419718770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:32.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2020207532 shutdown_connections 2023-07-11T00:00:32.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 1 -- 172.21.15.38:0/2020207532 wait complete. 2023-07-11T00:00:32.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87c98ebb80 20 client.4632 trim_cache size 0 max 16384 2023-07-11T00:00:32.741 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-07-11T00:00:32.741 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "712aa6bd-5b82-40dc-8d7c-7e66131fef83", 2023-07-11T00:00:32.741 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-07-11T00:00:32.741 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4291, 2023-07-11T00:00:32.741 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-07-11T00:00:32.741 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-07-11T00:00:32.742 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-07-11T00:00:32.742 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 15.349206248, 2023-07-11T00:00:32.742 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 7, 2023-07-11T00:00:32.742 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 21, 2023-07-11T00:00:32.742 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 21, 2023-07-11T00:00:32.743 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 21.327981490999999 2023-07-11T00:00:32.743 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-07-11T00:00:32.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87bd752700 1 -- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f879806ace0 msgr2=0x7f879806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87bd752700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f879806ace0 0x7f879806d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f87a0006fd0 tx=0x7f87a0008040 comp rx=0 tx=0).stop 2023-07-11T00:00:32.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87bd752700 1 -- 172.21.15.38:0/1414635698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87b80bc810 msgr2=0x7f87b81e3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:32.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87bd752700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87b80bc810 0x7f87b81e3c70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f87b806d000 tx=0x7f87a8004750 comp rx=0 tx=0).stop 2023-07-11T00:00:32.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87bd752700 1 -- 172.21.15.38:0/1414635698 shutdown_connections 2023-07-11T00:00:32.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.715+0000 7f87bd752700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f879806ace0 0x7f879806d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.716+0000 7f87bd752700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b81449d0 0x7f87b81450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.716+0000 7f87bd752700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87b80b8d90 0x7f87b80b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.716+0000 7f87bd752700 1 --2- 172.21.15.38:0/1414635698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87b80bc810 0x7f87b81e3c70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:32.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.716+0000 7f87bd752700 1 -- 172.21.15.38:0/1414635698 >> 172.21.15.38:0/1414635698 conn(0x7f87b80c0860 msgr2=0x7f87b80baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:32.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.716+0000 7f87bd752700 1 -- 172.21.15.38:0/1414635698 shutdown_connections 2023-07-11T00:00:32.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:32.716+0000 7f87bd752700 1 -- 172.21.15.38:0/1414635698 wait complete. 2023-07-11T00:00:32.746 INFO:teuthology.run_tasks:Running task kclient... 2023-07-11T00:00:32.770 INFO:tasks.kclient:Mounting kernel clients... 2023-07-11T00:00:32.770 INFO:tasks.kclient:config is {'client.0': {}} 2023-07-11T00:00:32.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:32.771 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-07-11T00:00:32.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:32.826 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2023-07-11T00:00:32.904 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2023-07-11T00:00:32.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-11T00:00:32.907 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-11T00:00:32.907 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-11T00:00:32.908 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-11T00:00:32.908 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-11T00:00:33.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.032+0000 7f0e77add700 1 Processor -- start 2023-07-11T00:00:33.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.033+0000 7f0e77add700 1 -- start start 2023-07-11T00:00:33.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.033+0000 7f0e77add700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e70147c00 0x7f0e700b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:33.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e77add700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e700b3bd0 con 0x7f0e70071b60 2023-07-11T00:00:33.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e77add700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e700714d0 con 0x7f0e7006b120 2023-07-11T00:00:33.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e77add700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e70070800 con 0x7f0e70147c00 2023-07-11T00:00:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e75078700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e70147c00 0x7f0e700b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e7607a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0e70071b60 0x7f0e700b6970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53324/0 (socket says 172.21.15.38:53324) 2023-07-11T00:00:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e7607a700 1 -- 172.21.15.38:0/1047784269 learned_addr learned my addr 172.21.15.38:0/1047784269 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e75078700 1 -- 172.21.15.38:0/1047784269 >> v1:172.21.15.70:6789/0 conn(0x7f0e7006b120 legacy=0x7f0e701474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e75078700 1 -- 172.21.15.38:0/1047784269 >> v1:172.21.15.38:6789/0 conn(0x7f0e70071b60 legacy=0x7f0e700b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e75078700 1 -- 172.21.15.38:0/1047784269 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e700b3e20 con 0x7f0e70147c00 2023-07-11T00:00:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e74877700 1 -- 172.21.15.38:0/1047784269 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893419028 0 0) 0x7f0e700b3bd0 con 0x7f0e70071b60 2023-07-11T00:00:33.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e75078700 1 --2- 172.21.15.38:0/1047784269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e70147c00 0x7f0e700b6430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009840 tx=0x7f0e60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e583f568e02118 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:33.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e74877700 1 -- 172.21.15.38:0/1047784269 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60011830 con 0x7f0e70147c00 2023-07-11T00:00:33.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e74877700 1 -- 172.21.15.38:0/1047784269 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e60011990 con 0x7f0e70147c00 2023-07-11T00:00:33.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.034+0000 7f0e74877700 1 -- 172.21.15.38:0/1047784269 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60011d20 con 0x7f0e70147c00 2023-07-11T00:00:33.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.035+0000 7f0e77add700 1 -- 172.21.15.38:0/1047784269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e70147c00 msgr2=0x7f0e700b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:33.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.035+0000 7f0e77add700 1 --2- 172.21.15.38:0/1047784269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e70147c00 0x7f0e700b6430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009840 tx=0x7f0e60009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:33.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.035+0000 7f0e77add700 1 -- 172.21.15.38:0/1047784269 shutdown_connections 2023-07-11T00:00:33.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.035+0000 7f0e77add700 1 --2- 172.21.15.38:0/1047784269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e70147c00 0x7f0e700b6430 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:33.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.035+0000 7f0e77add700 1 -- 172.21.15.38:0/1047784269 >> 172.21.15.38:0/1047784269 conn(0x7f0e700bd980 msgr2=0x7f0e700b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:33.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.035+0000 7f0e77add700 1 -- 172.21.15.38:0/1047784269 shutdown_connections 2023-07-11T00:00:33.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.035+0000 7f0e77add700 1 -- 172.21.15.38:0/1047784269 wait complete. 2023-07-11T00:00:33.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.036+0000 7f0e77add700 1 Processor -- start 2023-07-11T00:00:33.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.036+0000 7f0e77add700 1 -- start start 2023-07-11T00:00:33.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.037+0000 7f0e77add700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e7006b120 0x7f0e7013eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:33.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.037+0000 7f0e77add700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e70071b60 0x7f0e7013d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:33.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.037+0000 7f0e77add700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70147c00 0x7f0e700b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:33.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.037+0000 7f0e77add700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700b69d0 con 0x7f0e7006b120 2023-07-11T00:00:33.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.037+0000 7f0e77add700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e70144d90 con 0x7f0e70147c00 2023-07-11T00:00:33.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.037+0000 7f0e77add700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7013fa10 con 0x7f0e70071b60 2023-07-11T00:00:33.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.037+0000 7f0e75879700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e7006b120 0x7f0e7013eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:33.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.037+0000 7f0e75879700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e7006b120 0x7f0e7013eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41176/0 (socket says 172.21.15.38:41176) 2023-07-11T00:00:33.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.037+0000 7f0e75879700 1 -- 172.21.15.38:0/1411802404 learned_addr learned my addr 172.21.15.38:0/1411802404 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:33.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.037+0000 7f0e75078700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e70071b60 0x7f0e7013d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:33.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e7607a700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70147c00 0x7f0e700b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:33.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e75879700 1 -- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e70071b60 msgr2=0x7f0e7013d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:33.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e75879700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e70071b60 0x7f0e7013d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:33.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e75879700 1 -- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70147c00 msgr2=0x7f0e700b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:33.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e75879700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70147c00 0x7f0e700b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:33.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e75879700 1 -- 172.21.15.38:0/1411802404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600094a0 con 0x7f0e7006b120 2023-07-11T00:00:33.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e75879700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e7006b120 0x7f0e7013eb90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00c4e0 tx=0x7f0e6c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:33.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e667fc700 1 -- 172.21.15.38:0/1411802404 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c0052d0 con 0x7f0e7006b120 2023-07-11T00:00:33.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e667fc700 1 -- 172.21.15.38:0/1411802404 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6c005430 con 0x7f0e7006b120 2023-07-11T00:00:33.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e77add700 1 -- 172.21.15.38:0/1411802404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7013f730 con 0x7f0e7006b120 2023-07-11T00:00:33.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e667fc700 1 -- 172.21.15.38:0/1411802404 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c0038c0 con 0x7f0e7006b120 2023-07-11T00:00:33.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.038+0000 7f0e77add700 1 -- 172.21.15.38:0/1411802404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7013d490 con 0x7f0e7006b120 2023-07-11T00:00:33.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.039+0000 7f0e77add700 1 -- 172.21.15.38:0/1411802404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e70074360 con 0x7f0e7006b120 2023-07-11T00:00:33.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.039+0000 7f0e667fc700 1 -- 172.21.15.38:0/1411802404 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e6c003a20 con 0x7f0e7006b120 2023-07-11T00:00:33.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.040+0000 7f0e667fc700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0e5406ace0 0x7f0e5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:33.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.040+0000 7f0e667fc700 1 -- 172.21.15.38:0/1411802404 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e6c088990 con 0x7f0e7006b120 2023-07-11T00:00:33.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.040+0000 7f0e75078700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0e5406ace0 0x7f0e5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:33.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.040+0000 7f0e75078700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0e5406ace0 0x7f0e5406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e701d1510 tx=0x7f0e6001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:33.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.044+0000 7f0e667fc700 1 -- 172.21.15.38:0/1411802404 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0e6c053a50 con 0x7f0e7006b120 2023-07-11T00:00:33.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.288+0000 7f0e77add700 1 -- 172.21.15.38:0/1411802404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0e7006fd00 con 0x7f0e7006b120 2023-07-11T00:00:33.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.289+0000 7f0e667fc700 1 -- 172.21.15.38:0/1411802404 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0e6c057070 con 0x7f0e7006b120 2023-07-11T00:00:33.292 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-11T00:00:33.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 -- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0e5406ace0 msgr2=0x7f0e5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:33.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0e5406ace0 0x7f0e5406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e701d1510 tx=0x7f0e6001c040 comp rx=0 tx=0).stop 2023-07-11T00:00:33.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 -- 172.21.15.38:0/1411802404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e7006b120 msgr2=0x7f0e7013eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:33.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e7006b120 0x7f0e7013eb90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00c4e0 tx=0x7f0e6c00c8a0 comp rx=0 tx=0).stop 2023-07-11T00:00:33.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 -- 172.21.15.38:0/1411802404 shutdown_connections 2023-07-11T00:00:33.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0e5406ace0 0x7f0e5406d190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:33.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70147c00 0x7f0e700b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:33.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e7006b120 0x7f0e7013eb90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:33.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 --2- 172.21.15.38:0/1411802404 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e70071b60 0x7f0e7013d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:33.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 -- 172.21.15.38:0/1411802404 >> 172.21.15.38:0/1411802404 conn(0x7f0e700bd980 msgr2=0x7f0e701452f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:33.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 -- 172.21.15.38:0/1411802404 shutdown_connections 2023-07-11T00:00:33.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:33.291+0000 7f0e77add700 1 -- 172.21.15.38:0/1411802404 wait complete. 2023-07-11T00:00:33.305 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-11T00:00:33.306 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-11T00:00:33.306 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-07-11T00:00:33.306 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-11T00:00:33.306 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-11T00:00:33.307 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-11T00:00:33.307 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-11T00:00:33.307 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-11T00:00:33.307 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-11T00:00:33.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:33.308 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-07-11T00:00:33.355 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:00:33.356 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:00:33.356 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:00:33.357 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:00:33.357 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-07-11T00:00:33.357 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:00:33.357 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:00:33.357 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:00:33.357 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-07-11T00:00:33.357 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:00:33.358 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:00:33.358 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-07-11T00:00:33.358 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:00:33.358 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:00:33.358 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-11T00:00:33.358 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:00:33.358 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-11T00:00:33.359 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42309sec preferred_lft 42309sec 2023-07-11T00:00:33.359 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-07-11T00:00:33.359 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:00:33.360 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-11T00:00:33.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:33.361 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-07-11T00:00:33.361 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-07-11T00:00:33.361 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2023-07-11T00:00:33.361 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2023-07-11T00:00:33.361 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2023-07-11T00:00:33.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-11T00:00:33.362 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-07-11T00:00:33.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:33.779 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-11T00:00:33.877 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-07-11T00:00:33.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:33.881 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-07-11T00:00:33.950 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-07-11T00:00:33.951 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-11T00:00:33.951 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-11T00:00:33.951 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-11T00:00:33.951 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-11T00:00:33.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:33.952 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-07-11T00:00:33.953 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-07-11T00:00:33.953 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-11T00:00:33.953 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-11T00:00:33.954 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-11T00:00:33.954 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-07-11T00:00:34.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:34.621 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-07-11T00:00:34.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:34.669 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2023-07-11T00:00:34.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:34.715 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-07-11T00:00:34.715 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-07-11T00:00:34.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-11T00:00:34.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-11T00:00:34.716 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-07-11T00:00:34.897 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-11T00:00:34.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:34.898 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-07-11T00:00:34.898 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-07-11T00:00:34.898 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-11T00:00:34.898 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-11T00:00:34.899 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-11T00:00:34.899 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-11T00:00:34.899 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-11T00:00:34.899 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-07-11T00:00:35.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:35.164 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-07-11T00:00:35.164 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-07-11T00:00:35.165 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2023-07-11T00:00:35.165 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2023-07-11T00:00:35.165 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-07-11T00:00:35.342 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:00:35.343 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-11T00:00:35.388 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-11T00:00:35.389 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:00:35.389 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-11T00:00:35.472 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-11T00:00:35.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:35.473 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:00:35.617 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:00:35.618 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:00:35.618 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-07-11T00:00:36.033 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:00:36.033 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:00:36.033 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-07-11T00:00:36.034 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.70:3300,172.21.15.70:3301" 2023-07-11T00:00:36.034 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:00:36.057 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:00:36.058 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:00:36.058 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-07-11T00:00:36.058 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.70:3300,172.21.15.70:3301" 2023-07-11T00:00:36.058 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:00:36.058 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.38:6789,172.21.15.70:6789,172.21.15.70:6790" 2023-07-11T00:00:36.058 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.38:6789,172.21.15.70:6789,172.21.15.70:6790:/ 2023-07-11T00:00:36.058 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=712aa6bd-5b82-40dc-8d7c-7e66131fef83" will pass to kernel 2023-07-11T00:00:36.064 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-11T00:00:36.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:36.065 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-11T00:00:36.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:36.135 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:00:36.257 INFO:teuthology.orchestra.run.smithi131.stdout:client4511 2023-07-11T00:00:36.257 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-11T00:00:36.258 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:00:36.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:36.303 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:00:36.434 INFO:teuthology.orchestra.run.smithi131.stdout:client4511 2023-07-11T00:00:36.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:36.435 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:00:36.522 INFO:teuthology.orchestra.run.smithi131.stdout:client4511 2023-07-11T00:00:36.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:36.523 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/712aa6bd-5b82-40dc-8d7c-7e66131fef83.client4511/status') 2023-07-11T00:00:36.630 INFO:teuthology.orchestra.run.smithi131.stdout:instance: client.4511 (3)172.21.15.131:0/3002363582 2023-07-11T00:00:36.631 INFO:teuthology.orchestra.run.smithi131.stdout:blocklisted: false 2023-07-11T00:00:36.631 INFO:teuthology.orchestra.run.smithi131.stderr:0+1 records in 2023-07-11T00:00:36.631 INFO:teuthology.orchestra.run.smithi131.stderr:0+1 records out 2023-07-11T00:00:36.632 INFO:teuthology.orchestra.run.smithi131.stderr:71 bytes copied, 5.3242e-05 s, 1.3 MB/s 2023-07-11T00:00:36.633 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-11T00:00:36.656 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.794+0000 7f3372c3e700 1 Processor -- start 2023-07-11T00:00:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.794+0000 7f3372c3e700 1 -- start start 2023-07-11T00:00:36.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.794+0000 7f3372c3e700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f336c141780 0x7f336c0ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:36.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.794+0000 7f3372c3e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f336c071a30 0x7f336c14ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:36.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.794+0000 7f3372c3e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336c0b96b0 0x7f336c0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.794+0000 7f3372c3e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c070e70 con 0x7f336c071a30 2023-07-11T00:00:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.794+0000 7f3372c3e700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c071ea0 con 0x7f336c141780 2023-07-11T00:00:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.794+0000 7f3372c3e700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0b9b40 con 0x7f336c0b96b0 2023-07-11T00:00:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.794+0000 7f336bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f336c071a30 0x7f336c14ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f336bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f336c071a30 0x7f336c14ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41178/0 (socket says 172.21.15.38:41178) 2023-07-11T00:00:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f336bfff700 1 -- 172.21.15.38:0/3112812226 learned_addr learned my addr 172.21.15.38:0/3112812226 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f33711db700 1 --2- 172.21.15.38:0/3112812226 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336c0b96b0 0x7f336c0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:36.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f33709da700 1 --2- 172.21.15.38:0/3112812226 >> v2:172.21.15.70:3300/0 conn(0x7f336c141780 0x7f336c0ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:36.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f336bfff700 1 -- 172.21.15.38:0/3112812226 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336c0b96b0 msgr2=0x7f336c0b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:36.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f336bfff700 1 --2- 172.21.15.38:0/3112812226 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336c0b96b0 0x7f336c0b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:36.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f336bfff700 1 -- 172.21.15.38:0/3112812226 >> v2:172.21.15.70:3300/0 conn(0x7f336c141780 msgr2=0x7f336c0ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:36.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f336bfff700 1 --2- 172.21.15.38:0/3112812226 >> v2:172.21.15.70:3300/0 conn(0x7f336c141780 0x7f336c0ba010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:36.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f336bfff700 1 -- 172.21.15.38:0/3112812226 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c070670 con 0x7f336c071a30 2023-07-11T00:00:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f33709da700 1 --2- 172.21.15.38:0/3112812226 >> v2:172.21.15.70:3300/0 conn(0x7f336c141780 0x7f336c0ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f336bfff700 1 --2- 172.21.15.38:0/3112812226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f336c071a30 0x7f336c14ab20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f336c0b9400 tx=0x7f335800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35eccc27c318d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f336b7fe700 1 -- 172.21.15.38:0/3112812226 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335800dd30 con 0x7f336c071a30 2023-07-11T00:00:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f336b7fe700 1 -- 172.21.15.38:0/3112812226 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335800de90 con 0x7f336c071a30 2023-07-11T00:00:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.795+0000 7f336b7fe700 1 -- 172.21.15.38:0/3112812226 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358010690 con 0x7f336c071a30 2023-07-11T00:00:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.796+0000 7f3372c3e700 1 -- 172.21.15.38:0/3112812226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f336c071a30 msgr2=0x7f336c14ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.796+0000 7f3372c3e700 1 --2- 172.21.15.38:0/3112812226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f336c071a30 0x7f336c14ab20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f336c0b9400 tx=0x7f335800be70 comp rx=0 tx=0).stop 2023-07-11T00:00:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.796+0000 7f3372c3e700 1 -- 172.21.15.38:0/3112812226 shutdown_connections 2023-07-11T00:00:36.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.796+0000 7f3372c3e700 1 --2- 172.21.15.38:0/3112812226 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336c0b96b0 0x7f336c0b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:36.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.796+0000 7f3372c3e700 1 --2- 172.21.15.38:0/3112812226 >> v2:172.21.15.70:3300/0 conn(0x7f336c141780 0x7f336c0ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:36.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.796+0000 7f3372c3e700 1 --2- 172.21.15.38:0/3112812226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f336c071a30 0x7f336c14ab20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:36.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.796+0000 7f3372c3e700 1 -- 172.21.15.38:0/3112812226 >> 172.21.15.38:0/3112812226 conn(0x7f336c06d0e0 msgr2=0x7f336c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:36.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.796+0000 7f3372c3e700 1 -- 172.21.15.38:0/3112812226 shutdown_connections 2023-07-11T00:00:36.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.796+0000 7f3372c3e700 1 -- 172.21.15.38:0/3112812226 wait complete. 2023-07-11T00:00:36.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.797+0000 7f3372c3e700 1 Processor -- start 2023-07-11T00:00:36.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.797+0000 7f3372c3e700 1 -- start start 2023-07-11T00:00:36.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f3372c3e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336c071a30 0x7f336c0bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:36.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f3372c3e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f336c0b96b0 0x7f336c13c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:36.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f3372c3e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f336c141780 0x7f336c1d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:36.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f3372c3e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0bcbe0 con 0x7f336c141780 2023-07-11T00:00:36.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f3372c3e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c13bf90 con 0x7f336c0b96b0 2023-07-11T00:00:36.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f3372c3e700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c1d0a40 con 0x7f336c071a30 2023-07-11T00:00:36.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f33711db700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f336c141780 0x7f336c1d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:36.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f33711db700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f336c141780 0x7f336c1d0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41192/0 (socket says 172.21.15.38:41192) 2023-07-11T00:00:36.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f33711db700 1 -- 172.21.15.38:0/1390946734 learned_addr learned my addr 172.21.15.38:0/1390946734 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:36.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f33709da700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336c071a30 0x7f336c0bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:36.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f336bfff700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f336c0b96b0 0x7f336c13c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:36.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f33711db700 1 -- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336c071a30 msgr2=0x7f336c0bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:36.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f33711db700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336c071a30 0x7f336c0bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:36.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f33711db700 1 -- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f336c0b96b0 msgr2=0x7f336c13c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:36.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f33711db700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f336c0b96b0 0x7f336c13c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:36.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f33711db700 1 -- 172.21.15.38:0/1390946734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335800b7f0 con 0x7f336c141780 2023-07-11T00:00:36.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f336bfff700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f336c0b96b0 0x7f336c13c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:36.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.798+0000 7f33711db700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f336c141780 0x7f336c1d0ed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3364007e60 tx=0x7f336400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:36.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.799+0000 7f33697fa700 1 -- 172.21.15.38:0/1390946734 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336400ed80 con 0x7f336c141780 2023-07-11T00:00:36.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.799+0000 7f33697fa700 1 -- 172.21.15.38:0/1390946734 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3364014420 con 0x7f336c141780 2023-07-11T00:00:36.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.799+0000 7f3372c3e700 1 -- 172.21.15.38:0/1390946734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c140ee0 con 0x7f336c141780 2023-07-11T00:00:36.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.799+0000 7f33697fa700 1 -- 172.21.15.38:0/1390946734 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33640147d0 con 0x7f336c141780 2023-07-11T00:00:36.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.799+0000 7f3372c3e700 1 -- 172.21.15.38:0/1390946734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c13b9d0 con 0x7f336c141780 2023-07-11T00:00:36.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.799+0000 7f3372c3e700 1 -- 172.21.15.38:0/1390946734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c074360 con 0x7f336c141780 2023-07-11T00:00:36.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.800+0000 7f33697fa700 1 -- 172.21.15.38:0/1390946734 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3364014930 con 0x7f336c141780 2023-07-11T00:00:36.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.801+0000 7f33697fa700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f335006ace0 0x7f335006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:36.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.801+0000 7f33697fa700 1 -- 172.21.15.38:0/1390946734 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3364089bd0 con 0x7f336c141780 2023-07-11T00:00:36.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.801+0000 7f33709da700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f335006ace0 0x7f335006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:36.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.801+0000 7f33709da700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f335006ace0 0x7f335006d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3360006fd0 tx=0x7f3360008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:36.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:36.805+0000 7f33697fa700 1 -- 172.21.15.38:0/1390946734 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3364054d10 con 0x7f336c141780 2023-07-11T00:00:37.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.005+0000 7f3372c3e700 1 -- 172.21.15.38:0/1390946734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f336c1d0b80 con 0x7f336c141780 2023-07-11T00:00:37.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.007+0000 7f33697fa700 1 -- 172.21.15.38:0/1390946734 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f3364087710 con 0x7f336c141780 2023-07-11T00:00:37.010 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:37.010 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:37.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 -- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f335006ace0 msgr2=0x7f335006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f335006ace0 0x7f335006d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3360006fd0 tx=0x7f3360008040 comp rx=0 tx=0).stop 2023-07-11T00:00:37.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 -- 172.21.15.38:0/1390946734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f336c141780 msgr2=0x7f336c1d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f336c141780 0x7f336c1d0ed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3364007e60 tx=0x7f336400e3c0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 -- 172.21.15.38:0/1390946734 shutdown_connections 2023-07-11T00:00:37.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f335006ace0 0x7f335006d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f336c141780 0x7f336c1d0ed0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f336c071a30 0x7f336c0bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 --2- 172.21.15.38:0/1390946734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f336c0b96b0 0x7f336c13c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 -- 172.21.15.38:0/1390946734 >> 172.21.15.38:0/1390946734 conn(0x7f336c06d0e0 msgr2=0x7f336c0b88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:37.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 -- 172.21.15.38:0/1390946734 shutdown_connections 2023-07-11T00:00:37.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.009+0000 7f3372c3e700 1 -- 172.21.15.38:0/1390946734 wait complete. 2023-07-11T00:00:37.025 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:00:14.572121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:00:15.763698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:00:37.026 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:00:37.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.152+0000 7f3a52309700 1 Processor -- start 2023-07-11T00:00:37.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.152+0000 7f3a52309700 1 -- start start 2023-07-11T00:00:37.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a52309700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3a4c06b120 0x7f3a4c071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a52309700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3a4c0b5fc0 0x7f3a4c0b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a52309700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c0b7180 con 0x7f3a4c0ba160 2023-07-11T00:00:37.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a52309700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c0b90b0 con 0x7f3a4c0b5fc0 2023-07-11T00:00:37.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a52309700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c0b6980 con 0x7f3a4c06b120 2023-07-11T00:00:37.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a508a6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3a4c0b5fc0 0x7f3a4c0b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a508a6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3a4c0b5fc0 0x7f3a4c0b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41202/0 (socket says 172.21.15.38:41202) 2023-07-11T00:00:37.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a508a6700 1 -- 172.21.15.38:0/2363948800 learned_addr learned my addr 172.21.15.38:0/2363948800 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:37.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a4bfff700 1 --2- 172.21.15.38:0/2363948800 >> v2:172.21.15.70:3300/0 conn(0x7f3a4c06b120 0x7f3a4c071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a508a6700 1 -- 172.21.15.38:0/2363948800 >> v2:172.21.15.70:3300/0 conn(0x7f3a4c06b120 msgr2=0x7f3a4c071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:37.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a508a6700 1 --2- 172.21.15.38:0/2363948800 >> v2:172.21.15.70:3300/0 conn(0x7f3a4c06b120 0x7f3a4c071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a508a6700 1 -- 172.21.15.38:0/2363948800 >> v1:172.21.15.70:6789/0 conn(0x7f3a4c0ba160 legacy=0x7f3a4c1485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:37.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a508a6700 1 -- 172.21.15.38:0/2363948800 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c071070 con 0x7f3a4c0b5fc0 2023-07-11T00:00:37.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.153+0000 7f3a508a6700 1 --2- 172.21.15.38:0/2363948800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a4c0b5fc0 0x7f3a4c0b6440 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0660a0 tx=0x7f3a4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66130d61418fbd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:37.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.154+0000 7f3a4affd700 1 -- 172.21.15.38:0/2363948800 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400e070 con 0x7f3a4c0b5fc0 2023-07-11T00:00:37.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.154+0000 7f3a4affd700 1 -- 172.21.15.38:0/2363948800 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a44003a20 con 0x7f3a4c0b5fc0 2023-07-11T00:00:37.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.154+0000 7f3a4affd700 1 -- 172.21.15.38:0/2363948800 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44003dd0 con 0x7f3a4c0b5fc0 2023-07-11T00:00:37.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.154+0000 7f3a52309700 1 -- 172.21.15.38:0/2363948800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a4c0b5fc0 msgr2=0x7f3a4c0b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.154+0000 7f3a52309700 1 --2- 172.21.15.38:0/2363948800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a4c0b5fc0 0x7f3a4c0b6440 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0660a0 tx=0x7f3a4400b330 comp rx=0 tx=0).stop 2023-07-11T00:00:37.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.154+0000 7f3a52309700 1 -- 172.21.15.38:0/2363948800 shutdown_connections 2023-07-11T00:00:37.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.154+0000 7f3a52309700 1 --2- 172.21.15.38:0/2363948800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a4c0b5fc0 0x7f3a4c0b6440 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.154+0000 7f3a52309700 1 --2- 172.21.15.38:0/2363948800 >> v2:172.21.15.70:3300/0 conn(0x7f3a4c06b120 0x7f3a4c071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.154+0000 7f3a52309700 1 -- 172.21.15.38:0/2363948800 >> 172.21.15.38:0/2363948800 conn(0x7f3a4c0bd980 msgr2=0x7f3a4c0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:37.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.154+0000 7f3a52309700 1 -- 172.21.15.38:0/2363948800 shutdown_connections 2023-07-11T00:00:37.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.154+0000 7f3a52309700 1 -- 172.21.15.38:0/2363948800 wait complete. 2023-07-11T00:00:37.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.155+0000 7f3a52309700 1 Processor -- start 2023-07-11T00:00:37.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.155+0000 7f3a52309700 1 -- start start 2023-07-11T00:00:37.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a52309700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a4c06b120 0x7f3a4c06f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a52309700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a4c0b5fc0 0x7f3a4c13ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a52309700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a4c0ba160 0x7f3a4c06f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a52309700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c06f570 con 0x7f3a4c06b120 2023-07-11T00:00:37.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a52309700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0b32e0 con 0x7f3a4c0b5fc0 2023-07-11T00:00:37.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a52309700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c070dd0 con 0x7f3a4c0ba160 2023-07-11T00:00:37.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a4bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a4c06b120 0x7f3a4c06f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a4bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a4c06b120 0x7f3a4c06f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41210/0 (socket says 172.21.15.38:41210) 2023-07-11T00:00:37.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a4bfff700 1 -- 172.21.15.38:0/1783360347 learned_addr learned my addr 172.21.15.38:0/1783360347 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:37.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a4b7fe700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a4c0b5fc0 0x7f3a4c13ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a508a6700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a4c0ba160 0x7f3a4c06f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a4bfff700 1 -- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a4c0ba160 msgr2=0x7f3a4c06f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a4bfff700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a4c0ba160 0x7f3a4c06f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a4bfff700 1 -- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a4c0b5fc0 msgr2=0x7f3a4c13ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a4bfff700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a4c0b5fc0 0x7f3a4c13ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.156+0000 7f3a4bfff700 1 -- 172.21.15.38:0/1783360347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a44009b30 con 0x7f3a4c06b120 2023-07-11T00:00:37.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.157+0000 7f3a4bfff700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a4c06b120 0x7f3a4c06f030 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00e810 tx=0x7f3a3c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:37.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.157+0000 7f3a48ff9700 1 -- 172.21.15.38:0/1783360347 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00c070 con 0x7f3a4c06b120 2023-07-11T00:00:37.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.157+0000 7f3a48ff9700 1 -- 172.21.15.38:0/1783360347 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c013610 con 0x7f3a4c06b120 2023-07-11T00:00:37.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.157+0000 7f3a52309700 1 -- 172.21.15.38:0/1783360347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c1d0e30 con 0x7f3a4c06b120 2023-07-11T00:00:37.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.157+0000 7f3a48ff9700 1 -- 172.21.15.38:0/1783360347 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c0139c0 con 0x7f3a4c06b120 2023-07-11T00:00:37.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.157+0000 7f3a52309700 1 -- 172.21.15.38:0/1783360347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c070a80 con 0x7f3a4c06b120 2023-07-11T00:00:37.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.158+0000 7f3a52309700 1 -- 172.21.15.38:0/1783360347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c070c40 con 0x7f3a4c06b120 2023-07-11T00:00:37.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.158+0000 7f3a48ff9700 1 -- 172.21.15.38:0/1783360347 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a3c013b20 con 0x7f3a4c06b120 2023-07-11T00:00:37.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.159+0000 7f3a48ff9700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a3806ad10 0x7f3a3806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.159+0000 7f3a48ff9700 1 -- 172.21.15.38:0/1783360347 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a3c089190 con 0x7f3a4c06b120 2023-07-11T00:00:37.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.159+0000 7f3a4b7fe700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a3806ad10 0x7f3a3806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.159+0000 7f3a4b7fe700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a3806ad10 0x7f3a3806d1c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0bc0a0 tx=0x7f3a400090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:37.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.163+0000 7f3a48ff9700 1 -- 172.21.15.38:0/1783360347 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3a3c054250 con 0x7f3a4c06b120 2023-07-11T00:00:37.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.358+0000 7f3a52309700 1 -- 172.21.15.38:0/1783360347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3a4c074360 con 0x7f3a4c06b120 2023-07-11T00:00:37.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.358+0000 7f3a48ff9700 1 -- 172.21.15.38:0/1783360347 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3a3c057870 con 0x7f3a4c06b120 2023-07-11T00:00:37.361 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:00:37.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.360+0000 7f3a52309700 1 -- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a3806ad10 msgr2=0x7f3a3806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.360+0000 7f3a52309700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a3806ad10 0x7f3a3806d1c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0bc0a0 tx=0x7f3a400090e0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.360+0000 7f3a52309700 1 -- 172.21.15.38:0/1783360347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a4c06b120 msgr2=0x7f3a4c06f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.360+0000 7f3a52309700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a4c06b120 0x7f3a4c06f030 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00e810 tx=0x7f3a3c00eb20 comp rx=0 tx=0).stop 2023-07-11T00:00:37.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.360+0000 7f3a52309700 1 -- 172.21.15.38:0/1783360347 shutdown_connections 2023-07-11T00:00:37.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.360+0000 7f3a52309700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f3a3806ad10 0x7f3a3806d1c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.360+0000 7f3a52309700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a4c0ba160 0x7f3a4c06f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.360+0000 7f3a52309700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a4c06b120 0x7f3a4c06f030 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.360+0000 7f3a52309700 1 --2- 172.21.15.38:0/1783360347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a4c0b5fc0 0x7f3a4c13ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.360+0000 7f3a52309700 1 -- 172.21.15.38:0/1783360347 >> 172.21.15.38:0/1783360347 conn(0x7f3a4c0bd980 msgr2=0x7f3a4c0bc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:37.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.360+0000 7f3a52309700 1 -- 172.21.15.38:0/1783360347 shutdown_connections 2023-07-11T00:00:37.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.361+0000 7f3a52309700 1 -- 172.21.15.38:0/1783360347 wait complete. 2023-07-11T00:00:37.375 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:00:37.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.501+0000 7fa7d6f1f700 1 Processor -- start 2023-07-11T00:00:37.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.501+0000 7fa7d6f1f700 1 -- start start 2023-07-11T00:00:37.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7d6f1f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa7d00bc810 0x7fa7d00ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7d6f1f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d00b8620 con 0x7fa7d00b8d90 2023-07-11T00:00:37.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7d6f1f700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d00b8900 con 0x7fa7d01449d0 2023-07-11T00:00:37.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7d6f1f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00b97a0 con 0x7fa7d00bc810 2023-07-11T00:00:37.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7cffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa7d00bc810 0x7fa7d00ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7d54bc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa7d00b8d90 0x7fa7d006ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53338/0 (socket says 172.21.15.38:53338) 2023-07-11T00:00:37.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7d54bc700 1 -- 172.21.15.38:0/2040158770 learned_addr learned my addr 172.21.15.38:0/2040158770 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:37.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7cffff700 1 -- 172.21.15.38:0/2040158770 >> v1:172.21.15.70:6789/0 conn(0x7fa7d01449d0 legacy=0x7fa7d014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7cffff700 1 -- 172.21.15.38:0/2040158770 >> v1:172.21.15.38:6789/0 conn(0x7fa7d00b8d90 legacy=0x7fa7d006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7cffff700 1 -- 172.21.15.38:0/2040158770 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d006b4f0 con 0x7fa7d00bc810 2023-07-11T00:00:37.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7cf7fe700 1 -- 172.21.15.38:0/2040158770 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762078954 0 0) 0x7fa7d00b8620 con 0x7fa7d00b8d90 2023-07-11T00:00:37.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7cffff700 1 --2- 172.21.15.38:0/2040158770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d00bc810 0x7fa7d00ba530 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009840 tx=0x7fa7bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6c923fb23c770a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:37.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7cf7fe700 1 -- 172.21.15.38:0/2040158770 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc011830 con 0x7fa7d00bc810 2023-07-11T00:00:37.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7cf7fe700 1 -- 172.21.15.38:0/2040158770 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc011990 con 0x7fa7d00bc810 2023-07-11T00:00:37.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.502+0000 7fa7cf7fe700 1 -- 172.21.15.38:0/2040158770 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc011d20 con 0x7fa7d00bc810 2023-07-11T00:00:37.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.503+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/2040158770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d00bc810 msgr2=0x7fa7d00ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.503+0000 7fa7d6f1f700 1 --2- 172.21.15.38:0/2040158770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d00bc810 0x7fa7d00ba530 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009840 tx=0x7fa7bc009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:37.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.503+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/2040158770 shutdown_connections 2023-07-11T00:00:37.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.503+0000 7fa7d6f1f700 1 --2- 172.21.15.38:0/2040158770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d00bc810 0x7fa7d00ba530 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.503+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/2040158770 >> 172.21.15.38:0/2040158770 conn(0x7fa7d00c0860 msgr2=0x7fa7d00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:37.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.503+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/2040158770 shutdown_connections 2023-07-11T00:00:37.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.503+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/2040158770 wait complete. 2023-07-11T00:00:37.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.504+0000 7fa7d6f1f700 1 Processor -- start 2023-07-11T00:00:37.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.504+0000 7fa7d6f1f700 1 -- start start 2023-07-11T00:00:37.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d6f1f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d00b8d90 0x7fa7d00b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d6f1f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa7d00bc810 0x7fa7d00b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d6f1f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7d01449d0 0x7fa7d00b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d6f1f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00b6590 con 0x7fa7d00b8d90 2023-07-11T00:00:37.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d6f1f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00b1e20 con 0x7fa7d01449d0 2023-07-11T00:00:37.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d6f1f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d014cbc0 con 0x7fa7d00bc810 2023-07-11T00:00:37.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d4cbb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d00b8d90 0x7fa7d00b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d4cbb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d00b8d90 0x7fa7d00b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41234/0 (socket says 172.21.15.38:41234) 2023-07-11T00:00:37.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d4cbb700 1 -- 172.21.15.38:0/956994815 learned_addr learned my addr 172.21.15.38:0/956994815 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:37.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7cffff700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa7d00bc810 0x7fa7d00b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d54bc700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7d01449d0 0x7fa7d00b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d4cbb700 1 -- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa7d00bc810 msgr2=0x7fa7d00b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d4cbb700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa7d00bc810 0x7fa7d00b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d4cbb700 1 -- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7d01449d0 msgr2=0x7fa7d00b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d4cbb700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7d01449d0 0x7fa7d00b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d4cbb700 1 -- 172.21.15.38:0/956994815 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0094a0 con 0x7fa7d00b8d90 2023-07-11T00:00:37.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.505+0000 7fa7d54bc700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7d01449d0 0x7fa7d00b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:37.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.506+0000 7fa7d4cbb700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d00b8d90 0x7fa7d00b2130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400c480 tx=0x7fa7c400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:37.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.506+0000 7fa7cd7fa700 1 -- 172.21.15.38:0/956994815 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40052d0 con 0x7fa7d00b8d90 2023-07-11T00:00:37.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.506+0000 7fa7cd7fa700 1 -- 172.21.15.38:0/956994815 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c4005430 con 0x7fa7d00b8d90 2023-07-11T00:00:37.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.506+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/956994815 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d014ce10 con 0x7fa7d00b8d90 2023-07-11T00:00:37.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.506+0000 7fa7cd7fa700 1 -- 172.21.15.38:0/956994815 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40038c0 con 0x7fa7d00b8d90 2023-07-11T00:00:37.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.506+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/956994815 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d014d650 con 0x7fa7d00b8d90 2023-07-11T00:00:37.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.507+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/956994815 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d00b2fa0 con 0x7fa7d00b8d90 2023-07-11T00:00:37.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.507+0000 7fa7cd7fa700 1 -- 172.21.15.38:0/956994815 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7c4003a20 con 0x7fa7d00b8d90 2023-07-11T00:00:37.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.507+0000 7fa7cd7fa700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa7b406ace0 0x7fa7b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.508+0000 7fa7cd7fa700 1 -- 172.21.15.38:0/956994815 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7c4088830 con 0x7fa7d00b8d90 2023-07-11T00:00:37.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.508+0000 7fa7cffff700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa7b406ace0 0x7fa7b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.508+0000 7fa7cffff700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa7b406ace0 0x7fa7b406d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0090b0 tx=0x7fa7bc01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:37.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.512+0000 7fa7cd7fa700 1 -- 172.21.15.38:0/956994815 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa7d00b2fa0 con 0x7fa7d00b8d90 2023-07-11T00:00:37.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.709+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/956994815 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7d00b2fa0 con 0x7fa7d00b8d90 2023-07-11T00:00:37.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.709+0000 7fa7cd7fa700 1 -- 172.21.15.38:0/956994815 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7d00b2fa0 con 0x7fa7d00b8d90 2023-07-11T00:00:37.712 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:00:37.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa7b406ace0 msgr2=0x7fa7b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa7b406ace0 0x7fa7b406d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0090b0 tx=0x7fa7bc01c040 comp rx=0 tx=0).stop 2023-07-11T00:00:37.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/956994815 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d00b8d90 msgr2=0x7fa7d00b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d00b8d90 0x7fa7d00b2130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400c480 tx=0x7fa7c400c790 comp rx=0 tx=0).stop 2023-07-11T00:00:37.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/956994815 shutdown_connections 2023-07-11T00:00:37.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa7b406ace0 0x7fa7b406d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7d01449d0 0x7fa7d00b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d00b8d90 0x7fa7d00b2130 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 --2- 172.21.15.38:0/956994815 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa7d00bc810 0x7fa7d00b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/956994815 >> 172.21.15.38:0/956994815 conn(0x7fa7d00c0860 msgr2=0x7fa7d00bef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:37.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/956994815 shutdown_connections 2023-07-11T00:00:37.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.711+0000 7fa7d6f1f700 1 -- 172.21.15.38:0/956994815 wait complete. 2023-07-11T00:00:37.725 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:00:37.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.851+0000 7f71afb99700 1 Processor -- start 2023-07-11T00:00:37.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.851+0000 7f71afb99700 1 -- start start 2023-07-11T00:00:37.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71afb99700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f71a81449d0 0x7f71a814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71afb99700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f71a80b8d90 0x7f71a806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71afb99700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a80b8620 con 0x7f71a80bc810 2023-07-11T00:00:37.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71afb99700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a80b97a0 con 0x7f71a80b8d90 2023-07-11T00:00:37.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71afb99700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a8144da0 con 0x7f71a81449d0 2023-07-11T00:00:37.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71ae136700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f71a80b8d90 0x7f71a806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71ae136700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f71a80b8d90 0x7f71a806ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41242/0 (socket says 172.21.15.38:41242) 2023-07-11T00:00:37.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71ae136700 1 -- 172.21.15.38:0/3022721418 learned_addr learned my addr 172.21.15.38:0/3022721418 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:37.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71ad935700 1 --2- 172.21.15.38:0/3022721418 >> v2:172.21.15.70:3300/0 conn(0x7f71a81449d0 0x7f71a814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71ae136700 1 -- 172.21.15.38:0/3022721418 >> v2:172.21.15.70:3300/0 conn(0x7f71a81449d0 msgr2=0x7f71a814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:37.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71ae136700 1 --2- 172.21.15.38:0/3022721418 >> v2:172.21.15.70:3300/0 conn(0x7f71a81449d0 0x7f71a814db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71ae136700 1 -- 172.21.15.38:0/3022721418 >> v1:172.21.15.70:6789/0 conn(0x7f71a80bc810 legacy=0x7f71a80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:37.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.852+0000 7f71ae136700 1 -- 172.21.15.38:0/3022721418 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80b8900 con 0x7f71a80b8d90 2023-07-11T00:00:37.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71ae136700 1 --2- 172.21.15.38:0/3022721418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a80b8d90 0x7f71a806ade0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f71a806cbe0 tx=0x7f71a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29bc900b8e60fa1 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:37.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71ac933700 1 -- 172.21.15.38:0/3022721418 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000e070 con 0x7f71a80b8d90 2023-07-11T00:00:37.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71ac933700 1 -- 172.21.15.38:0/3022721418 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a0003a20 con 0x7f71a80b8d90 2023-07-11T00:00:37.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71ac933700 1 -- 172.21.15.38:0/3022721418 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0003dd0 con 0x7f71a80b8d90 2023-07-11T00:00:37.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71afb99700 1 -- 172.21.15.38:0/3022721418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a80b8d90 msgr2=0x7f71a806ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71afb99700 1 --2- 172.21.15.38:0/3022721418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a80b8d90 0x7f71a806ade0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f71a806cbe0 tx=0x7f71a000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:37.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71afb99700 1 -- 172.21.15.38:0/3022721418 shutdown_connections 2023-07-11T00:00:37.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71afb99700 1 --2- 172.21.15.38:0/3022721418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a80b8d90 0x7f71a806ade0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71afb99700 1 --2- 172.21.15.38:0/3022721418 >> v2:172.21.15.70:3300/0 conn(0x7f71a81449d0 0x7f71a814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71afb99700 1 -- 172.21.15.38:0/3022721418 >> 172.21.15.38:0/3022721418 conn(0x7f71a80c0860 msgr2=0x7f71a80c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:37.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71afb99700 1 -- 172.21.15.38:0/3022721418 shutdown_connections 2023-07-11T00:00:37.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.853+0000 7f71afb99700 1 -- 172.21.15.38:0/3022721418 wait complete. 2023-07-11T00:00:37.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.854+0000 7f71afb99700 1 Processor -- start 2023-07-11T00:00:37.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.854+0000 7f71afb99700 1 -- start start 2023-07-11T00:00:37.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71afb99700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71a80b8d90 0x7f71a80b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71afb99700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a80bc810 0x7f71a81d5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71afb99700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f71a81449d0 0x7f71a81d5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71afb99700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80b2510 con 0x7f71a80bc810 2023-07-11T00:00:37.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71afb99700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80b2270 con 0x7f71a80b8d90 2023-07-11T00:00:37.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71afb99700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80b3890 con 0x7f71a81449d0 2023-07-11T00:00:37.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71ad134700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a80bc810 0x7f71a81d5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71ad134700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a80bc810 0x7f71a81d5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41256/0 (socket says 172.21.15.38:41256) 2023-07-11T00:00:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71ad134700 1 -- 172.21.15.38:0/703189347 learned_addr learned my addr 172.21.15.38:0/703189347 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71ae136700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f71a81449d0 0x7f71a81d5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71ad935700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71a80b8d90 0x7f71a80b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71ad134700 1 -- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f71a81449d0 msgr2=0x7f71a81d5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71ad134700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f71a81449d0 0x7f71a81d5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71ad134700 1 -- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71a80b8d90 msgr2=0x7f71a80b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71ad134700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71a80b8d90 0x7f71a80b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:37.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.855+0000 7f71ad134700 1 -- 172.21.15.38:0/703189347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a0009b30 con 0x7f71a80bc810 2023-07-11T00:00:37.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.856+0000 7f71ad134700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a80bc810 0x7f71a81d5620 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f71a400c4d0 tx=0x7f71a400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:37.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.856+0000 7f719e7fc700 1 -- 172.21.15.38:0/703189347 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4011790 con 0x7f71a80bc810 2023-07-11T00:00:37.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.856+0000 7f719e7fc700 1 -- 172.21.15.38:0/703189347 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a40118f0 con 0x7f71a80bc810 2023-07-11T00:00:37.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.856+0000 7f719e7fc700 1 -- 172.21.15.38:0/703189347 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4011ca0 con 0x7f71a80bc810 2023-07-11T00:00:37.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.856+0000 7f71afb99700 1 -- 172.21.15.38:0/703189347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a80b3b30 con 0x7f71a80bc810 2023-07-11T00:00:37.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.856+0000 7f71afb99700 1 -- 172.21.15.38:0/703189347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a80b40f0 con 0x7f71a80bc810 2023-07-11T00:00:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.857+0000 7f71afb99700 1 -- 172.21.15.38:0/703189347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a8074360 con 0x7f71a80bc810 2023-07-11T00:00:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.857+0000 7f719e7fc700 1 -- 172.21.15.38:0/703189347 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71a401c460 con 0x7f71a80bc810 2023-07-11T00:00:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.858+0000 7f719e7fc700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f718c06ace0 0x7f718c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.858+0000 7f719e7fc700 1 -- 172.21.15.38:0/703189347 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71a4089110 con 0x7f71a80bc810 2023-07-11T00:00:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.858+0000 7f71ad935700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f718c06ace0 0x7f718c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.858+0000 7f71ad935700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f718c06ace0 0x7f718c06d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7198006b20 tx=0x7f7198008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:37.862+0000 7f719e7fc700 1 -- 172.21.15.38:0/703189347 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f71a4054250 con 0x7f71a80bc810 2023-07-11T00:00:38.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.056+0000 7f71afb99700 1 -- 172.21.15.38:0/703189347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71a80bc330 con 0x7f71a80bc810 2023-07-11T00:00:38.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.056+0000 7f719e7fc700 1 -- 172.21.15.38:0/703189347 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71a4057870 con 0x7f71a80bc810 2023-07-11T00:00:38.060 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-07-11T00:00:38.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 -- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f718c06ace0 msgr2=0x7f718c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f718c06ace0 0x7f718c06d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7198006b20 tx=0x7f7198008040 comp rx=0 tx=0).stop 2023-07-11T00:00:38.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 -- 172.21.15.38:0/703189347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a80bc810 msgr2=0x7f71a81d5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a80bc810 0x7f71a81d5620 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f71a400c4d0 tx=0x7f71a400c7e0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 -- 172.21.15.38:0/703189347 shutdown_connections 2023-07-11T00:00:38.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f718c06ace0 0x7f718c06d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f71a81449d0 0x7f71a81d5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71a80b8d90 0x7f71a80b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 --2- 172.21.15.38:0/703189347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a80bc810 0x7f71a81d5620 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 -- 172.21.15.38:0/703189347 >> 172.21.15.38:0/703189347 conn(0x7f71a80c0860 msgr2=0x7f71a80baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:38.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 -- 172.21.15.38:0/703189347 shutdown_connections 2023-07-11T00:00:38.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.058+0000 7f71afb99700 1 -- 172.21.15.38:0/703189347 wait complete. 2023-07-11T00:00:38.073 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:00:38.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.199+0000 7f6ed15a3700 1 Processor -- start 2023-07-11T00:00:38.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.199+0000 7f6ed15a3700 1 -- start start 2023-07-11T00:00:38.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.199+0000 7f6ed15a3700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ecc1449d0 0x7f6ecc14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.199+0000 7f6ed15a3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ecc0b8d90 0x7f6ecc06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.199+0000 7f6ed15a3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc0b8620 con 0x7f6ecc0bc810 2023-07-11T00:00:38.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.199+0000 7f6ed15a3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc0b97a0 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.199+0000 7f6ed15a3700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc144da0 con 0x7f6ecc1449d0 2023-07-11T00:00:38.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6ecb7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ecc0b8d90 0x7f6ecc06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6eca7fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6ecc0bc810 0x7f6ecc0ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53352/0 (socket says 172.21.15.38:53352) 2023-07-11T00:00:38.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6eca7fc700 1 -- 172.21.15.38:0/3944414832 learned_addr learned my addr 172.21.15.38:0/3944414832 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:38.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6ecaffd700 1 --2- 172.21.15.38:0/3944414832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ecc1449d0 0x7f6ecc14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6ecb7fe700 1 -- 172.21.15.38:0/3944414832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ecc1449d0 msgr2=0x7f6ecc14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:38.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6ecb7fe700 1 --2- 172.21.15.38:0/3944414832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ecc1449d0 0x7f6ecc14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6ecb7fe700 1 -- 172.21.15.38:0/3944414832 >> v1:172.21.15.38:6789/0 conn(0x7f6ecc0bc810 legacy=0x7f6ecc0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6ecb7fe700 1 -- 172.21.15.38:0/3944414832 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0b8900 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6ec9ffb700 1 -- 172.21.15.38:0/3944414832 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402563023 0 0) 0x7f6ecc0b8620 con 0x7f6ecc0bc810 2023-07-11T00:00:38.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6ecb7fe700 1 --2- 172.21.15.38:0/3944414832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ecc0b8d90 0x7f6ecc06ade0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009d90 tx=0x7f6ec400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cc67b1ce26ce0a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:38.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6ec9ffb700 1 -- 172.21.15.38:0/3944414832 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec400e070 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6ec9ffb700 1 -- 172.21.15.38:0/3944414832 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400bbd0 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.200+0000 7f6ec9ffb700 1 -- 172.21.15.38:0/3944414832 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4012430 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.201+0000 7f6ed15a3700 1 -- 172.21.15.38:0/3944414832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ecc0b8d90 msgr2=0x7f6ecc06ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.201+0000 7f6ed15a3700 1 --2- 172.21.15.38:0/3944414832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ecc0b8d90 0x7f6ecc06ade0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009d90 tx=0x7f6ec400b330 comp rx=0 tx=0).stop 2023-07-11T00:00:38.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.201+0000 7f6ed15a3700 1 -- 172.21.15.38:0/3944414832 shutdown_connections 2023-07-11T00:00:38.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.201+0000 7f6ed15a3700 1 --2- 172.21.15.38:0/3944414832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ecc0b8d90 0x7f6ecc06ade0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.201+0000 7f6ed15a3700 1 --2- 172.21.15.38:0/3944414832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ecc1449d0 0x7f6ecc14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.201+0000 7f6ed15a3700 1 -- 172.21.15.38:0/3944414832 >> 172.21.15.38:0/3944414832 conn(0x7f6ecc0c0860 msgr2=0x7f6ecc0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:38.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.201+0000 7f6ed15a3700 1 -- 172.21.15.38:0/3944414832 shutdown_connections 2023-07-11T00:00:38.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.201+0000 7f6ed15a3700 1 -- 172.21.15.38:0/3944414832 wait complete. 2023-07-11T00:00:38.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.202+0000 7f6ed15a3700 1 Processor -- start 2023-07-11T00:00:38.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.202+0000 7f6ed15a3700 1 -- start start 2023-07-11T00:00:38.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.203+0000 7f6ed15a3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ecc0b8d90 0x7f6ecc147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.203+0000 7f6ed15a3700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ecc0bc810 0x7f6ecc14c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.203+0000 7f6ed15a3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ecc1449d0 0x7f6ecc0a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.203+0000 7f6ed15a3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc14cc40 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.203+0000 7f6ed15a3700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0b4510 con 0x7f6ecc1449d0 2023-07-11T00:00:38.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.203+0000 7f6ed15a3700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0b47f0 con 0x7f6ecc0bc810 2023-07-11T00:00:38.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.203+0000 7f6ecaffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ecc0b8d90 0x7f6ecc147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.203+0000 7f6ecaffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ecc0b8d90 0x7f6ecc147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41270/0 (socket says 172.21.15.38:41270) 2023-07-11T00:00:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.203+0000 7f6ecaffd700 1 -- 172.21.15.38:0/4255897214 learned_addr learned my addr 172.21.15.38:0/4255897214 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6eca7fc700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ecc0bc810 0x7f6ecc14c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6ecb7fe700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ecc1449d0 0x7f6ecc0a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6ecaffd700 1 -- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ecc0bc810 msgr2=0x7f6ecc14c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6ecaffd700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ecc0bc810 0x7f6ecc14c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6ecaffd700 1 -- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ecc1449d0 msgr2=0x7f6ecc0a60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6ecaffd700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ecc1449d0 0x7f6ecc0a60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6ecaffd700 1 -- 172.21.15.38:0/4255897214 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4009a70 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6ecb7fe700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ecc1449d0 0x7f6ecc0a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:38.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6ecaffd700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ecc0b8d90 0x7f6ecc147d60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000d800 tx=0x7f6ec000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:38.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6eb37fe700 1 -- 172.21.15.38:0/4255897214 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00125f0 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6eb37fe700 1 -- 172.21.15.38:0/4255897214 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec0012750 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6ed15a3700 1 -- 172.21.15.38:0/4255897214 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc0b4ad0 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6eb37fe700 1 -- 172.21.15.38:0/4255897214 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0012b00 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.204+0000 7f6ed15a3700 1 -- 172.21.15.38:0/4255897214 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc0b7220 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.205+0000 7f6ed15a3700 1 -- 172.21.15.38:0/4255897214 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc1e3030 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.206+0000 7f6eb37fe700 1 -- 172.21.15.38:0/4255897214 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ec0012c60 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.206+0000 7f6eb37fe700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6eb806ace0 0x7f6eb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.207+0000 7f6eb37fe700 1 -- 172.21.15.38:0/4255897214 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ec008a000 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.207+0000 7f6eca7fc700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6eb806ace0 0x7f6eb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.207+0000 7f6eca7fc700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6eb806ace0 0x7f6eb806d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc1e0bf0 tx=0x7f6ebc007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.210+0000 7f6eb37fe700 1 -- 172.21.15.38:0/4255897214 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6ec0055190 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.407+0000 7f6ed15a3700 1 -- 172.21.15.38:0/4255897214 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ecc1e3030 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.408+0000 7f6eb37fe700 1 -- 172.21.15.38:0/4255897214 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ec00587b0 con 0x7f6ecc0b8d90 2023-07-11T00:00:38.411 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-07-11T00:00:38.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 -- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6eb806ace0 msgr2=0x7f6eb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6eb806ace0 0x7f6eb806d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc1e0bf0 tx=0x7f6ebc007de0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 -- 172.21.15.38:0/4255897214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ecc0b8d90 msgr2=0x7f6ecc147d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ecc0b8d90 0x7f6ecc147d60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000d800 tx=0x7f6ec000db10 comp rx=0 tx=0).stop 2023-07-11T00:00:38.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 -- 172.21.15.38:0/4255897214 shutdown_connections 2023-07-11T00:00:38.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6eb806ace0 0x7f6eb806d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ecc1449d0 0x7f6ecc0a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ecc0b8d90 0x7f6ecc147d60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 --2- 172.21.15.38:0/4255897214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6ecc0bc810 0x7f6ecc14c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 -- 172.21.15.38:0/4255897214 >> 172.21.15.38:0/4255897214 conn(0x7f6ecc0c0860 msgr2=0x7f6ecc0be760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:38.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 -- 172.21.15.38:0/4255897214 shutdown_connections 2023-07-11T00:00:38.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.410+0000 7f6ed15a3700 1 -- 172.21.15.38:0/4255897214 wait complete. 2023-07-11T00:00:38.425 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:38.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.548+0000 7f34aa6e3700 1 Processor -- start 2023-07-11T00:00:38.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.548+0000 7f34aa6e3700 1 -- start start 2023-07-11T00:00:38.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.548+0000 7f34aa6e3700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34a4147dc0 0x7f34a40721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34aa6e3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f34a4069f30 0x7f34a4071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34aa6e3700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f34a406a380 0x7f34a4071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34aa6e3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a4070950 con 0x7f34a4069f30 2023-07-11T00:00:38.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34aa6e3700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a406f680 con 0x7f34a406a380 2023-07-11T00:00:38.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34aa6e3700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a406f920 con 0x7f34a4147dc0 2023-07-11T00:00:38.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f34a4069f30 0x7f34a4071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f34a4069f30 0x7f34a4071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41282/0 (socket says 172.21.15.38:41282) 2023-07-11T00:00:38.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a37fe700 1 -- 172.21.15.38:0/2879892783 learned_addr learned my addr 172.21.15.38:0/2879892783 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a3fff700 1 --2- 172.21.15.38:0/2879892783 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34a4147dc0 0x7f34a40721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a8c80700 1 --2- 172.21.15.38:0/2879892783 >> v2:172.21.15.70:3300/0 conn(0x7f34a406a380 0x7f34a4071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a37fe700 1 -- 172.21.15.38:0/2879892783 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34a4147dc0 msgr2=0x7f34a40721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:38.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a37fe700 1 --2- 172.21.15.38:0/2879892783 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34a4147dc0 0x7f34a40721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a37fe700 1 -- 172.21.15.38:0/2879892783 >> v2:172.21.15.70:3300/0 conn(0x7f34a406a380 msgr2=0x7f34a4071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:38.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a37fe700 1 --2- 172.21.15.38:0/2879892783 >> v2:172.21.15.70:3300/0 conn(0x7f34a406a380 0x7f34a4071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a37fe700 1 -- 172.21.15.38:0/2879892783 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a40b9660 con 0x7f34a4069f30 2023-07-11T00:00:38.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a37fe700 1 --2- 172.21.15.38:0/2879892783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34a4069f30 0x7f34a4071130 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f34a40667e0 tx=0x7f3498009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9b672c08b8aef9 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:38.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a2ffd700 1 -- 172.21.15.38:0/2879892783 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498011830 con 0x7f34a4069f30 2023-07-11T00:00:38.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a2ffd700 1 -- 172.21.15.38:0/2879892783 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3498011990 con 0x7f34a4069f30 2023-07-11T00:00:38.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.549+0000 7f34a2ffd700 1 -- 172.21.15.38:0/2879892783 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498011d20 con 0x7f34a4069f30 2023-07-11T00:00:38.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.550+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2879892783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34a4069f30 msgr2=0x7f34a4071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.550+0000 7f34aa6e3700 1 --2- 172.21.15.38:0/2879892783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34a4069f30 0x7f34a4071130 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f34a40667e0 tx=0x7f3498009bd0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.550+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2879892783 shutdown_connections 2023-07-11T00:00:38.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.550+0000 7f34aa6e3700 1 --2- 172.21.15.38:0/2879892783 >> v2:172.21.15.70:3300/0 conn(0x7f34a406a380 0x7f34a4071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.550+0000 7f34aa6e3700 1 --2- 172.21.15.38:0/2879892783 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34a4147dc0 0x7f34a40721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.550+0000 7f34aa6e3700 1 --2- 172.21.15.38:0/2879892783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34a4069f30 0x7f34a4071130 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.550+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2879892783 >> 172.21.15.38:0/2879892783 conn(0x7f34a406d0e0 msgr2=0x7f34a406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:38.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.550+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2879892783 shutdown_connections 2023-07-11T00:00:38.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.550+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2879892783 wait complete. 2023-07-11T00:00:38.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.551+0000 7f34aa6e3700 1 Processor -- start 2023-07-11T00:00:38.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.551+0000 7f34aa6e3700 1 -- start start 2023-07-11T00:00:38.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34aa6e3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34a4069f30 0x7f34a414e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34aa6e3700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34a406a380 0x7f34a414d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34aa6e3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34a4147dc0 0x7f34a414c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34aa6e3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a414c060 con 0x7f34a4069f30 2023-07-11T00:00:38.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34aa6e3700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a414eab0 con 0x7f34a4147dc0 2023-07-11T00:00:38.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34aa6e3700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a414ded0 con 0x7f34a406a380 2023-07-11T00:00:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34a4069f30 0x7f34a414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34a4069f30 0x7f34a414e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41294/0 (socket says 172.21.15.38:41294) 2023-07-11T00:00:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a3fff700 1 -- 172.21.15.38:0/2819180184 learned_addr learned my addr 172.21.15.38:0/2819180184 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a37fe700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34a406a380 0x7f34a414d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a8c80700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34a4147dc0 0x7f34a414c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a3fff700 1 -- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34a406a380 msgr2=0x7f34a414d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a3fff700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34a406a380 0x7f34a414d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a3fff700 1 -- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34a4147dc0 msgr2=0x7f34a414c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a3fff700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34a4147dc0 0x7f34a414c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a3fff700 1 -- 172.21.15.38:0/2819180184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3498009550 con 0x7f34a4069f30 2023-07-11T00:00:38.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a37fe700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34a406a380 0x7f34a414d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:38.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.552+0000 7f34a3fff700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34a4069f30 0x7f34a414e570 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f349400e870 tx=0x7f349400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.553+0000 7f34a0ff9700 1 -- 172.21.15.38:0/2819180184 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494009590 con 0x7f34a4069f30 2023-07-11T00:00:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.553+0000 7f34a0ff9700 1 -- 172.21.15.38:0/2819180184 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400ee70 con 0x7f34a4069f30 2023-07-11T00:00:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.553+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2819180184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a414ba10 con 0x7f34a4069f30 2023-07-11T00:00:38.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.553+0000 7f34a0ff9700 1 -- 172.21.15.38:0/2819180184 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400ca50 con 0x7f34a4069f30 2023-07-11T00:00:38.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.553+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2819180184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a4142b00 con 0x7f34a4069f30 2023-07-11T00:00:38.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.553+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2819180184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a4142cf0 con 0x7f34a4069f30 2023-07-11T00:00:38.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.554+0000 7f34a0ff9700 1 -- 172.21.15.38:0/2819180184 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f349400cbb0 con 0x7f34a4069f30 2023-07-11T00:00:38.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.554+0000 7f34a0ff9700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f349006ace0 0x7f349006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.555+0000 7f34a0ff9700 1 -- 172.21.15.38:0/2819180184 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3494089460 con 0x7f34a4069f30 2023-07-11T00:00:38.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.555+0000 7f34a37fe700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f349006ace0 0x7f349006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.555+0000 7f34a37fe700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f349006ace0 0x7f349006d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3498009c10 tx=0x7f3498008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:38.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.559+0000 7f34a0ff9700 1 -- 172.21.15.38:0/2819180184 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f34a4142cf0 con 0x7f34a4069f30 2023-07-11T00:00:38.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.754+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2819180184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34a4142cf0 con 0x7f34a4069f30 2023-07-11T00:00:38.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.755+0000 7f34a0ff9700 1 -- 172.21.15.38:0/2819180184 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f34a4142cf0 con 0x7f34a4069f30 2023-07-11T00:00:38.758 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:38.759 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f349006ace0 msgr2=0x7f349006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f349006ace0 0x7f349006d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3498009c10 tx=0x7f3498008030 comp rx=0 tx=0).stop 2023-07-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2819180184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34a4069f30 msgr2=0x7f34a414e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34a4069f30 0x7f34a414e570 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f349400e870 tx=0x7f349400ec30 comp rx=0 tx=0).stop 2023-07-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2819180184 shutdown_connections 2023-07-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f349006ace0 0x7f349006d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34a4147dc0 0x7f34a414c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34a4069f30 0x7f34a414e570 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 --2- 172.21.15.38:0/2819180184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34a406a380 0x7f34a414d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2819180184 >> 172.21.15.38:0/2819180184 conn(0x7f34a406d0e0 msgr2=0x7f34a4143520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:38.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2819180184 shutdown_connections 2023-07-11T00:00:38.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.757+0000 7f34aa6e3700 1 -- 172.21.15.38:0/2819180184 wait complete. 2023-07-11T00:00:38.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:00:14.572121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:00:15.763698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:00:38.774 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:00:38.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.901+0000 7fcdf5b8f700 1 Processor -- start 2023-07-11T00:00:38.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.901+0000 7fcdf5b8f700 1 -- start start 2023-07-11T00:00:38.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.902+0000 7fcdf5b8f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcdf006b120 0x7fcdf01474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.902+0000 7fcdf5b8f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcdf0147a30 0x7fcdf00b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.902+0000 7fcdf5b8f700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf00b3bd0 con 0x7fcdf0071b60 2023-07-11T00:00:38.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.902+0000 7fcdf5b8f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf0070800 con 0x7fcdf006b120 2023-07-11T00:00:38.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.902+0000 7fcdf5b8f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf0141c90 con 0x7fcdf0147a30 2023-07-11T00:00:38.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.902+0000 7fcdef7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcdf006b120 0x7fcdf01474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.902+0000 7fcdef7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcdf006b120 0x7fcdf01474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41304/0 (socket says 172.21.15.38:41304) 2023-07-11T00:00:38.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.902+0000 7fcdef7fe700 1 -- 172.21.15.38:0/2777855800 learned_addr learned my addr 172.21.15.38:0/2777855800 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:38.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.902+0000 7fcdeffff700 1 --2- 172.21.15.38:0/2777855800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcdf0147a30 0x7fcdf00b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.903+0000 7fcdef7fe700 1 -- 172.21.15.38:0/2777855800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcdf0147a30 msgr2=0x7fcdf00b6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:38.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.903+0000 7fcdef7fe700 1 --2- 172.21.15.38:0/2777855800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcdf0147a30 0x7fcdf00b6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.903+0000 7fcdef7fe700 1 -- 172.21.15.38:0/2777855800 >> v1:172.21.15.70:6789/0 conn(0x7fcdf0071b60 legacy=0x7fcdf00b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.903+0000 7fcdef7fe700 1 -- 172.21.15.38:0/2777855800 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf00714d0 con 0x7fcdf006b120 2023-07-11T00:00:38.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.903+0000 7fcdef7fe700 1 --2- 172.21.15.38:0/2777855800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf006b120 0x7fcdf01474f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcde00098f0 tx=0x7fcde0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358324bc13b58c88 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:38.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.903+0000 7fcdee7fc700 1 -- 172.21.15.38:0/2777855800 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0011830 con 0x7fcdf006b120 2023-07-11T00:00:38.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.903+0000 7fcdee7fc700 1 -- 172.21.15.38:0/2777855800 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde0011990 con 0x7fcdf006b120 2023-07-11T00:00:38.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.903+0000 7fcdee7fc700 1 -- 172.21.15.38:0/2777855800 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0011d20 con 0x7fcdf006b120 2023-07-11T00:00:38.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.903+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/2777855800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf006b120 msgr2=0x7fcdf01474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.903+0000 7fcdf5b8f700 1 --2- 172.21.15.38:0/2777855800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf006b120 0x7fcdf01474f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcde00098f0 tx=0x7fcde0009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:38.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.904+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/2777855800 shutdown_connections 2023-07-11T00:00:38.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.904+0000 7fcdf5b8f700 1 --2- 172.21.15.38:0/2777855800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcdf0147a30 0x7fcdf00b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.904+0000 7fcdf5b8f700 1 --2- 172.21.15.38:0/2777855800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf006b120 0x7fcdf01474f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.904+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/2777855800 >> 172.21.15.38:0/2777855800 conn(0x7fcdf00bd980 msgr2=0x7fcdf00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:38.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.904+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/2777855800 shutdown_connections 2023-07-11T00:00:38.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.904+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/2777855800 wait complete. 2023-07-11T00:00:38.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.905+0000 7fcdf5b8f700 1 Processor -- start 2023-07-11T00:00:38.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.905+0000 7fcdf5b8f700 1 -- start start 2023-07-11T00:00:38.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.905+0000 7fcdf5b8f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf006b120 0x7fcdf01df3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.905+0000 7fcdf5b8f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdf0071b60 0x7fcdf013ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.905+0000 7fcdf5b8f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcdf0147a30 0x7fcdf01db390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.905+0000 7fcdf5b8f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf013f450 con 0x7fcdf006b120 2023-07-11T00:00:38.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.905+0000 7fcdf5b8f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf01def40 con 0x7fcdf0071b60 2023-07-11T00:00:38.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdf5b8f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00b70a0 con 0x7fcdf0147a30 2023-07-11T00:00:38.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdef7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf006b120 0x7fcdf01df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdef7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf006b120 0x7fcdf01df3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41306/0 (socket says 172.21.15.38:41306) 2023-07-11T00:00:38.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdef7fe700 1 -- 172.21.15.38:0/3180647751 learned_addr learned my addr 172.21.15.38:0/3180647751 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:38.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdeffff700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcdf0147a30 0x7fcdf01db390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdeeffd700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdf0071b60 0x7fcdf013ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdef7fe700 1 -- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcdf0147a30 msgr2=0x7fcdf01db390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdef7fe700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcdf0147a30 0x7fcdf01db390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdef7fe700 1 -- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdf0071b60 msgr2=0x7fcdf013ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:38.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdef7fe700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdf0071b60 0x7fcdf013ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:38.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdef7fe700 1 -- 172.21.15.38:0/3180647751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0009550 con 0x7fcdf006b120 2023-07-11T00:00:38.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdef7fe700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf006b120 0x7fcdf01df3d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcde0000c00 tx=0x7fcde0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:38.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcde7fff700 1 -- 172.21.15.38:0/3180647751 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0004400 con 0x7fcdf006b120 2023-07-11T00:00:38.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcde7fff700 1 -- 172.21.15.38:0/3180647751 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde001f070 con 0x7fcdf006b120 2023-07-11T00:00:38.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/3180647751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf0139760 con 0x7fcdf006b120 2023-07-11T00:00:38.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcde7fff700 1 -- 172.21.15.38:0/3180647751 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde00038e0 con 0x7fcdf006b120 2023-07-11T00:00:38.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.906+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/3180647751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf01debd0 con 0x7fcdf006b120 2023-07-11T00:00:38.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.907+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/3180647751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf00b8e70 con 0x7fcdf006b120 2023-07-11T00:00:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.908+0000 7fcde7fff700 1 -- 172.21.15.38:0/3180647751 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcde0021030 con 0x7fcdf006b120 2023-07-11T00:00:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.908+0000 7fcde7fff700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcdd006ace0 0x7fcdd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.908+0000 7fcde7fff700 1 -- 172.21.15.38:0/3180647751 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcde008a790 con 0x7fcdf006b120 2023-07-11T00:00:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.908+0000 7fcdeeffd700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcdd006ace0 0x7fcdd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:38.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.909+0000 7fcdeeffd700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcdd006ace0 0x7fcdd006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00b7a30 tx=0x7fcdd8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:38.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:38.912+0000 7fcde7fff700 1 -- 172.21.15.38:0/3180647751 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fcdf00b8e70 con 0x7fcdf006b120 2023-07-11T00:00:39.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.108+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/3180647751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcdf00b8e70 con 0x7fcdf006b120 2023-07-11T00:00:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.109+0000 7fcde7fff700 1 -- 172.21.15.38:0/3180647751 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcdf00b8e70 con 0x7fcdf006b120 2023-07-11T00:00:39.112 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:00:39.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcdd006ace0 msgr2=0x7fcdd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcdd006ace0 0x7fcdd006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00b7a30 tx=0x7fcdd8009040 comp rx=0 tx=0).stop 2023-07-11T00:00:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/3180647751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf006b120 msgr2=0x7fcdf01df3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf006b120 0x7fcdf01df3d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcde0000c00 tx=0x7fcde0004750 comp rx=0 tx=0).stop 2023-07-11T00:00:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/3180647751 shutdown_connections 2023-07-11T00:00:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fcdd006ace0 0x7fcdd006d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcdf0147a30 0x7fcdf01db390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf006b120 0x7fcdf01df3d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 --2- 172.21.15.38:0/3180647751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdf0071b60 0x7fcdf013ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/3180647751 >> 172.21.15.38:0/3180647751 conn(0x7fcdf00bd980 msgr2=0x7fcdf00bb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:39.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/3180647751 shutdown_connections 2023-07-11T00:00:39.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.111+0000 7fcdf5b8f700 1 -- 172.21.15.38:0/3180647751 wait complete. 2023-07-11T00:00:39.126 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:00:39.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.250+0000 7f10e0963700 1 Processor -- start 2023-07-11T00:00:39.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.250+0000 7f10e0963700 1 -- start start 2023-07-11T00:00:39.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.251+0000 7f10e0963700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10dc071a30 0x7f10dc14ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.251+0000 7f10e0963700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc070e70 con 0x7f10dc0b96b0 2023-07-11T00:00:39.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.251+0000 7f10e0963700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc0ba720 con 0x7f10dc141780 2023-07-11T00:00:39.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.251+0000 7f10e0963700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc071ea0 con 0x7f10dc071a30 2023-07-11T00:00:39.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.251+0000 7f10dad9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f10dc0b96b0 0x7f10dc151eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53354/0 (socket says 172.21.15.38:53354) 2023-07-11T00:00:39.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.251+0000 7f10dad9d700 1 -- 172.21.15.38:0/65097122 learned_addr learned my addr 172.21.15.38:0/65097122 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:39.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d9d9b700 1 --2- 172.21.15.38:0/65097122 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10dc071a30 0x7f10dc14ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d959a700 1 -- 172.21.15.38:0/65097122 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437367513 0 0) 0x7f10dc070e70 con 0x7f10dc0b96b0 2023-07-11T00:00:39.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d959a700 1 -- 172.21.15.38:0/65097122 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c40035b0 con 0x7f10dc0b96b0 2023-07-11T00:00:39.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d959a700 1 -- 172.21.15.38:0/65097122 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456096665 0 0) 0x7f10dc0ba720 con 0x7f10dc141780 2023-07-11T00:00:39.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d959a700 1 -- 172.21.15.38:0/65097122 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10dc070e70 con 0x7f10dc141780 2023-07-11T00:00:39.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d9d9b700 1 -- 172.21.15.38:0/65097122 >> v1:172.21.15.70:6789/0 conn(0x7f10dc141780 legacy=0x7f10dc0ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d959a700 1 -- 172.21.15.38:0/65097122 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741915699 0 0) 0x7f10c40035b0 con 0x7f10dc0b96b0 2023-07-11T00:00:39.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d9d9b700 1 -- 172.21.15.38:0/65097122 >> v1:172.21.15.38:6789/0 conn(0x7f10dc0b96b0 legacy=0x7f10dc151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d9d9b700 1 -- 172.21.15.38:0/65097122 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0b9b40 con 0x7f10dc071a30 2023-07-11T00:00:39.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d9d9b700 1 --2- 172.21.15.38:0/65097122 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10dc071a30 0x7f10dc14ab20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009870 tx=0x7f10cc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56e909935f449ee2 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:39.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d959a700 1 -- 172.21.15.38:0/65097122 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d40019f0 con 0x7f10dc071a30 2023-07-11T00:00:39.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d959a700 1 -- 172.21.15.38:0/65097122 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc004030 con 0x7f10dc071a30 2023-07-11T00:00:39.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.252+0000 7f10d959a700 1 -- 172.21.15.38:0/65097122 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0043c0 con 0x7f10dc071a30 2023-07-11T00:00:39.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.253+0000 7f10e0963700 1 -- 172.21.15.38:0/65097122 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10dc071a30 msgr2=0x7f10dc14ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.253+0000 7f10e0963700 1 --2- 172.21.15.38:0/65097122 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10dc071a30 0x7f10dc14ab20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009870 tx=0x7f10cc009b80 comp rx=0 tx=0).stop 2023-07-11T00:00:39.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.253+0000 7f10e0963700 1 -- 172.21.15.38:0/65097122 shutdown_connections 2023-07-11T00:00:39.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.253+0000 7f10e0963700 1 --2- 172.21.15.38:0/65097122 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10dc071a30 0x7f10dc14ab20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.253+0000 7f10e0963700 1 -- 172.21.15.38:0/65097122 >> 172.21.15.38:0/65097122 conn(0x7f10dc06d0e0 msgr2=0x7f10dc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:39.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.253+0000 7f10e0963700 1 -- 172.21.15.38:0/65097122 shutdown_connections 2023-07-11T00:00:39.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.253+0000 7f10e0963700 1 -- 172.21.15.38:0/65097122 wait complete. 2023-07-11T00:00:39.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.254+0000 7f10e0963700 1 Processor -- start 2023-07-11T00:00:39.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.254+0000 7f10e0963700 1 -- start start 2023-07-11T00:00:39.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10e0963700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10dc071a30 0x7f10dc14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10e0963700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10dc0b96b0 0x7f10dc1e3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10e0963700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10dc141780 0x7f10dc1e3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10e0963700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc14a6f0 con 0x7f10dc141780 2023-07-11T00:00:39.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10e0963700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc13b290 con 0x7f10dc071a30 2023-07-11T00:00:39.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10e0963700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc137840 con 0x7f10dc0b96b0 2023-07-11T00:00:39.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10dad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10dc141780 0x7f10dc1e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10dad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10dc141780 0x7f10dc1e3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41310/0 (socket says 172.21.15.38:41310) 2023-07-11T00:00:39.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10dad9d700 1 -- 172.21.15.38:0/2811372757 learned_addr learned my addr 172.21.15.38:0/2811372757 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:39.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10d9d9b700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10dc0b96b0 0x7f10dc1e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10da59c700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10dc071a30 0x7f10dc14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10dad9d700 1 -- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10dc0b96b0 msgr2=0x7f10dc1e3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10dad9d700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10dc0b96b0 0x7f10dc1e3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10dad9d700 1 -- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10dc071a30 msgr2=0x7f10dc14a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10dad9d700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10dc071a30 0x7f10dc14a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.255+0000 7f10dad9d700 1 -- 172.21.15.38:0/2811372757 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0094a0 con 0x7f10dc141780 2023-07-11T00:00:39.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.256+0000 7f10dad9d700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10dc141780 0x7f10dc1e3680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f10d4001560 tx=0x7f10d4001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:39.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.256+0000 7f10caffd700 1 -- 172.21.15.38:0/2811372757 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d400ab00 con 0x7f10dc141780 2023-07-11T00:00:39.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.256+0000 7f10caffd700 1 -- 172.21.15.38:0/2811372757 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d400ac80 con 0x7f10dc141780 2023-07-11T00:00:39.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.256+0000 7f10e0963700 1 -- 172.21.15.38:0/2811372757 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc13a960 con 0x7f10dc141780 2023-07-11T00:00:39.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.256+0000 7f10caffd700 1 -- 172.21.15.38:0/2811372757 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d40070d0 con 0x7f10dc141780 2023-07-11T00:00:39.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.256+0000 7f10e0963700 1 -- 172.21.15.38:0/2811372757 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc13af20 con 0x7f10dc141780 2023-07-11T00:00:39.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.257+0000 7f10e0963700 1 -- 172.21.15.38:0/2811372757 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc074360 con 0x7f10dc141780 2023-07-11T00:00:39.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.257+0000 7f10caffd700 1 -- 172.21.15.38:0/2811372757 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10d4007230 con 0x7f10dc141780 2023-07-11T00:00:39.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.257+0000 7f10caffd700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f10bc06ad10 0x7f10bc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.258+0000 7f10caffd700 1 -- 172.21.15.38:0/2811372757 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10d40892c0 con 0x7f10dc141780 2023-07-11T00:00:39.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.258+0000 7f10da59c700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f10bc06ad10 0x7f10bc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.258+0000 7f10da59c700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f10bc06ad10 0x7f10bc06d1c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10d00011e0 tx=0x7f10d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:39.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.262+0000 7f10caffd700 1 -- 172.21.15.38:0/2811372757 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f10d4057e00 con 0x7f10dc141780 2023-07-11T00:00:39.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.456+0000 7f10e0963700 1 -- 172.21.15.38:0/2811372757 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10dc13b3d0 con 0x7f10dc141780 2023-07-11T00:00:39.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.457+0000 7f10caffd700 1 -- 172.21.15.38:0/2811372757 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10d4057990 con 0x7f10dc141780 2023-07-11T00:00:39.460 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:00:39.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 -- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f10bc06ad10 msgr2=0x7f10bc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f10bc06ad10 0x7f10bc06d1c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10d00011e0 tx=0x7f10d0009040 comp rx=0 tx=0).stop 2023-07-11T00:00:39.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 -- 172.21.15.38:0/2811372757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10dc141780 msgr2=0x7f10dc1e3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10dc141780 0x7f10dc1e3680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f10d4001560 tx=0x7f10d4001ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 -- 172.21.15.38:0/2811372757 shutdown_connections 2023-07-11T00:00:39.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f10bc06ad10 0x7f10bc06d1c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10dc141780 0x7f10dc1e3680 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10dc071a30 0x7f10dc14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 --2- 172.21.15.38:0/2811372757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10dc0b96b0 0x7f10dc1e3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 -- 172.21.15.38:0/2811372757 >> 172.21.15.38:0/2811372757 conn(0x7f10dc06d0e0 msgr2=0x7f10dc14ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:39.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 -- 172.21.15.38:0/2811372757 shutdown_connections 2023-07-11T00:00:39.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.459+0000 7f10e0963700 1 -- 172.21.15.38:0/2811372757 wait complete. 2023-07-11T00:00:39.474 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:00:39.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.599+0000 7fa1f7658700 1 Processor -- start 2023-07-11T00:00:39.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.600+0000 7fa1f7658700 1 -- start start 2023-07-11T00:00:39.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.600+0000 7fa1f7658700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa1f00bc810 0x7fa1f00ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.600+0000 7fa1f7658700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa1f00b8d90 0x7fa1f006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.600+0000 7fa1f7658700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00b8620 con 0x7fa1f01449d0 2023-07-11T00:00:39.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.600+0000 7fa1f7658700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f00b97a0 con 0x7fa1f00b8d90 2023-07-11T00:00:39.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.600+0000 7fa1f7658700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f0144da0 con 0x7fa1f00bc810 2023-07-11T00:00:39.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.600+0000 7fa1f5bf5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa1f00b8d90 0x7fa1f006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.600+0000 7fa1f53f4700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa1f01449d0 0x7fa1f014db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53368/0 (socket says 172.21.15.38:53368) 2023-07-11T00:00:39.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.600+0000 7fa1f53f4700 1 -- 172.21.15.38:0/1622558538 learned_addr learned my addr 172.21.15.38:0/1622558538 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:39.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.601+0000 7fa1f4bf3700 1 --2- 172.21.15.38:0/1622558538 >> v2:172.21.15.70:3300/0 conn(0x7fa1f00bc810 0x7fa1f00ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.601+0000 7fa1f5bf5700 1 -- 172.21.15.38:0/1622558538 >> v2:172.21.15.70:3300/0 conn(0x7fa1f00bc810 msgr2=0x7fa1f00ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:39.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.601+0000 7fa1f5bf5700 1 --2- 172.21.15.38:0/1622558538 >> v2:172.21.15.70:3300/0 conn(0x7fa1f00bc810 0x7fa1f00ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.601+0000 7fa1f5bf5700 1 -- 172.21.15.38:0/1622558538 >> v1:172.21.15.38:6789/0 conn(0x7fa1f01449d0 legacy=0x7fa1f014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.601+0000 7fa1e7fff700 1 -- 172.21.15.38:0/1622558538 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163658177 0 0) 0x7fa1f00b8620 con 0x7fa1f01449d0 2023-07-11T00:00:39.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.601+0000 7fa1f5bf5700 1 -- 172.21.15.38:0/1622558538 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00b8900 con 0x7fa1f00b8d90 2023-07-11T00:00:39.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.601+0000 7fa1f5bf5700 1 --2- 172.21.15.38:0/1622558538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1f00b8d90 0x7fa1f006ade0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa1f006ce40 tx=0x7fa1e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a262eb708f1553c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:39.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.601+0000 7fa1e7fff700 1 -- 172.21.15.38:0/1622558538 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800e070 con 0x7fa1f00b8d90 2023-07-11T00:00:39.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.601+0000 7fa1e7fff700 1 -- 172.21.15.38:0/1622558538 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e800bbd0 con 0x7fa1f00b8d90 2023-07-11T00:00:39.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.601+0000 7fa1e7fff700 1 -- 172.21.15.38:0/1622558538 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8012430 con 0x7fa1f00b8d90 2023-07-11T00:00:39.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.602+0000 7fa1f7658700 1 -- 172.21.15.38:0/1622558538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1f00b8d90 msgr2=0x7fa1f006ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.602+0000 7fa1f7658700 1 --2- 172.21.15.38:0/1622558538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1f00b8d90 0x7fa1f006ade0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa1f006ce40 tx=0x7fa1e800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:39.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.602+0000 7fa1f7658700 1 -- 172.21.15.38:0/1622558538 shutdown_connections 2023-07-11T00:00:39.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.602+0000 7fa1f7658700 1 --2- 172.21.15.38:0/1622558538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1f00b8d90 0x7fa1f006ade0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.602+0000 7fa1f7658700 1 --2- 172.21.15.38:0/1622558538 >> v2:172.21.15.70:3300/0 conn(0x7fa1f00bc810 0x7fa1f00ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.602+0000 7fa1f7658700 1 -- 172.21.15.38:0/1622558538 >> 172.21.15.38:0/1622558538 conn(0x7fa1f00c0860 msgr2=0x7fa1f00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:39.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.602+0000 7fa1f7658700 1 -- 172.21.15.38:0/1622558538 shutdown_connections 2023-07-11T00:00:39.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.602+0000 7fa1f7658700 1 -- 172.21.15.38:0/1622558538 wait complete. 2023-07-11T00:00:39.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.603+0000 7fa1f7658700 1 Processor -- start 2023-07-11T00:00:39.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.603+0000 7fa1f7658700 1 -- start start 2023-07-11T00:00:39.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f7658700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1f00b8d90 0x7fa1f0146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f7658700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1f00bc810 0x7fa1f01476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f7658700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f01449d0 0x7fa1f00b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f7658700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00b44c0 con 0x7fa1f00b8d90 2023-07-11T00:00:39.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f7658700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0145760 con 0x7fa1f01449d0 2023-07-11T00:00:39.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f7658700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00b2550 con 0x7fa1f00bc810 2023-07-11T00:00:39.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f53f4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1f00b8d90 0x7fa1f0146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f53f4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1f00b8d90 0x7fa1f0146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41330/0 (socket says 172.21.15.38:41330) 2023-07-11T00:00:39.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f53f4700 1 -- 172.21.15.38:0/708549485 learned_addr learned my addr 172.21.15.38:0/708549485 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:39.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f4bf3700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1f00bc810 0x7fa1f01476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f5bf5700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f01449d0 0x7fa1f00b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f53f4700 1 -- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1f00bc810 msgr2=0x7fa1f01476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f53f4700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1f00bc810 0x7fa1f01476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f53f4700 1 -- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f01449d0 msgr2=0x7fa1f00b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f53f4700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f01449d0 0x7fa1f00b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f53f4700 1 -- 172.21.15.38:0/708549485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8009a70 con 0x7fa1f00b8d90 2023-07-11T00:00:39.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f5bf5700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f01449d0 0x7fa1f00b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:39.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f53f4700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1f00b8d90 0x7fa1f0146ee0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c580 tx=0x7fa1e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:39.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1e5ffb700 1 -- 172.21.15.38:0/708549485 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0004c80 con 0x7fa1f00b8d90 2023-07-11T00:00:39.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1e5ffb700 1 -- 172.21.15.38:0/708549485 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e0004e00 con 0x7fa1f00b8d90 2023-07-11T00:00:39.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1f7658700 1 -- 172.21.15.38:0/708549485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f00b2830 con 0x7fa1f00b8d90 2023-07-11T00:00:39.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.604+0000 7fa1e5ffb700 1 -- 172.21.15.38:0/708549485 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0007310 con 0x7fa1f00b8d90 2023-07-11T00:00:39.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.605+0000 7fa1f7658700 1 -- 172.21.15.38:0/708549485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f01459b0 con 0x7fa1f00b8d90 2023-07-11T00:00:39.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.605+0000 7fa1f7658700 1 -- 172.21.15.38:0/708549485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f00be640 con 0x7fa1f00b8d90 2023-07-11T00:00:39.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.606+0000 7fa1e5ffb700 1 -- 172.21.15.38:0/708549485 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa1e0007470 con 0x7fa1f00b8d90 2023-07-11T00:00:39.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.606+0000 7fa1e5ffb700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa1d406ace0 0x7fa1d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.607+0000 7fa1e5ffb700 1 -- 172.21.15.38:0/708549485 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1e0089150 con 0x7fa1f00b8d90 2023-07-11T00:00:39.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.607+0000 7fa1f4bf3700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa1d406ace0 0x7fa1d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.607+0000 7fa1f4bf3700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa1d406ace0 0x7fa1d406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00befc0 tx=0x7fa1ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:39.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.611+0000 7fa1e5ffb700 1 -- 172.21.15.38:0/708549485 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa1e0054290 con 0x7fa1f00b8d90 2023-07-11T00:00:39.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.807+0000 7fa1f7658700 1 -- 172.21.15.38:0/708549485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1f006c2f0 con 0x7fa1f00b8d90 2023-07-11T00:00:39.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.807+0000 7fa1e5ffb700 1 -- 172.21.15.38:0/708549485 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1e00578b0 con 0x7fa1f00b8d90 2023-07-11T00:00:39.810 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-07-11T00:00:39.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.809+0000 7fa1f7658700 1 -- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa1d406ace0 msgr2=0x7fa1d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.809+0000 7fa1f7658700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa1d406ace0 0x7fa1d406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00befc0 tx=0x7fa1ec008040 comp rx=0 tx=0).stop 2023-07-11T00:00:39.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.809+0000 7fa1f7658700 1 -- 172.21.15.38:0/708549485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1f00b8d90 msgr2=0x7fa1f0146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.809+0000 7fa1f7658700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1f00b8d90 0x7fa1f0146ee0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c580 tx=0x7fa1e000c940 comp rx=0 tx=0).stop 2023-07-11T00:00:39.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.810+0000 7fa1f7658700 1 -- 172.21.15.38:0/708549485 shutdown_connections 2023-07-11T00:00:39.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.810+0000 7fa1f7658700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa1d406ace0 0x7fa1d406d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.810+0000 7fa1f7658700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f01449d0 0x7fa1f00b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.810+0000 7fa1f7658700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1f00b8d90 0x7fa1f0146ee0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.810+0000 7fa1f7658700 1 --2- 172.21.15.38:0/708549485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1f00bc810 0x7fa1f01476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.810+0000 7fa1f7658700 1 -- 172.21.15.38:0/708549485 >> 172.21.15.38:0/708549485 conn(0x7fa1f00c0860 msgr2=0x7fa1f00bf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:39.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.810+0000 7fa1f7658700 1 -- 172.21.15.38:0/708549485 shutdown_connections 2023-07-11T00:00:39.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.810+0000 7fa1f7658700 1 -- 172.21.15.38:0/708549485 wait complete. 2023-07-11T00:00:39.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:00:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.950+0000 7f17de2b7700 1 Processor -- start 2023-07-11T00:00:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.950+0000 7f17de2b7700 1 -- start start 2023-07-11T00:00:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.950+0000 7f17de2b7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f17d8141780 0x7f17d80ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.950+0000 7f17de2b7700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17d8071a30 0x7f17d814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.950+0000 7f17de2b7700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f17d80b96b0 0x7f17d80b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.950+0000 7f17de2b7700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d8070e70 con 0x7f17d8141780 2023-07-11T00:00:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.950+0000 7f17de2b7700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d8071ea0 con 0x7f17d80b96b0 2023-07-11T00:00:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.950+0000 7f17de2b7700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d80b9b40 con 0x7f17d8071a30 2023-07-11T00:00:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f17d8141780 0x7f17d80ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f17d8141780 0x7f17d80ba010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41332/0 (socket says 172.21.15.38:41332) 2023-07-11T00:00:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d7fff700 1 -- 172.21.15.38:0/372326867 learned_addr learned my addr 172.21.15.38:0/372326867 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17dc854700 1 --2- 172.21.15.38:0/372326867 >> v2:172.21.15.70:3300/0 conn(0x7f17d80b96b0 0x7f17d80b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d77fe700 1 --2- 172.21.15.38:0/372326867 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17d8071a30 0x7f17d814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d7fff700 1 -- 172.21.15.38:0/372326867 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17d8071a30 msgr2=0x7f17d814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d7fff700 1 --2- 172.21.15.38:0/372326867 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17d8071a30 0x7f17d814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d7fff700 1 -- 172.21.15.38:0/372326867 >> v2:172.21.15.70:3300/0 conn(0x7f17d80b96b0 msgr2=0x7f17d80b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d7fff700 1 --2- 172.21.15.38:0/372326867 >> v2:172.21.15.70:3300/0 conn(0x7f17d80b96b0 0x7f17d80b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d7fff700 1 -- 172.21.15.38:0/372326867 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8070670 con 0x7f17d8141780 2023-07-11T00:00:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d7fff700 1 --2- 172.21.15.38:0/372326867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17d8141780 0x7f17d80ba010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f17d8066bf0 tx=0x7f17c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd15d84d560404a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d6ffd700 1 -- 172.21.15.38:0/372326867 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8011830 con 0x7f17d8141780 2023-07-11T00:00:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d6ffd700 1 -- 172.21.15.38:0/372326867 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c8011990 con 0x7f17d8141780 2023-07-11T00:00:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.951+0000 7f17d6ffd700 1 -- 172.21.15.38:0/372326867 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8011d20 con 0x7f17d8141780 2023-07-11T00:00:39.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.952+0000 7f17de2b7700 1 -- 172.21.15.38:0/372326867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17d8141780 msgr2=0x7f17d80ba010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.952+0000 7f17de2b7700 1 --2- 172.21.15.38:0/372326867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17d8141780 0x7f17d80ba010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f17d8066bf0 tx=0x7f17c8009bd0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.952+0000 7f17de2b7700 1 -- 172.21.15.38:0/372326867 shutdown_connections 2023-07-11T00:00:39.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.952+0000 7f17de2b7700 1 --2- 172.21.15.38:0/372326867 >> v2:172.21.15.70:3300/0 conn(0x7f17d80b96b0 0x7f17d80b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.952+0000 7f17de2b7700 1 --2- 172.21.15.38:0/372326867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17d8141780 0x7f17d80ba010 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.952+0000 7f17de2b7700 1 --2- 172.21.15.38:0/372326867 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17d8071a30 0x7f17d814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.952+0000 7f17de2b7700 1 -- 172.21.15.38:0/372326867 >> 172.21.15.38:0/372326867 conn(0x7f17d806d0e0 msgr2=0x7f17d806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:39.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.952+0000 7f17de2b7700 1 -- 172.21.15.38:0/372326867 shutdown_connections 2023-07-11T00:00:39.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.952+0000 7f17de2b7700 1 -- 172.21.15.38:0/372326867 wait complete. 2023-07-11T00:00:39.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.953+0000 7f17de2b7700 1 Processor -- start 2023-07-11T00:00:39.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.954+0000 7f17de2b7700 1 -- start start 2023-07-11T00:00:39.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.954+0000 7f17de2b7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17d8071a30 0x7f17d813d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.954+0000 7f17de2b7700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17d80b96b0 0x7f17d81e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.954+0000 7f17de2b7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d8141780 0x7f17d81e3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.954+0000 7f17de2b7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d813d5f0 con 0x7f17d8071a30 2023-07-11T00:00:39.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.954+0000 7f17de2b7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d8146620 con 0x7f17d8141780 2023-07-11T00:00:39.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.954+0000 7f17de2b7700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d8147780 con 0x7f17d80b96b0 2023-07-11T00:00:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d7fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17d8071a30 0x7f17d813d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d7fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17d8071a30 0x7f17d813d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41346/0 (socket says 172.21.15.38:41346) 2023-07-11T00:00:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d7fff700 1 -- 172.21.15.38:0/3748108581 learned_addr learned my addr 172.21.15.38:0/3748108581 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d77fe700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17d80b96b0 0x7f17d81e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17dc854700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d8141780 0x7f17d81e3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d7fff700 1 -- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17d80b96b0 msgr2=0x7f17d81e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d7fff700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17d80b96b0 0x7f17d81e3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d7fff700 1 -- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d8141780 msgr2=0x7f17d81e3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:39.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d7fff700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d8141780 0x7f17d81e3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:39.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d7fff700 1 -- 172.21.15.38:0/3748108581 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c8009550 con 0x7f17d8071a30 2023-07-11T00:00:39.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d7fff700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17d8071a30 0x7f17d813d0b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009c10 tx=0x7f17c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:39.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d4ff9700 1 -- 172.21.15.38:0/3748108581 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8004450 con 0x7f17d8071a30 2023-07-11T00:00:39.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17de2b7700 1 -- 172.21.15.38:0/3748108581 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d8147f70 con 0x7f17d8071a30 2023-07-11T00:00:39.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d4ff9700 1 -- 172.21.15.38:0/3748108581 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c801e070 con 0x7f17d8071a30 2023-07-11T00:00:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17d4ff9700 1 -- 172.21.15.38:0/3748108581 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c80038e0 con 0x7f17d8071a30 2023-07-11T00:00:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.955+0000 7f17de2b7700 1 -- 172.21.15.38:0/3748108581 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d81479b0 con 0x7f17d8071a30 2023-07-11T00:00:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.956+0000 7f17de2b7700 1 -- 172.21.15.38:0/3748108581 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d81e3390 con 0x7f17d8071a30 2023-07-11T00:00:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.957+0000 7f17d4ff9700 1 -- 172.21.15.38:0/3748108581 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f17c8003a40 con 0x7f17d8071a30 2023-07-11T00:00:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.957+0000 7f17d4ff9700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f17c406ace0 0x7f17c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:39.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.957+0000 7f17d4ff9700 1 -- 172.21.15.38:0/3748108581 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17c808a6d0 con 0x7f17d8071a30 2023-07-11T00:00:39.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.957+0000 7f17d77fe700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f17c406ace0 0x7f17c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:39.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.958+0000 7f17d77fe700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f17c406ace0 0x7f17c406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f17d813d7a0 tx=0x7f17cc009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:39.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:39.961+0000 7f17d4ff9700 1 -- 172.21.15.38:0/3748108581 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f17c8055770 con 0x7f17d8071a30 2023-07-11T00:00:40.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.162+0000 7f17de2b7700 1 -- 172.21.15.38:0/3748108581 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17d8074360 con 0x7f17d8071a30 2023-07-11T00:00:40.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.162+0000 7f17d4ff9700 1 -- 172.21.15.38:0/3748108581 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17c8020020 con 0x7f17d8071a30 2023-07-11T00:00:40.165 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-07-11T00:00:40.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.164+0000 7f17de2b7700 1 -- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f17c406ace0 msgr2=0x7f17c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.164+0000 7f17de2b7700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f17c406ace0 0x7f17c406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f17d813d7a0 tx=0x7f17cc009210 comp rx=0 tx=0).stop 2023-07-11T00:00:40.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.164+0000 7f17de2b7700 1 -- 172.21.15.38:0/3748108581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17d8071a30 msgr2=0x7f17d813d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.164+0000 7f17de2b7700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17d8071a30 0x7f17d813d0b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009c10 tx=0x7f17c8004750 comp rx=0 tx=0).stop 2023-07-11T00:00:40.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.164+0000 7f17de2b7700 1 -- 172.21.15.38:0/3748108581 shutdown_connections 2023-07-11T00:00:40.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.164+0000 7f17de2b7700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f17c406ace0 0x7f17c406d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.164+0000 7f17de2b7700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d8141780 0x7f17d81e3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.164+0000 7f17de2b7700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17d8071a30 0x7f17d813d0b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.164+0000 7f17de2b7700 1 --2- 172.21.15.38:0/3748108581 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17d80b96b0 0x7f17d81e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.164+0000 7f17de2b7700 1 -- 172.21.15.38:0/3748108581 >> 172.21.15.38:0/3748108581 conn(0x7f17d806d0e0 msgr2=0x7f17d813e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:40.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.164+0000 7f17de2b7700 1 -- 172.21.15.38:0/3748108581 shutdown_connections 2023-07-11T00:00:40.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.165+0000 7f17de2b7700 1 -- 172.21.15.38:0/3748108581 wait complete. 2023-07-11T00:00:40.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:40.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.301+0000 7f323c8c0700 1 Processor -- start 2023-07-11T00:00:40.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.301+0000 7f323c8c0700 1 -- start start 2023-07-11T00:00:40.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.302+0000 7f323c8c0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3238071910 0x7f3238070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.302+0000 7f323c8c0700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f323806bce0 0x7f3238155260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.302+0000 7f323c8c0700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32380701a0 con 0x7f323814b510 2023-07-11T00:00:40.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.302+0000 7f323c8c0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323814b970 con 0x7f3238071910 2023-07-11T00:00:40.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.302+0000 7f323c8c0700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32380713d0 con 0x7f323806bce0 2023-07-11T00:00:40.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.302+0000 7f323659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3238071910 0x7f3238070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.302+0000 7f3235d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f323814b510 0x7f323806c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58832/0 (socket says 172.21.15.38:58832) 2023-07-11T00:00:40.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.302+0000 7f3235d9b700 1 -- 172.21.15.38:0/2994348011 learned_addr learned my addr 172.21.15.38:0/2994348011 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:40.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.302+0000 7f3236d9d700 1 --2- 172.21.15.38:0/2994348011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f323806bce0 0x7f3238155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323659c700 1 -- 172.21.15.38:0/2994348011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f323806bce0 msgr2=0x7f3238155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:40.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323659c700 1 --2- 172.21.15.38:0/2994348011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f323806bce0 0x7f3238155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323659c700 1 -- 172.21.15.38:0/2994348011 >> v1:172.21.15.38:6789/0 conn(0x7f323814b510 legacy=0x7f323806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323659c700 1 -- 172.21.15.38:0/2994348011 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323814aa30 con 0x7f3238071910 2023-07-11T00:00:40.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323559a700 1 -- 172.21.15.38:0/2994348011 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069075720 0 0) 0x7f32380701a0 con 0x7f323814b510 2023-07-11T00:00:40.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323659c700 1 --2- 172.21.15.38:0/2994348011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3238071910 0x7f3238070d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f322c009840 tx=0x7f322c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f682a99d1e942d60 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:40.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323559a700 1 -- 172.21.15.38:0/2994348011 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c011830 con 0x7f3238071910 2023-07-11T00:00:40.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323559a700 1 -- 172.21.15.38:0/2994348011 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c011990 con 0x7f3238071910 2023-07-11T00:00:40.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323559a700 1 -- 172.21.15.38:0/2994348011 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c011d20 con 0x7f3238071910 2023-07-11T00:00:40.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323c8c0700 1 -- 172.21.15.38:0/2994348011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3238071910 msgr2=0x7f3238070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323c8c0700 1 --2- 172.21.15.38:0/2994348011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3238071910 0x7f3238070d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f322c009840 tx=0x7f322c009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:40.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323c8c0700 1 -- 172.21.15.38:0/2994348011 shutdown_connections 2023-07-11T00:00:40.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323c8c0700 1 --2- 172.21.15.38:0/2994348011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f323806bce0 0x7f3238155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323c8c0700 1 --2- 172.21.15.38:0/2994348011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3238071910 0x7f3238070d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.303+0000 7f323c8c0700 1 -- 172.21.15.38:0/2994348011 >> 172.21.15.38:0/2994348011 conn(0x7f32380be670 msgr2=0x7f32380bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.304+0000 7f323c8c0700 1 -- 172.21.15.38:0/2994348011 shutdown_connections 2023-07-11T00:00:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.304+0000 7f323c8c0700 1 -- 172.21.15.38:0/2994348011 wait complete. 2023-07-11T00:00:40.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.305+0000 7f323c8c0700 1 Processor -- start 2023-07-11T00:00:40.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.305+0000 7f323c8c0700 1 -- start start 2023-07-11T00:00:40.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.305+0000 7f323c8c0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f323806bce0 0x7f32380b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.305+0000 7f323c8c0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3238071910 0x7f32380b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f323c8c0700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f323814b510 0x7f32380b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f323c8c0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32380b6d00 con 0x7f3238071910 2023-07-11T00:00:40.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f323c8c0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32380b5b20 con 0x7f323806bce0 2023-07-11T00:00:40.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f323c8c0700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32380b6990 con 0x7f323814b510 2023-07-11T00:00:40.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3235d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3238071910 0x7f32380b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3235d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3238071910 0x7f32380b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41150/0 (socket says 172.21.15.38:41150) 2023-07-11T00:00:40.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3235d9b700 1 -- 172.21.15.38:0/79966690 learned_addr learned my addr 172.21.15.38:0/79966690 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:40.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3236d9d700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f323814b510 0x7f32380b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f323659c700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f323806bce0 0x7f32380b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3235d9b700 1 -- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f323814b510 msgr2=0x7f32380b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3235d9b700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f323814b510 0x7f32380b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3235d9b700 1 -- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f323806bce0 msgr2=0x7f32380b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3235d9b700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f323806bce0 0x7f32380b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3235d9b700 1 -- 172.21.15.38:0/79966690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c0094a0 con 0x7f3238071910 2023-07-11T00:00:40.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f323659c700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f323806bce0 0x7f32380b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:40.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3235d9b700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3238071910 0x7f32380b7190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f322800c550 tx=0x7f322800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:40.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3226ffd700 1 -- 172.21.15.38:0/79966690 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228004c80 con 0x7f3238071910 2023-07-11T00:00:40.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3226ffd700 1 -- 172.21.15.38:0/79966690 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228004e00 con 0x7f3238071910 2023-07-11T00:00:40.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f323c8c0700 1 -- 172.21.15.38:0/79966690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3238145140 con 0x7f3238071910 2023-07-11T00:00:40.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f3226ffd700 1 -- 172.21.15.38:0/79966690 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228007310 con 0x7f3238071910 2023-07-11T00:00:40.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.306+0000 7f323c8c0700 1 -- 172.21.15.38:0/79966690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32380b76d0 con 0x7f3238071910 2023-07-11T00:00:40.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.307+0000 7f323c8c0700 1 -- 172.21.15.38:0/79966690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32380b6b50 con 0x7f3238071910 2023-07-11T00:00:40.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.308+0000 7f3226ffd700 1 -- 172.21.15.38:0/79966690 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3228007470 con 0x7f3238071910 2023-07-11T00:00:40.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.308+0000 7f3226ffd700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f321806ace0 0x7f321806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.308+0000 7f3226ffd700 1 -- 172.21.15.38:0/79966690 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3228089150 con 0x7f3238071910 2023-07-11T00:00:40.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.308+0000 7f323659c700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f321806ace0 0x7f321806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.309+0000 7f323659c700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f321806ace0 0x7f321806d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f322c000c00 tx=0x7f322c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:40.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.313+0000 7f3226ffd700 1 -- 172.21.15.38:0/79966690 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3228054290 con 0x7f3238071910 2023-07-11T00:00:40.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.510+0000 7f323c8c0700 1 -- 172.21.15.38:0/79966690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32380672b0 con 0x7f3238071910 2023-07-11T00:00:40.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.511+0000 7f3226ffd700 1 -- 172.21.15.38:0/79966690 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f32280578b0 con 0x7f3238071910 2023-07-11T00:00:40.515 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:40.515 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:40.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 -- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f321806ace0 msgr2=0x7f321806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f321806ace0 0x7f321806d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f322c000c00 tx=0x7f322c008030 comp rx=0 tx=0).stop 2023-07-11T00:00:40.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 -- 172.21.15.38:0/79966690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3238071910 msgr2=0x7f32380b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3238071910 0x7f32380b7190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f322800c550 tx=0x7f322800c910 comp rx=0 tx=0).stop 2023-07-11T00:00:40.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 -- 172.21.15.38:0/79966690 shutdown_connections 2023-07-11T00:00:40.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f321806ace0 0x7f321806d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f323814b510 0x7f32380b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f323806bce0 0x7f32380b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 --2- 172.21.15.38:0/79966690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3238071910 0x7f32380b7190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 -- 172.21.15.38:0/79966690 >> 172.21.15.38:0/79966690 conn(0x7f32380be670 msgr2=0x7f32380706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:40.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 -- 172.21.15.38:0/79966690 shutdown_connections 2023-07-11T00:00:40.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.514+0000 7f323c8c0700 1 -- 172.21.15.38:0/79966690 wait complete. 2023-07-11T00:00:40.529 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:00:14.572121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:00:15.763698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:00:40.529 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:00:40.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.656+0000 7f8afd95e700 1 Processor -- start 2023-07-11T00:00:40.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.656+0000 7f8afd95e700 1 -- start start 2023-07-11T00:00:40.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.657+0000 7f8afd95e700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8af8071840 0x7f8af8156000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.657+0000 7f8afd95e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af806a640 con 0x7f8af80721e0 2023-07-11T00:00:40.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.657+0000 7f8afd95e700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af806f680 con 0x7f8af8147dc0 2023-07-11T00:00:40.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.657+0000 7f8afd95e700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af8070950 con 0x7f8af8071840 2023-07-11T00:00:40.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.657+0000 7f8aeffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8af80721e0 0x7f8af8071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58838/0 (socket says 172.21.15.38:58838) 2023-07-11T00:00:40.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.657+0000 7f8aeffff700 1 -- 172.21.15.38:0/3342478814 learned_addr learned my addr 172.21.15.38:0/3342478814 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:40.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.657+0000 7f8af77fe700 1 --2- 172.21.15.38:0/3342478814 >> v2:172.21.15.70:3300/0 conn(0x7f8af8071840 0x7f8af8156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.657+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832890076 0 0) 0x7f8af806a640 con 0x7f8af80721e0 2023-07-11T00:00:40.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.657+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae40035b0 con 0x7f8af80721e0 2023-07-11T00:00:40.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 8951743 0 0) 0x7f8ae40035b0 con 0x7f8af80721e0 2023-07-11T00:00:40.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 >> v2:172.21.15.70:3300/0 conn(0x7f8af8071840 msgr2=0x7f8af8156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:40.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 --2- 172.21.15.38:0/3342478814 >> v2:172.21.15.70:3300/0 conn(0x7f8af8071840 0x7f8af8156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 >> v1:172.21.15.70:6789/0 conn(0x7f8af8147dc0 legacy=0x7f8af8069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af806f920 con 0x7f8af80721e0 2023-07-11T00:00:40.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f8ae0001670 con 0x7f8af80721e0 2023-07-11T00:00:40.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 >> v1:172.21.15.38:6789/0 conn(0x7f8af80721e0 legacy=0x7f8af8071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ae4003a00 0x7f8ae4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae4004850 0x7f8ae4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ae4005320 0x7f8ae400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af8070950 con 0x7f8ae4004850 2023-07-11T00:00:40.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae400c250 con 0x7f8ae4005320 2023-07-11T00:00:40.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae400c410 con 0x7f8ae4003a00 2023-07-11T00:00:40.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8aeffff700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae4004850 0x7f8ae4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af77fe700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ae4005320 0x7f8ae400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af6ffd700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ae4003a00 0x7f8ae4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8aeffff700 1 -- 172.21.15.38:0/3342478814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ae4003a00 msgr2=0x7f8ae4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:40.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8aeffff700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ae4003a00 0x7f8ae4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8aeffff700 1 -- 172.21.15.38:0/3342478814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ae4005320 msgr2=0x7f8ae400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:40.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8aeffff700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ae4005320 0x7f8ae400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8aeffff700 1 -- 172.21.15.38:0/3342478814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40035b0 con 0x7f8ae4004850 2023-07-11T00:00:40.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af77fe700 1 -- 172.21.15.38:0/3342478814 reap_dead start 2023-07-11T00:00:40.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af6ffd700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ae4003a00 0x7f8ae4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:40.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8aeffff700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae4004850 0x7f8ae4004cc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000c240 tx=0x7f8ae4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa9c453468d5305 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:40.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0007c10 con 0x7f8ae4004850 2023-07-11T00:00:40.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae000cd80 con 0x7f8ae4004850 2023-07-11T00:00:40.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.658+0000 7f8af67fc700 1 -- 172.21.15.38:0/3342478814 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0005ba0 con 0x7f8ae4004850 2023-07-11T00:00:40.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.659+0000 7f8afd95e700 1 -- 172.21.15.38:0/3342478814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae4004850 msgr2=0x7f8ae4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.659+0000 7f8afd95e700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae4004850 0x7f8ae4004cc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000c240 tx=0x7f8ae4005880 comp rx=0 tx=0).stop 2023-07-11T00:00:40.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.659+0000 7f8afd95e700 1 -- 172.21.15.38:0/3342478814 shutdown_connections 2023-07-11T00:00:40.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.659+0000 7f8afd95e700 1 --2- 172.21.15.38:0/3342478814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae4004850 0x7f8ae4004cc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.659+0000 7f8afd95e700 1 -- 172.21.15.38:0/3342478814 >> 172.21.15.38:0/3342478814 conn(0x7f8af806d0e0 msgr2=0x7f8af806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:40.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.659+0000 7f8afd95e700 1 -- 172.21.15.38:0/3342478814 shutdown_connections 2023-07-11T00:00:40.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.659+0000 7f8afd95e700 1 -- 172.21.15.38:0/3342478814 wait complete. 2023-07-11T00:00:40.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.660+0000 7f8afd95e700 1 Processor -- start 2023-07-11T00:00:40.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.660+0000 7f8afd95e700 1 -- start start 2023-07-11T00:00:40.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8afd95e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ae4004850 0x7f8af814e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8afd95e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8af814b870 0x7f8af81df6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8afd95e700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8af814cb10 0x7f8af81dfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8afd95e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af814e7e0 con 0x7f8af814b870 2023-07-11T00:00:40.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8afd95e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af814d5b0 con 0x7f8ae4004850 2023-07-11T00:00:40.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8afd95e700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af814db70 con 0x7f8af814cb10 2023-07-11T00:00:40.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8aeffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8af814b870 0x7f8af81df6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8aeffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8af814b870 0x7f8af81df6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41164/0 (socket says 172.21.15.38:41164) 2023-07-11T00:00:40.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8aeffff700 1 -- 172.21.15.38:0/2443192067 learned_addr learned my addr 172.21.15.38:0/2443192067 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:40.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8af6ffd700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ae4004850 0x7f8af814e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8af77fe700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8af814cb10 0x7f8af81dfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8aeffff700 1 -- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8af814cb10 msgr2=0x7f8af81dfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8aeffff700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8af814cb10 0x7f8af81dfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8aeffff700 1 -- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ae4004850 msgr2=0x7f8af814e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8aeffff700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ae4004850 0x7f8af814e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8aeffff700 1 -- 172.21.15.38:0/2443192067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af814c730 con 0x7f8af814b870 2023-07-11T00:00:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8aeffff700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8af814b870 0x7f8af81df6e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0001150 tx=0x7f8ae0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8af4ff9700 1 -- 172.21.15.38:0/2443192067 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0001630 con 0x7f8af814b870 2023-07-11T00:00:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8af4ff9700 1 -- 172.21.15.38:0/2443192067 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae00070d0 con 0x7f8af814b870 2023-07-11T00:00:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.661+0000 7f8afd95e700 1 -- 172.21.15.38:0/2443192067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af814d800 con 0x7f8af814b870 2023-07-11T00:00:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.662+0000 7f8af4ff9700 1 -- 172.21.15.38:0/2443192067 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0007460 con 0x7f8af814b870 2023-07-11T00:00:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.662+0000 7f8afd95e700 1 -- 172.21.15.38:0/2443192067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af80b5340 con 0x7f8af814b870 2023-07-11T00:00:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.662+0000 7f8afd95e700 1 -- 172.21.15.38:0/2443192067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af814dd00 con 0x7f8af814b870 2023-07-11T00:00:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.663+0000 7f8af4ff9700 1 -- 172.21.15.38:0/2443192067 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ae00075c0 con 0x7f8af814b870 2023-07-11T00:00:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.663+0000 7f8af4ff9700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8ad806ace0 0x7f8ad806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.663+0000 7f8af4ff9700 1 -- 172.21.15.38:0/2443192067 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ae008a450 con 0x7f8af814b870 2023-07-11T00:00:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.664+0000 7f8af6ffd700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8ad806ace0 0x7f8ad806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.664+0000 7f8af6ffd700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8ad806ace0 0x7f8ad806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8af8063b00 tx=0x7f8ae8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:40.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.668+0000 7f8af4ff9700 1 -- 172.21.15.38:0/2443192067 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8ae0055590 con 0x7f8af814b870 2023-07-11T00:00:40.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.861+0000 7f8afd95e700 1 -- 172.21.15.38:0/2443192067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8af8074360 con 0x7f8af814b870 2023-07-11T00:00:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.862+0000 7f8af4ff9700 1 -- 172.21.15.38:0/2443192067 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8ae0058bb0 con 0x7f8af814b870 2023-07-11T00:00:40.865 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:00:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 -- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8ad806ace0 msgr2=0x7f8ad806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8ad806ace0 0x7f8ad806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8af8063b00 tx=0x7f8ae8009040 comp rx=0 tx=0).stop 2023-07-11T00:00:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 -- 172.21.15.38:0/2443192067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8af814b870 msgr2=0x7f8af81df6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8af814b870 0x7f8af81df6e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0001150 tx=0x7f8ae0001a00 comp rx=0 tx=0).stop 2023-07-11T00:00:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 -- 172.21.15.38:0/2443192067 shutdown_connections 2023-07-11T00:00:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8ad806ace0 0x7f8ad806d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8af814cb10 0x7f8af81dfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ae4004850 0x7f8af814e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 --2- 172.21.15.38:0/2443192067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8af814b870 0x7f8af81df6e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 -- 172.21.15.38:0/2443192067 >> 172.21.15.38:0/2443192067 conn(0x7f8af806d0e0 msgr2=0x7f8af80bb500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 -- 172.21.15.38:0/2443192067 shutdown_connections 2023-07-11T00:00:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:40.864+0000 7f8afd95e700 1 -- 172.21.15.38:0/2443192067 wait complete. 2023-07-11T00:00:40.878 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:00:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.005+0000 7f5a7ed53700 1 Processor -- start 2023-07-11T00:00:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.005+0000 7f5a7ed53700 1 -- start start 2023-07-11T00:00:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a7ed53700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5a781449d0 0x7f5a7814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a7ed53700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a780b8620 con 0x7f5a780b8d90 2023-07-11T00:00:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a7ed53700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a780b8900 con 0x7f5a780bc810 2023-07-11T00:00:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a7ed53700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a780b97a0 con 0x7f5a781449d0 2023-07-11T00:00:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a7caef700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5a781449d0 0x7f5a7814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a7d2f0700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5a780b8d90 0x7f5a7806ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58842/0 (socket says 172.21.15.38:58842) 2023-07-11T00:00:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a7d2f0700 1 -- 172.21.15.38:0/2641090186 learned_addr learned my addr 172.21.15.38:0/2641090186 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a7caef700 1 -- 172.21.15.38:0/2641090186 >> v1:172.21.15.70:6789/0 conn(0x7f5a780bc810 legacy=0x7f5a780ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a7caef700 1 -- 172.21.15.38:0/2641090186 >> v1:172.21.15.38:6789/0 conn(0x7f5a780b8d90 legacy=0x7f5a7806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a7caef700 1 -- 172.21.15.38:0/2641090186 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a780bac40 con 0x7f5a781449d0 2023-07-11T00:00:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a777fe700 1 -- 172.21.15.38:0/2641090186 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289460165 0 0) 0x7f5a780b8620 con 0x7f5a780b8d90 2023-07-11T00:00:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a7caef700 1 --2- 172.21.15.38:0/2641090186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a781449d0 0x7f5a7814db50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009840 tx=0x7f5a6c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217335bf9fd3064 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a777fe700 1 -- 172.21.15.38:0/2641090186 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c011830 con 0x7f5a781449d0 2023-07-11T00:00:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.006+0000 7f5a777fe700 1 -- 172.21.15.38:0/2641090186 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c011990 con 0x7f5a781449d0 2023-07-11T00:00:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.007+0000 7f5a777fe700 1 -- 172.21.15.38:0/2641090186 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c011d20 con 0x7f5a781449d0 2023-07-11T00:00:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.007+0000 7f5a7ed53700 1 -- 172.21.15.38:0/2641090186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a781449d0 msgr2=0x7f5a7814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.007+0000 7f5a7ed53700 1 --2- 172.21.15.38:0/2641090186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a781449d0 0x7f5a7814db50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009840 tx=0x7f5a6c009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.007+0000 7f5a7ed53700 1 -- 172.21.15.38:0/2641090186 shutdown_connections 2023-07-11T00:00:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.007+0000 7f5a7ed53700 1 --2- 172.21.15.38:0/2641090186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a781449d0 0x7f5a7814db50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.007+0000 7f5a7ed53700 1 -- 172.21.15.38:0/2641090186 >> 172.21.15.38:0/2641090186 conn(0x7f5a780c0860 msgr2=0x7f5a780c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.007+0000 7f5a7ed53700 1 -- 172.21.15.38:0/2641090186 shutdown_connections 2023-07-11T00:00:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.007+0000 7f5a7ed53700 1 -- 172.21.15.38:0/2641090186 wait complete. 2023-07-11T00:00:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.008+0000 7f5a7ed53700 1 Processor -- start 2023-07-11T00:00:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.008+0000 7f5a7ed53700 1 -- start start 2023-07-11T00:00:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.009+0000 7f5a7ed53700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a780b8d90 0x7f5a78147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.009+0000 7f5a7ed53700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a780bc810 0x7f5a7814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.009+0000 7f5a7ed53700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a781449d0 0x7f5a78144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.009+0000 7f5a7ed53700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780b35b0 con 0x7f5a780b8d90 2023-07-11T00:00:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.009+0000 7f5a7ed53700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a78146d10 con 0x7f5a780bc810 2023-07-11T00:00:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.009+0000 7f5a7ed53700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a78147b60 con 0x7f5a781449d0 2023-07-11T00:00:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.009+0000 7f5a7caef700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a780b8d90 0x7f5a78147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.009+0000 7f5a7caef700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a780b8d90 0x7f5a78147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41170/0 (socket says 172.21.15.38:41170) 2023-07-11T00:00:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.009+0000 7f5a7caef700 1 -- 172.21.15.38:0/1769397238 learned_addr learned my addr 172.21.15.38:0/1769397238 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.009+0000 7f5a77fff700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a780bc810 0x7f5a7814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.009+0000 7f5a7d2f0700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a781449d0 0x7f5a78144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.010+0000 7f5a7caef700 1 -- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a781449d0 msgr2=0x7f5a78144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.010+0000 7f5a7caef700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a781449d0 0x7f5a78144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.010+0000 7f5a7caef700 1 -- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a780bc810 msgr2=0x7f5a7814d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.010+0000 7f5a7caef700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a780bc810 0x7f5a7814d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.010+0000 7f5a7caef700 1 -- 172.21.15.38:0/1769397238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0094a0 con 0x7f5a780b8d90 2023-07-11T00:00:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.010+0000 7f5a7caef700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a780b8d90 0x7f5a78147620 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0090b0 tx=0x7f5a6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.010+0000 7f5a757fa700 1 -- 172.21.15.38:0/1769397238 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c01a8c0 con 0x7f5a780b8d90 2023-07-11T00:00:41.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.010+0000 7f5a757fa700 1 -- 172.21.15.38:0/1769397238 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c01aa20 con 0x7f5a780b8d90 2023-07-11T00:00:41.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.010+0000 7f5a7ed53700 1 -- 172.21.15.38:0/1769397238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a781466c0 con 0x7f5a780b8d90 2023-07-11T00:00:41.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.010+0000 7f5a757fa700 1 -- 172.21.15.38:0/1769397238 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c01ad90 con 0x7f5a780b8d90 2023-07-11T00:00:41.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.010+0000 7f5a7ed53700 1 -- 172.21.15.38:0/1769397238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a78147de0 con 0x7f5a780b8d90 2023-07-11T00:00:41.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.011+0000 7f5a7ed53700 1 -- 172.21.15.38:0/1769397238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a78146e80 con 0x7f5a780b8d90 2023-07-11T00:00:41.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.011+0000 7f5a757fa700 1 -- 172.21.15.38:0/1769397238 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a6c022070 con 0x7f5a780b8d90 2023-07-11T00:00:41.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.012+0000 7f5a757fa700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a5c06ace0 0x7f5a5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.012+0000 7f5a757fa700 1 -- 172.21.15.38:0/1769397238 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a6c08a5f0 con 0x7f5a780b8d90 2023-07-11T00:00:41.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.012+0000 7f5a77fff700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a5c06ace0 0x7f5a5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.012+0000 7f5a77fff700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a5c06ace0 0x7f5a5c06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5a780b6980 tx=0x7f5a64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:41.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.016+0000 7f5a757fa700 1 -- 172.21.15.38:0/1769397238 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5a6c055900 con 0x7f5a780b8d90 2023-07-11T00:00:41.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.211+0000 7f5a7ed53700 1 -- 172.21.15.38:0/1769397238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a78074360 con 0x7f5a780b8d90 2023-07-11T00:00:41.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.212+0000 7f5a757fa700 1 -- 172.21.15.38:0/1769397238 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a6c058f20 con 0x7f5a780b8d90 2023-07-11T00:00:41.215 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:00:41.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 -- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a5c06ace0 msgr2=0x7f5a5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a5c06ace0 0x7f5a5c06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5a780b6980 tx=0x7f5a64009040 comp rx=0 tx=0).stop 2023-07-11T00:00:41.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 -- 172.21.15.38:0/1769397238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a780b8d90 msgr2=0x7f5a78147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a780b8d90 0x7f5a78147620 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0090b0 tx=0x7f5a6c004750 comp rx=0 tx=0).stop 2023-07-11T00:00:41.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 -- 172.21.15.38:0/1769397238 shutdown_connections 2023-07-11T00:00:41.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5a5c06ace0 0x7f5a5c06d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a781449d0 0x7f5a78144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a780b8d90 0x7f5a78147620 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 --2- 172.21.15.38:0/1769397238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a780bc810 0x7f5a7814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 -- 172.21.15.38:0/1769397238 >> 172.21.15.38:0/1769397238 conn(0x7f5a780c0860 msgr2=0x7f5a780be970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:41.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 -- 172.21.15.38:0/1769397238 shutdown_connections 2023-07-11T00:00:41.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.214+0000 7f5a7ed53700 1 -- 172.21.15.38:0/1769397238 wait complete. 2023-07-11T00:00:41.228 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:00:41.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.355+0000 7fc494fa2700 1 Processor -- start 2023-07-11T00:00:41.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.355+0000 7fc494fa2700 1 -- start start 2023-07-11T00:00:41.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc494fa2700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900b9c20 0x7fc49014b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc494fa2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc4900bab70 0x7fc49014bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc494fa2700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4900b7100 con 0x7fc49013eca0 2023-07-11T00:00:41.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc494fa2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4900b9950 con 0x7fc4900bab70 2023-07-11T00:00:41.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc494fa2700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900b9290 con 0x7fc4900b9c20 2023-07-11T00:00:41.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc48ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc4900bab70 0x7fc49014bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc48ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc4900bab70 0x7fc49014bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41184/0 (socket says 172.21.15.38:41184) 2023-07-11T00:00:41.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc48ffff700 1 -- 172.21.15.38:0/4210604214 learned_addr learned my addr 172.21.15.38:0/4210604214 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:41.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc487fff700 1 --2- 172.21.15.38:0/4210604214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900b9c20 0x7fc49014b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc48ffff700 1 -- 172.21.15.38:0/4210604214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900b9c20 msgr2=0x7fc49014b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:41.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc48ffff700 1 --2- 172.21.15.38:0/4210604214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900b9c20 0x7fc49014b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc48ffff700 1 -- 172.21.15.38:0/4210604214 >> v1:172.21.15.70:6789/0 conn(0x7fc49013eca0 legacy=0x7fc4900b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:41.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc48ffff700 1 -- 172.21.15.38:0/4210604214 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4900b80d0 con 0x7fc4900bab70 2023-07-11T00:00:41.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc487fff700 1 --2- 172.21.15.38:0/4210604214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900b9c20 0x7fc49014b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:41.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc48ffff700 1 --2- 172.21.15.38:0/4210604214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4900bab70 0x7fc49014bd60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc488009e50 tx=0x7fc48800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a160f52bc37ed3cc server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:41.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc48effd700 1 -- 172.21.15.38:0/4210604214 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800e070 con 0x7fc4900bab70 2023-07-11T00:00:41.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc48effd700 1 -- 172.21.15.38:0/4210604214 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc488003a20 con 0x7fc4900bab70 2023-07-11T00:00:41.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.356+0000 7fc48effd700 1 -- 172.21.15.38:0/4210604214 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488003dd0 con 0x7fc4900bab70 2023-07-11T00:00:41.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.357+0000 7fc494fa2700 1 -- 172.21.15.38:0/4210604214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4900bab70 msgr2=0x7fc49014bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.357+0000 7fc494fa2700 1 --2- 172.21.15.38:0/4210604214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4900bab70 0x7fc49014bd60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc488009e50 tx=0x7fc48800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:41.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.357+0000 7fc494fa2700 1 -- 172.21.15.38:0/4210604214 shutdown_connections 2023-07-11T00:00:41.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.357+0000 7fc494fa2700 1 --2- 172.21.15.38:0/4210604214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4900bab70 0x7fc49014bd60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.357+0000 7fc494fa2700 1 --2- 172.21.15.38:0/4210604214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900b9c20 0x7fc49014b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.357+0000 7fc494fa2700 1 -- 172.21.15.38:0/4210604214 >> 172.21.15.38:0/4210604214 conn(0x7fc49006b040 msgr2=0x7fc49006b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:41.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.357+0000 7fc494fa2700 1 -- 172.21.15.38:0/4210604214 shutdown_connections 2023-07-11T00:00:41.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.357+0000 7fc494fa2700 1 -- 172.21.15.38:0/4210604214 wait complete. 2023-07-11T00:00:41.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.358+0000 7fc494fa2700 1 Processor -- start 2023-07-11T00:00:41.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.358+0000 7fc494fa2700 1 -- start start 2023-07-11T00:00:41.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc494fa2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4900b9c20 0x7fc490136fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc494fa2700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900bab70 0x7fc4901375d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc494fa2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49013eca0 0x7fc490140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc494fa2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4901414b0 con 0x7fc49013eca0 2023-07-11T00:00:41.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc494fa2700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4901361c0 con 0x7fc4900b9c20 2023-07-11T00:00:41.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc494fa2700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc490139440 con 0x7fc4900bab70 2023-07-11T00:00:41.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49013eca0 0x7fc490140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49013eca0 0x7fc490140f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41190/0 (socket says 172.21.15.38:41190) 2023-07-11T00:00:41.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48ffff700 1 -- 172.21.15.38:0/1431684995 learned_addr learned my addr 172.21.15.38:0/1431684995 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:41.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc487fff700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900bab70 0x7fc4901375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48f7fe700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4900b9c20 0x7fc490136fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48ffff700 1 -- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900bab70 msgr2=0x7fc4901375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48ffff700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900bab70 0x7fc4901375d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48ffff700 1 -- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4900b9c20 msgr2=0x7fc490136fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48ffff700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4900b9c20 0x7fc490136fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48ffff700 1 -- 172.21.15.38:0/1431684995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc488009b30 con 0x7fc49013eca0 2023-07-11T00:00:41.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc487fff700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900bab70 0x7fc4901375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:41.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48f7fe700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4900b9c20 0x7fc490136fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:41.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48ffff700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49013eca0 0x7fc490140f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc488004000 tx=0x7fc488004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:41.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48cff9700 1 -- 172.21.15.38:0/1431684995 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488004440 con 0x7fc49013eca0 2023-07-11T00:00:41.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48cff9700 1 -- 172.21.15.38:0/1431684995 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4880045a0 con 0x7fc49013eca0 2023-07-11T00:00:41.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc494fa2700 1 -- 172.21.15.38:0/1431684995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc490136500 con 0x7fc49013eca0 2023-07-11T00:00:41.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc48cff9700 1 -- 172.21.15.38:0/1431684995 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488004950 con 0x7fc49013eca0 2023-07-11T00:00:41.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.359+0000 7fc494fa2700 1 -- 172.21.15.38:0/1431684995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc490136ac0 con 0x7fc49013eca0 2023-07-11T00:00:41.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.360+0000 7fc494fa2700 1 -- 172.21.15.38:0/1431684995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49004ea60 con 0x7fc49013eca0 2023-07-11T00:00:41.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.361+0000 7fc48cff9700 1 -- 172.21.15.38:0/1431684995 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc488012430 con 0x7fc49013eca0 2023-07-11T00:00:41.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.361+0000 7fc48cff9700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc47006ace0 0x7fc47006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.361+0000 7fc48cff9700 1 -- 172.21.15.38:0/1431684995 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc48808a9d0 con 0x7fc49013eca0 2023-07-11T00:00:41.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.361+0000 7fc48f7fe700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc47006ace0 0x7fc47006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.362+0000 7fc48f7fe700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc47006ace0 0x7fc47006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc490142120 tx=0x7fc480009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:41.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.366+0000 7fc48cff9700 1 -- 172.21.15.38:0/1431684995 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc488055a90 con 0x7fc49013eca0 2023-07-11T00:00:41.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.565+0000 7fc494fa2700 1 -- 172.21.15.38:0/1431684995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4900ba490 con 0x7fc49013eca0 2023-07-11T00:00:41.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.566+0000 7fc48cff9700 1 -- 172.21.15.38:0/1431684995 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc4880590b0 con 0x7fc49013eca0 2023-07-11T00:00:41.569 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-07-11T00:00:41.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 -- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc47006ace0 msgr2=0x7fc47006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc47006ace0 0x7fc47006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc490142120 tx=0x7fc480009040 comp rx=0 tx=0).stop 2023-07-11T00:00:41.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 -- 172.21.15.38:0/1431684995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49013eca0 msgr2=0x7fc490140f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49013eca0 0x7fc490140f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc488004000 tx=0x7fc488004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 -- 172.21.15.38:0/1431684995 shutdown_connections 2023-07-11T00:00:41.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc47006ace0 0x7fc47006d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49013eca0 0x7fc490140f70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4900b9c20 0x7fc490136fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 --2- 172.21.15.38:0/1431684995 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4900bab70 0x7fc4901375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 -- 172.21.15.38:0/1431684995 >> 172.21.15.38:0/1431684995 conn(0x7fc49006b040 msgr2=0x7fc49013c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 -- 172.21.15.38:0/1431684995 shutdown_connections 2023-07-11T00:00:41.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.568+0000 7fc494fa2700 1 -- 172.21.15.38:0/1431684995 wait complete. 2023-07-11T00:00:41.583 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:00:41.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.709+0000 7f66112d8700 1 Processor -- start 2023-07-11T00:00:41.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.709+0000 7f66112d8700 1 -- start start 2023-07-11T00:00:41.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.710+0000 7f66112d8700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f660c0bc810 0x7f660c0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.710+0000 7f66112d8700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0b8d90 0x7f660c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.710+0000 7f66112d8700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660c0b8620 con 0x7f660c1449d0 2023-07-11T00:00:41.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.710+0000 7f66112d8700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c0b97a0 con 0x7f660c0bc810 2023-07-11T00:00:41.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.710+0000 7f66112d8700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c144da0 con 0x7f660c0b8d90 2023-07-11T00:00:41.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.710+0000 7f660b7fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0b8d90 0x7f660c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.710+0000 7f660a7fc700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f660c0bc810 0x7f660c0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.710+0000 7f660affd700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f660c1449d0 0x7f660c14db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:56062/0 (socket says 172.21.15.38:56062) 2023-07-11T00:00:41.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.710+0000 7f660b7fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0b8d90 0x7f660c06ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:39356/0 (socket says 172.21.15.38:39356) 2023-07-11T00:00:41.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.710+0000 7f660affd700 1 -- 172.21.15.38:0/3203623743 learned_addr learned my addr 172.21.15.38:0/3203623743 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:41.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.710+0000 7f660a7fc700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f660c0bc810 0x7f660c0ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:35928/0 (socket says 172.21.15.38:35928) 2023-07-11T00:00:41.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.711+0000 7f660a7fc700 1 -- 172.21.15.38:0/3203623743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0b8d90 msgr2=0x7f660c06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:41.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.711+0000 7f660a7fc700 1 --2- 172.21.15.38:0/3203623743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0b8d90 0x7f660c06ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.711+0000 7f660a7fc700 1 -- 172.21.15.38:0/3203623743 >> v1:172.21.15.70:6789/0 conn(0x7f660c1449d0 legacy=0x7f660c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.711+0000 7f660a7fc700 1 -- 172.21.15.38:0/3203623743 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c0b8900 con 0x7f660c0bc810 2023-07-11T00:00:41.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.711+0000 7f6609ffb700 1 -- 172.21.15.38:0/3203623743 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366253769 0 0) 0x7f660c0b8620 con 0x7f660c1449d0 2023-07-11T00:00:41.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.711+0000 7f660b7fe700 1 --2- 172.21.15.38:0/3203623743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0b8d90 0x7f660c06ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:41.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.711+0000 7f660a7fc700 1 --2- 172.21.15.38:0/3203623743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c0bc810 0x7f660c0ba530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009840 tx=0x7f65f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baa77690a6174591 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:41.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.711+0000 7f6609ffb700 1 -- 172.21.15.38:0/3203623743 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4011830 con 0x7f660c0bc810 2023-07-11T00:00:41.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.711+0000 7f6609ffb700 1 -- 172.21.15.38:0/3203623743 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f4011990 con 0x7f660c0bc810 2023-07-11T00:00:41.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.711+0000 7f6609ffb700 1 -- 172.21.15.38:0/3203623743 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4011d20 con 0x7f660c0bc810 2023-07-11T00:00:41.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.712+0000 7f66112d8700 1 -- 172.21.15.38:0/3203623743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c0bc810 msgr2=0x7f660c0ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.712+0000 7f66112d8700 1 --2- 172.21.15.38:0/3203623743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c0bc810 0x7f660c0ba530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009840 tx=0x7f65f4009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.712+0000 7f66112d8700 1 -- 172.21.15.38:0/3203623743 shutdown_connections 2023-07-11T00:00:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.712+0000 7f66112d8700 1 --2- 172.21.15.38:0/3203623743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0b8d90 0x7f660c06ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.712+0000 7f66112d8700 1 --2- 172.21.15.38:0/3203623743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c0bc810 0x7f660c0ba530 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.712+0000 7f66112d8700 1 -- 172.21.15.38:0/3203623743 >> 172.21.15.38:0/3203623743 conn(0x7f660c0c0860 msgr2=0x7f660c0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.712+0000 7f66112d8700 1 -- 172.21.15.38:0/3203623743 shutdown_connections 2023-07-11T00:00:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.712+0000 7f66112d8700 1 -- 172.21.15.38:0/3203623743 wait complete. 2023-07-11T00:00:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.713+0000 7f66112d8700 1 Processor -- start 2023-07-11T00:00:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.713+0000 7f66112d8700 1 -- start start 2023-07-11T00:00:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f66112d8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c0b8d90 0x7f660c14d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f66112d8700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0bc810 0x7f660c1483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f66112d8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f660c1449d0 0x7f660c14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f66112d8700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c14d800 con 0x7f660c1449d0 2023-07-11T00:00:41.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f66112d8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0b3520 con 0x7f660c0b8d90 2023-07-11T00:00:41.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f66112d8700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c149e70 con 0x7f660c0bc810 2023-07-11T00:00:41.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f660c1449d0 0x7f660c14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f660c1449d0 0x7f660c14aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41194/0 (socket says 172.21.15.38:41194) 2023-07-11T00:00:41.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660b7fe700 1 -- 172.21.15.38:0/498078919 learned_addr learned my addr 172.21.15.38:0/498078919 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:41.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660affd700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c0b8d90 0x7f660c14d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660a7fc700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0bc810 0x7f660c1483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660b7fe700 1 -- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0bc810 msgr2=0x7f660c1483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660b7fe700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0bc810 0x7f660c1483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660b7fe700 1 -- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c0b8d90 msgr2=0x7f660c14d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660b7fe700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c0b8d90 0x7f660c14d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660b7fe700 1 -- 172.21.15.38:0/498078919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6604009a70 con 0x7f660c1449d0 2023-07-11T00:00:41.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660a7fc700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0bc810 0x7f660c1483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:41.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660affd700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c0b8d90 0x7f660c14d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:41.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f660b7fe700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f660c1449d0 0x7f660c14aa80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f660400efc0 tx=0x7f660400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:41.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f66037fe700 1 -- 172.21.15.38:0/498078919 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604009d70 con 0x7f660c1449d0 2023-07-11T00:00:41.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f66037fe700 1 -- 172.21.15.38:0/498078919 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660400f040 con 0x7f660c1449d0 2023-07-11T00:00:41.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.714+0000 7f66112d8700 1 -- 172.21.15.38:0/498078919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f40094a0 con 0x7f660c1449d0 2023-07-11T00:00:41.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.715+0000 7f66037fe700 1 -- 172.21.15.38:0/498078919 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400ce00 con 0x7f660c1449d0 2023-07-11T00:00:41.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.715+0000 7f66112d8700 1 -- 172.21.15.38:0/498078919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c149b00 con 0x7f660c1449d0 2023-07-11T00:00:41.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.715+0000 7f66112d8700 1 -- 172.21.15.38:0/498078919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c074360 con 0x7f660c1449d0 2023-07-11T00:00:41.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.716+0000 7f66037fe700 1 -- 172.21.15.38:0/498078919 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6604014480 con 0x7f660c1449d0 2023-07-11T00:00:41.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.716+0000 7f66037fe700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f65ec06ace0 0x7f65ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:41.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.717+0000 7f66037fe700 1 -- 172.21.15.38:0/498078919 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6604089d20 con 0x7f660c1449d0 2023-07-11T00:00:41.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.717+0000 7f660affd700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f65ec06ace0 0x7f65ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:41.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.717+0000 7f660affd700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f65ec06ace0 0x7f65ec06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f65fc000f60 tx=0x7f65fc007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:41.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.721+0000 7f66037fe700 1 -- 172.21.15.38:0/498078919 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6604054d40 con 0x7f660c1449d0 2023-07-11T00:00:41.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.918+0000 7f66112d8700 1 -- 172.21.15.38:0/498078919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f660c149fb0 con 0x7f660c1449d0 2023-07-11T00:00:41.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.918+0000 7f66037fe700 1 -- 172.21.15.38:0/498078919 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6604058360 con 0x7f660c1449d0 2023-07-11T00:00:41.921 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-07-11T00:00:41.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.920+0000 7f66112d8700 1 -- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f65ec06ace0 msgr2=0x7f65ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.920+0000 7f66112d8700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f65ec06ace0 0x7f65ec06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f65fc000f60 tx=0x7f65fc007d30 comp rx=0 tx=0).stop 2023-07-11T00:00:41.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.920+0000 7f66112d8700 1 -- 172.21.15.38:0/498078919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f660c1449d0 msgr2=0x7f660c14aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:41.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.920+0000 7f66112d8700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f660c1449d0 0x7f660c14aa80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f660400efc0 tx=0x7f660400c3a0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.920+0000 7f66112d8700 1 -- 172.21.15.38:0/498078919 shutdown_connections 2023-07-11T00:00:41.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.920+0000 7f66112d8700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f65ec06ace0 0x7f65ec06d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.920+0000 7f66112d8700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f660c1449d0 0x7f660c14aa80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.920+0000 7f66112d8700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c0b8d90 0x7f660c14d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.920+0000 7f66112d8700 1 --2- 172.21.15.38:0/498078919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f660c0bc810 0x7f660c1483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:41.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.921+0000 7f66112d8700 1 -- 172.21.15.38:0/498078919 >> 172.21.15.38:0/498078919 conn(0x7f660c0c0860 msgr2=0x7f660c0baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:41.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.921+0000 7f66112d8700 1 -- 172.21.15.38:0/498078919 shutdown_connections 2023-07-11T00:00:41.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:41.921+0000 7f66112d8700 1 -- 172.21.15.38:0/498078919 wait complete. 2023-07-11T00:00:41.936 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:42.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.059+0000 7f574f5de700 1 Processor -- start 2023-07-11T00:00:42.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.059+0000 7f574f5de700 1 -- start start 2023-07-11T00:00:42.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f574f5de700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f57480b8d90 0x7f574806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f574f5de700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57480b8620 con 0x7f57481449d0 2023-07-11T00:00:42.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f574f5de700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57480b8900 con 0x7f57480bc810 2023-07-11T00:00:42.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f574f5de700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57480b97a0 con 0x7f57480b8d90 2023-07-11T00:00:42.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f574db7b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f57480b8d90 0x7f574806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f574d37a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f57481449d0 0x7f574814db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58844/0 (socket says 172.21.15.38:58844) 2023-07-11T00:00:42.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f574d37a700 1 -- 172.21.15.38:0/3033422261 learned_addr learned my addr 172.21.15.38:0/3033422261 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:42.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f573ffff700 1 -- 172.21.15.38:0/3033422261 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973628931 0 0) 0x7f57480b8620 con 0x7f57481449d0 2023-07-11T00:00:42.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f573ffff700 1 -- 172.21.15.38:0/3033422261 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57340035b0 con 0x7f57481449d0 2023-07-11T00:00:42.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f574db7b700 1 -- 172.21.15.38:0/3033422261 >> v1:172.21.15.70:6789/0 conn(0x7f57480bc810 legacy=0x7f57480ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f574db7b700 1 -- 172.21.15.38:0/3033422261 >> v1:172.21.15.38:6789/0 conn(0x7f57481449d0 legacy=0x7f574814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f574db7b700 1 -- 172.21.15.38:0/3033422261 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57480bac40 con 0x7f57480b8d90 2023-07-11T00:00:42.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f574db7b700 1 --2- 172.21.15.38:0/3033422261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57480b8d90 0x7f574806ade0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5740009d90 tx=0x7f574000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9da7c0fa6a72a85 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:42.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f573ffff700 1 -- 172.21.15.38:0/3033422261 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574000e070 con 0x7f57480b8d90 2023-07-11T00:00:42.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f573ffff700 1 -- 172.21.15.38:0/3033422261 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574000bb20 con 0x7f57480b8d90 2023-07-11T00:00:42.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.060+0000 7f573ffff700 1 -- 172.21.15.38:0/3033422261 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5740012430 con 0x7f57480b8d90 2023-07-11T00:00:42.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.061+0000 7f574f5de700 1 -- 172.21.15.38:0/3033422261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57480b8d90 msgr2=0x7f574806ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.061+0000 7f574f5de700 1 --2- 172.21.15.38:0/3033422261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57480b8d90 0x7f574806ade0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5740009d90 tx=0x7f574000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:42.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.061+0000 7f574f5de700 1 -- 172.21.15.38:0/3033422261 shutdown_connections 2023-07-11T00:00:42.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.061+0000 7f574f5de700 1 --2- 172.21.15.38:0/3033422261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57480b8d90 0x7f574806ade0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.061+0000 7f574f5de700 1 -- 172.21.15.38:0/3033422261 >> 172.21.15.38:0/3033422261 conn(0x7f57480c0860 msgr2=0x7f57480c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:42.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.061+0000 7f574f5de700 1 -- 172.21.15.38:0/3033422261 shutdown_connections 2023-07-11T00:00:42.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.061+0000 7f574f5de700 1 -- 172.21.15.38:0/3033422261 wait complete. 2023-07-11T00:00:42.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.062+0000 7f574f5de700 1 Processor -- start 2023-07-11T00:00:42.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.062+0000 7f574f5de700 1 -- start start 2023-07-11T00:00:42.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574f5de700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57480b8d90 0x7f57480b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574f5de700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57480bc810 0x7f57480b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574f5de700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57481449d0 0x7f5748147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574f5de700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57480b30c0 con 0x7f57480b8d90 2023-07-11T00:00:42.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574f5de700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57481da400 con 0x7f57480bc810 2023-07-11T00:00:42.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574f5de700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57480b1ee0 con 0x7f57481449d0 2023-07-11T00:00:42.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574d37a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57480b8d90 0x7f57480b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574d37a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57480b8d90 0x7f57480b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41198/0 (socket says 172.21.15.38:41198) 2023-07-11T00:00:42.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574d37a700 1 -- 172.21.15.38:0/1737802414 learned_addr learned my addr 172.21.15.38:0/1737802414 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:42.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574db7b700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57481449d0 0x7f5748147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574cb79700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57480bc810 0x7f57480b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574d37a700 1 -- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57481449d0 msgr2=0x7f5748147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574d37a700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57481449d0 0x7f5748147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574d37a700 1 -- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57480bc810 msgr2=0x7f57480b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574d37a700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57480bc810 0x7f57480b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574d37a700 1 -- 172.21.15.38:0/1737802414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740009a70 con 0x7f57480b8d90 2023-07-11T00:00:42.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.063+0000 7f574d37a700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57480b8d90 0x7f57480b2b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f574400c730 tx=0x7f574400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:42.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.064+0000 7f573dffb700 1 -- 172.21.15.38:0/1737802414 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5744005d70 con 0x7f57480b8d90 2023-07-11T00:00:42.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.064+0000 7f573dffb700 1 -- 172.21.15.38:0/1737802414 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57440070d0 con 0x7f57480b8d90 2023-07-11T00:00:42.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.064+0000 7f574f5de700 1 -- 172.21.15.38:0/1737802414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57480b3f90 con 0x7f57480b8d90 2023-07-11T00:00:42.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.064+0000 7f573dffb700 1 -- 172.21.15.38:0/1737802414 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5744007440 con 0x7f57480b8d90 2023-07-11T00:00:42.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.064+0000 7f574f5de700 1 -- 172.21.15.38:0/1737802414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574814b3c0 con 0x7f57480b8d90 2023-07-11T00:00:42.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.065+0000 7f574f5de700 1 -- 172.21.15.38:0/1737802414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574806b2d0 con 0x7f57480b8d90 2023-07-11T00:00:42.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.065+0000 7f573dffb700 1 -- 172.21.15.38:0/1737802414 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f57440075a0 con 0x7f57480b8d90 2023-07-11T00:00:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.065+0000 7f573dffb700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f572c06ace0 0x7f572c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.065+0000 7f573dffb700 1 -- 172.21.15.38:0/1737802414 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5744088780 con 0x7f57480b8d90 2023-07-11T00:00:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.066+0000 7f574cb79700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f572c06ace0 0x7f572c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.066+0000 7f574cb79700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f572c06ace0 0x7f572c06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57480b6bc0 tx=0x7f5738009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.070+0000 7f573dffb700 1 -- 172.21.15.38:0/1737802414 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f57440538e0 con 0x7f57480b8d90 2023-07-11T00:00:42.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.269+0000 7f574f5de700 1 -- 172.21.15.38:0/1737802414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f574806a2a0 con 0x7f57480b8d90 2023-07-11T00:00:42.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.270+0000 7f573dffb700 1 -- 172.21.15.38:0/1737802414 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f5744056f00 con 0x7f57480b8d90 2023-07-11T00:00:42.273 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:42.274 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:42.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 -- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f572c06ace0 msgr2=0x7f572c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f572c06ace0 0x7f572c06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57480b6bc0 tx=0x7f5738009040 comp rx=0 tx=0).stop 2023-07-11T00:00:42.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 -- 172.21.15.38:0/1737802414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57480b8d90 msgr2=0x7f57480b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57480b8d90 0x7f57480b2b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f574400c730 tx=0x7f574400ca40 comp rx=0 tx=0).stop 2023-07-11T00:00:42.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 -- 172.21.15.38:0/1737802414 shutdown_connections 2023-07-11T00:00:42.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f572c06ace0 0x7f572c06d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57481449d0 0x7f5748147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57480b8d90 0x7f57480b2b80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 --2- 172.21.15.38:0/1737802414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57480bc810 0x7f57480b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 -- 172.21.15.38:0/1737802414 >> 172.21.15.38:0/1737802414 conn(0x7f57480c0860 msgr2=0x7f5748143710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:42.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 -- 172.21.15.38:0/1737802414 shutdown_connections 2023-07-11T00:00:42.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.272+0000 7f574f5de700 1 -- 172.21.15.38:0/1737802414 wait complete. 2023-07-11T00:00:42.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:00:14.572121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:00:15.763698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:00:42.288 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:00:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.414+0000 7f54b2994700 1 Processor -- start 2023-07-11T00:00:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.414+0000 7f54b2994700 1 -- start start 2023-07-11T00:00:42.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54b2994700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f54ac0bc810 0x7f54ac0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54b2994700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54ac0b8d90 0x7f54ac06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54b2994700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ac0b8620 con 0x7f54ac1449d0 2023-07-11T00:00:42.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54b2994700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac0b97a0 con 0x7f54ac0bc810 2023-07-11T00:00:42.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54b2994700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac144da0 con 0x7f54ac0b8d90 2023-07-11T00:00:42.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54abfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f54ac1449d0 0x7f54ac14db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58852/0 (socket says 172.21.15.38:58852) 2023-07-11T00:00:42.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54abfff700 1 -- 172.21.15.38:0/3326281949 learned_addr learned my addr 172.21.15.38:0/3326281949 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:42.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54b0f31700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54ac0b8d90 0x7f54ac06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245096233 0 0) 0x7f54ac0b8620 con 0x7f54ac1449d0 2023-07-11T00:00:42.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54ab7fe700 1 --2- 172.21.15.38:0/3326281949 >> v2:172.21.15.70:3300/0 conn(0x7f54ac0bc810 0x7f54ac0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54980035b0 con 0x7f54ac1449d0 2023-07-11T00:00:42.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3856452508 0 0) 0x7f54980035b0 con 0x7f54ac1449d0 2023-07-11T00:00:42.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54ac0b8d90 msgr2=0x7f54ac06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:42.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54aaffd700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54ac0b8d90 0x7f54ac06ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 >> v2:172.21.15.70:3300/0 conn(0x7f54ac0bc810 msgr2=0x7f54ac0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:42.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54aaffd700 1 --2- 172.21.15.38:0/3326281949 >> v2:172.21.15.70:3300/0 conn(0x7f54ac0bc810 0x7f54ac0ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0b8900 con 0x7f54ac1449d0 2023-07-11T00:00:42.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f549c001670 con 0x7f54ac1449d0 2023-07-11T00:00:42.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.415+0000 7f54ab7fe700 1 --2- 172.21.15.38:0/3326281949 >> v2:172.21.15.70:3300/0 conn(0x7f54ac0bc810 0x7f54ac0ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:42.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 >> v1:172.21.15.38:6789/0 conn(0x7f54ac1449d0 legacy=0x7f54ac14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54aaffd700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5498003a00 0x7f5498003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54aaffd700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54ac0b8d90 0x7f5498004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54aaffd700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5498004d90 0x7f5498005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0b97a0 con 0x7f5498004d90 2023-07-11T00:00:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549800ba10 con 0x7f5498003a00 2023-07-11T00:00:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549800bb50 con 0x7f54ac0b8d90 2023-07-11T00:00:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54abfff700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5498003a00 0x7f5498003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54b0f31700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5498004d90 0x7f5498005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54ab7fe700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54ac0b8d90 0x7f5498004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54abfff700 1 -- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54ac0b8d90 msgr2=0x7f5498004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54abfff700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54ac0b8d90 0x7f5498004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54abfff700 1 -- 172.21.15.38:0/3326281949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5498004d90 msgr2=0x7f5498005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:42.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54abfff700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5498004d90 0x7f5498005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54abfff700 1 -- 172.21.15.38:0/3326281949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54980035b0 con 0x7f5498003a00 2023-07-11T00:00:42.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54b0f31700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5498004d90 0x7f5498005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:42.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54abfff700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5498003a00 0x7f5498003e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c3a0 tx=0x7f5498005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6c46d9f98e3bb64 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:42.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c007c60 con 0x7f5498003a00 2023-07-11T00:00:42.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c005960 con 0x7f5498003a00 2023-07-11T00:00:42.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.416+0000 7f54aaffd700 1 -- 172.21.15.38:0/3326281949 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00cea0 con 0x7f5498003a00 2023-07-11T00:00:42.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.417+0000 7f54b2994700 1 -- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5498003a00 msgr2=0x7f5498003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.417+0000 7f54b2994700 1 --2- 172.21.15.38:0/3326281949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5498003a00 0x7f5498003e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c3a0 tx=0x7f5498005880 comp rx=0 tx=0).stop 2023-07-11T00:00:42.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.417+0000 7f54b0f31700 1 -- 172.21.15.38:0/3326281949 reap_dead start 2023-07-11T00:00:42.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.417+0000 7f54b2994700 1 -- 172.21.15.38:0/3326281949 shutdown_connections 2023-07-11T00:00:42.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.417+0000 7f54b2994700 1 -- 172.21.15.38:0/3326281949 >> 172.21.15.38:0/3326281949 conn(0x7f54ac0c0860 msgr2=0x7f54ac0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:42.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.417+0000 7f54b2994700 1 -- 172.21.15.38:0/3326281949 shutdown_connections 2023-07-11T00:00:42.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.417+0000 7f54b2994700 1 -- 172.21.15.38:0/3326281949 wait complete. 2023-07-11T00:00:42.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.418+0000 7f54b2994700 1 Processor -- start 2023-07-11T00:00:42.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.418+0000 7f54b2994700 1 -- start start 2023-07-11T00:00:42.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b2994700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5498003a00 0x7f54ac14d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b2994700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54ac147be0 0x7f54ac0b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b2994700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54ac0b2290 0x7f54ac0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b2994700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0b4480 con 0x7f54ac0b2290 2023-07-11T00:00:42.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b2994700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac14d800 con 0x7f54ac147be0 2023-07-11T00:00:42.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b2994700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0b3fb0 con 0x7f5498003a00 2023-07-11T00:00:42.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b0f31700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54ac0b2290 0x7f54ac0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b0f31700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54ac0b2290 0x7f54ac0b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41218/0 (socket says 172.21.15.38:41218) 2023-07-11T00:00:42.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b0f31700 1 -- 172.21.15.38:0/1114226433 learned_addr learned my addr 172.21.15.38:0/1114226433 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:42.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54abfff700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5498003a00 0x7f54ac14d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54ab7fe700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54ac147be0 0x7f54ac0b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b0f31700 1 -- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5498003a00 msgr2=0x7f54ac14d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b0f31700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5498003a00 0x7f54ac14d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b0f31700 1 -- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54ac147be0 msgr2=0x7f54ac0b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b0f31700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54ac147be0 0x7f54ac0b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54b0f31700 1 -- 172.21.15.38:0/1114226433 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac14ae90 con 0x7f54ac0b2290 2023-07-11T00:00:42.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.419+0000 7f54abfff700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5498003a00 0x7f54ac14d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:42.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.420+0000 7f54b0f31700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54ac0b2290 0x7f54ac0b30a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f54ac1481b0 tx=0x7f54a400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:42.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.420+0000 7f54a8ff9700 1 -- 172.21.15.38:0/1114226433 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400e040 con 0x7f54ac0b2290 2023-07-11T00:00:42.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.420+0000 7f54a8ff9700 1 -- 172.21.15.38:0/1114226433 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400f040 con 0x7f54ac0b2290 2023-07-11T00:00:42.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.420+0000 7f54a8ff9700 1 -- 172.21.15.38:0/1114226433 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4003a20 con 0x7f54ac0b2290 2023-07-11T00:00:42.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.420+0000 7f54b2994700 1 -- 172.21.15.38:0/1114226433 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ac0b41e0 con 0x7f54ac0b2290 2023-07-11T00:00:42.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.420+0000 7f54b2994700 1 -- 172.21.15.38:0/1114226433 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ac14b320 con 0x7f54ac0b2290 2023-07-11T00:00:42.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.421+0000 7f54b2994700 1 -- 172.21.15.38:0/1114226433 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ac14b020 con 0x7f54ac0b2290 2023-07-11T00:00:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.421+0000 7f54a8ff9700 1 -- 172.21.15.38:0/1114226433 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54a4015430 con 0x7f54ac0b2290 2023-07-11T00:00:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.421+0000 7f54a8ff9700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f548c06ace0 0x7f548c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.422+0000 7f54a8ff9700 1 -- 172.21.15.38:0/1114226433 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54a4089a40 con 0x7f54ac0b2290 2023-07-11T00:00:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.422+0000 7f54abfff700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f548c06ace0 0x7f548c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.422+0000 7f54abfff700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f548c06ace0 0x7f548c06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f549c008fd0 tx=0x7f549c00a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.426+0000 7f54a8ff9700 1 -- 172.21.15.38:0/1114226433 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f54a408be60 con 0x7f54ac0b2290 2023-07-11T00:00:42.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.621+0000 7f54b2994700 1 -- 172.21.15.38:0/1114226433 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54ac074360 con 0x7f54ac0b2290 2023-07-11T00:00:42.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.621+0000 7f54a8ff9700 1 -- 172.21.15.38:0/1114226433 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54a4058610 con 0x7f54ac0b2290 2023-07-11T00:00:42.625 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:00:42.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.623+0000 7f54b2994700 1 -- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f548c06ace0 msgr2=0x7f548c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.623+0000 7f54b2994700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f548c06ace0 0x7f548c06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f549c008fd0 tx=0x7f549c00a000 comp rx=0 tx=0).stop 2023-07-11T00:00:42.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.623+0000 7f54b2994700 1 -- 172.21.15.38:0/1114226433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54ac0b2290 msgr2=0x7f54ac0b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.623+0000 7f54b2994700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54ac0b2290 0x7f54ac0b30a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f54ac1481b0 tx=0x7f54a400f490 comp rx=0 tx=0).stop 2023-07-11T00:00:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.623+0000 7f54b2994700 1 -- 172.21.15.38:0/1114226433 shutdown_connections 2023-07-11T00:00:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.623+0000 7f54b2994700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f548c06ace0 0x7f548c06d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.623+0000 7f54b2994700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54ac0b2290 0x7f54ac0b30a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.623+0000 7f54b2994700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5498003a00 0x7f54ac14d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.623+0000 7f54b2994700 1 --2- 172.21.15.38:0/1114226433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54ac147be0 0x7f54ac0b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.623+0000 7f54b2994700 1 -- 172.21.15.38:0/1114226433 >> 172.21.15.38:0/1114226433 conn(0x7f54ac0c0860 msgr2=0x7f54ac142b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:42.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.624+0000 7f54b2994700 1 -- 172.21.15.38:0/1114226433 shutdown_connections 2023-07-11T00:00:42.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.624+0000 7f54b2994700 1 -- 172.21.15.38:0/1114226433 wait complete. 2023-07-11T00:00:42.638 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:00:42.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.764+0000 7fe04a4e5700 1 Processor -- start 2023-07-11T00:00:42.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.764+0000 7fe04a4e5700 1 -- start start 2023-07-11T00:00:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe04a4e5700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe044071a30 0x7fe04414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe04a4e5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0440b96b0 0x7fe044151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe04a4e5700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe044070e70 con 0x7fe044141780 2023-07-11T00:00:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe04a4e5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0440ba720 con 0x7fe0440b96b0 2023-07-11T00:00:42.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe04a4e5700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe044071ea0 con 0x7fe044071a30 2023-07-11T00:00:42.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe048a82700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0440b96b0 0x7fe044151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe048a82700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0440b96b0 0x7fe044151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41232/0 (socket says 172.21.15.38:41232) 2023-07-11T00:00:42.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe048a82700 1 -- 172.21.15.38:0/59208674 learned_addr learned my addr 172.21.15.38:0/59208674 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:42.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe0437fe700 1 --2- 172.21.15.38:0/59208674 >> v2:172.21.15.70:3300/0 conn(0x7fe044071a30 0x7fe04414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe048a82700 1 -- 172.21.15.38:0/59208674 >> v2:172.21.15.70:3300/0 conn(0x7fe044071a30 msgr2=0x7fe04414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:42.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe048a82700 1 --2- 172.21.15.38:0/59208674 >> v2:172.21.15.70:3300/0 conn(0x7fe044071a30 0x7fe04414ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe048a82700 1 -- 172.21.15.38:0/59208674 >> v1:172.21.15.70:6789/0 conn(0x7fe044141780 legacy=0x7fe0440ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe048a82700 1 -- 172.21.15.38:0/59208674 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440b9b40 con 0x7fe0440b96b0 2023-07-11T00:00:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe0437fe700 1 --2- 172.21.15.38:0/59208674 >> v2:172.21.15.70:3300/0 conn(0x7fe044071a30 0x7fe04414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.765+0000 7fe048a82700 1 --2- 172.21.15.38:0/59208674 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0440b96b0 0x7fe044151eb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe04406f200 tx=0x7fe03c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadb8e351d3fecf3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.766+0000 7fe042ffd700 1 -- 172.21.15.38:0/59208674 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00e070 con 0x7fe0440b96b0 2023-07-11T00:00:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.766+0000 7fe042ffd700 1 -- 172.21.15.38:0/59208674 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c003a20 con 0x7fe0440b96b0 2023-07-11T00:00:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.766+0000 7fe042ffd700 1 -- 172.21.15.38:0/59208674 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c003dd0 con 0x7fe0440b96b0 2023-07-11T00:00:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.766+0000 7fe04a4e5700 1 -- 172.21.15.38:0/59208674 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0440b96b0 msgr2=0x7fe044151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.766+0000 7fe04a4e5700 1 --2- 172.21.15.38:0/59208674 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0440b96b0 0x7fe044151eb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe04406f200 tx=0x7fe03c00b330 comp rx=0 tx=0).stop 2023-07-11T00:00:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.766+0000 7fe04a4e5700 1 -- 172.21.15.38:0/59208674 shutdown_connections 2023-07-11T00:00:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.766+0000 7fe04a4e5700 1 --2- 172.21.15.38:0/59208674 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0440b96b0 0x7fe044151eb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.766+0000 7fe04a4e5700 1 --2- 172.21.15.38:0/59208674 >> v2:172.21.15.70:3300/0 conn(0x7fe044071a30 0x7fe04414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.766+0000 7fe04a4e5700 1 -- 172.21.15.38:0/59208674 >> 172.21.15.38:0/59208674 conn(0x7fe04406d0e0 msgr2=0x7fe04406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.766+0000 7fe04a4e5700 1 -- 172.21.15.38:0/59208674 shutdown_connections 2023-07-11T00:00:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.766+0000 7fe04a4e5700 1 -- 172.21.15.38:0/59208674 wait complete. 2023-07-11T00:00:42.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.767+0000 7fe04a4e5700 1 Processor -- start 2023-07-11T00:00:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe04a4e5700 1 -- start start 2023-07-11T00:00:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe04a4e5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe044071a30 0x7fe0441d4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe04a4e5700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0440b96b0 0x7fe0441492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe04a4e5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe044141780 0x7fe0441e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe04a4e5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0441d5500 con 0x7fe044071a30 2023-07-11T00:00:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe04a4e5700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440b5450 con 0x7fe044141780 2023-07-11T00:00:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe04a4e5700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe044148b80 con 0x7fe0440b96b0 2023-07-11T00:00:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe043fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe044071a30 0x7fe0441d4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe043fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe044071a30 0x7fe0441d4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41246/0 (socket says 172.21.15.38:41246) 2023-07-11T00:00:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe043fff700 1 -- 172.21.15.38:0/1322927616 learned_addr learned my addr 172.21.15.38:0/1322927616 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe048a82700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe044141780 0x7fe0441e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.768+0000 7fe0437fe700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0440b96b0 0x7fe0441492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe043fff700 1 -- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0440b96b0 msgr2=0x7fe0441492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe043fff700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0440b96b0 0x7fe0441492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe043fff700 1 -- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe044141780 msgr2=0x7fe0441e34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe043fff700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe044141780 0x7fe0441e34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe043fff700 1 -- 172.21.15.38:0/1322927616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c009b30 con 0x7fe044071a30 2023-07-11T00:00:42.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe0437fe700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0440b96b0 0x7fe0441492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:42.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe043fff700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe044071a30 0x7fe0441d4fc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00b4d0 tx=0x7fe02c00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:42.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe040ff9700 1 -- 172.21.15.38:0/1322927616 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c011830 con 0x7fe044071a30 2023-07-11T00:00:42.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe040ff9700 1 -- 172.21.15.38:0/1322927616 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c011990 con 0x7fe044071a30 2023-07-11T00:00:42.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe04a4e5700 1 -- 172.21.15.38:0/1322927616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe044148e60 con 0x7fe044071a30 2023-07-11T00:00:42.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe040ff9700 1 -- 172.21.15.38:0/1322927616 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c011d40 con 0x7fe044071a30 2023-07-11T00:00:42.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.769+0000 7fe04a4e5700 1 -- 172.21.15.38:0/1322927616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04414a770 con 0x7fe044071a30 2023-07-11T00:00:42.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.770+0000 7fe04a4e5700 1 -- 172.21.15.38:0/1322927616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe044074360 con 0x7fe044071a30 2023-07-11T00:00:42.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.771+0000 7fe040ff9700 1 -- 172.21.15.38:0/1322927616 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe02c004020 con 0x7fe044071a30 2023-07-11T00:00:42.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.771+0000 7fe040ff9700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe02406ace0 0x7fe02406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:42.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.772+0000 7fe040ff9700 1 -- 172.21.15.38:0/1322927616 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe02c0898e0 con 0x7fe044071a30 2023-07-11T00:00:42.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.772+0000 7fe0437fe700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe02406ace0 0x7fe02406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:42.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.772+0000 7fe0437fe700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe02406ace0 0x7fe02406d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe04413dc80 tx=0x7fe034008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:42.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.775+0000 7fe040ff9700 1 -- 172.21.15.38:0/1322927616 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe02c054a00 con 0x7fe044071a30 2023-07-11T00:00:42.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.969+0000 7fe04a4e5700 1 -- 172.21.15.38:0/1322927616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0440b8570 con 0x7fe044071a30 2023-07-11T00:00:42.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.970+0000 7fe040ff9700 1 -- 172.21.15.38:0/1322927616 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe02c015020 con 0x7fe044071a30 2023-07-11T00:00:42.974 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:00:42.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 -- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe02406ace0 msgr2=0x7fe02406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe02406ace0 0x7fe02406d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe04413dc80 tx=0x7fe034008040 comp rx=0 tx=0).stop 2023-07-11T00:00:42.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 -- 172.21.15.38:0/1322927616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe044071a30 msgr2=0x7fe0441d4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:42.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe044071a30 0x7fe0441d4fc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00b4d0 tx=0x7fe02c00b7e0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 -- 172.21.15.38:0/1322927616 shutdown_connections 2023-07-11T00:00:42.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe02406ace0 0x7fe02406d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe044141780 0x7fe0441e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe044071a30 0x7fe0441d4fc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 --2- 172.21.15.38:0/1322927616 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe0440b96b0 0x7fe0441492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:42.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 -- 172.21.15.38:0/1322927616 >> 172.21.15.38:0/1322927616 conn(0x7fe04406d0e0 msgr2=0x7fe04414ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:42.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 -- 172.21.15.38:0/1322927616 shutdown_connections 2023-07-11T00:00:42.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:42.972+0000 7fe04a4e5700 1 -- 172.21.15.38:0/1322927616 wait complete. 2023-07-11T00:00:42.987 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:00:43.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.113+0000 7f85e6392700 1 Processor -- start 2023-07-11T00:00:43.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.113+0000 7f85e6392700 1 -- start start 2023-07-11T00:00:43.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85e6392700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f85e01449d0 0x7f85e014db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85e6392700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85e00bc810 0x7f85e00ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85e6392700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e00b8620 con 0x7f85e00b8d90 2023-07-11T00:00:43.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85e6392700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e00b97a0 con 0x7f85e01449d0 2023-07-11T00:00:43.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85e6392700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0144da0 con 0x7f85e00bc810 2023-07-11T00:00:43.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85dffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f85e01449d0 0x7f85e014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85e492f700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f85e00b8d90 0x7f85e006ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58854/0 (socket says 172.21.15.38:58854) 2023-07-11T00:00:43.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85e492f700 1 -- 172.21.15.38:0/3354570438 learned_addr learned my addr 172.21.15.38:0/3354570438 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:43.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85df7fe700 1 --2- 172.21.15.38:0/3354570438 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85e00bc810 0x7f85e00ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85dffff700 1 -- 172.21.15.38:0/3354570438 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85e00bc810 msgr2=0x7f85e00ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:43.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85dffff700 1 --2- 172.21.15.38:0/3354570438 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85e00bc810 0x7f85e00ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85dffff700 1 -- 172.21.15.38:0/3354570438 >> v1:172.21.15.38:6789/0 conn(0x7f85e00b8d90 legacy=0x7f85e006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85dffff700 1 -- 172.21.15.38:0/3354570438 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e00b8900 con 0x7f85e01449d0 2023-07-11T00:00:43.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85deffd700 1 -- 172.21.15.38:0/3354570438 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098955695 0 0) 0x7f85e00b8620 con 0x7f85e00b8d90 2023-07-11T00:00:43.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85df7fe700 1 --2- 172.21.15.38:0/3354570438 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85e00bc810 0x7f85e00ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:43.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85dffff700 1 --2- 172.21.15.38:0/3354570438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85e01449d0 0x7f85e014db50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009840 tx=0x7f85c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b9f467e7d44f7f server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:43.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85deffd700 1 -- 172.21.15.38:0/3354570438 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8011830 con 0x7f85e01449d0 2023-07-11T00:00:43.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85deffd700 1 -- 172.21.15.38:0/3354570438 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c8011990 con 0x7f85e01449d0 2023-07-11T00:00:43.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.114+0000 7f85deffd700 1 -- 172.21.15.38:0/3354570438 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8011d20 con 0x7f85e01449d0 2023-07-11T00:00:43.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.115+0000 7f85e6392700 1 -- 172.21.15.38:0/3354570438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85e01449d0 msgr2=0x7f85e014db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.115+0000 7f85e6392700 1 --2- 172.21.15.38:0/3354570438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85e01449d0 0x7f85e014db50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009840 tx=0x7f85c8009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:43.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.115+0000 7f85e6392700 1 -- 172.21.15.38:0/3354570438 shutdown_connections 2023-07-11T00:00:43.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.115+0000 7f85e6392700 1 --2- 172.21.15.38:0/3354570438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85e01449d0 0x7f85e014db50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.115+0000 7f85e6392700 1 --2- 172.21.15.38:0/3354570438 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85e00bc810 0x7f85e00ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.115+0000 7f85e6392700 1 -- 172.21.15.38:0/3354570438 >> 172.21.15.38:0/3354570438 conn(0x7f85e00c0860 msgr2=0x7f85e00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:43.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.115+0000 7f85e6392700 1 -- 172.21.15.38:0/3354570438 shutdown_connections 2023-07-11T00:00:43.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.115+0000 7f85e6392700 1 -- 172.21.15.38:0/3354570438 wait complete. 2023-07-11T00:00:43.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.116+0000 7f85e6392700 1 Processor -- start 2023-07-11T00:00:43.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.116+0000 7f85e6392700 1 -- start start 2023-07-11T00:00:43.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e6392700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85e00b8d90 0x7f85e01df530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e6392700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85e00bc810 0x7f85e00a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e6392700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85e01449d0 0x7f85e00a3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e6392700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00a6430 con 0x7f85e01449d0 2023-07-11T00:00:43.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e6392700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00a3ba0 con 0x7f85e00bc810 2023-07-11T00:00:43.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e6392700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00a16f0 con 0x7f85e00b8d90 2023-07-11T00:00:43.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e492f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85e01449d0 0x7f85e00a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e492f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85e01449d0 0x7f85e00a3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41276/0 (socket says 172.21.15.38:41276) 2023-07-11T00:00:43.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e492f700 1 -- 172.21.15.38:0/2881249779 learned_addr learned my addr 172.21.15.38:0/2881249779 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:43.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85dffff700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85e00b8d90 0x7f85e01df530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85df7fe700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85e00bc810 0x7f85e00a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e492f700 1 -- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85e00b8d90 msgr2=0x7f85e01df530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e492f700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85e00b8d90 0x7f85e01df530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e492f700 1 -- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85e00bc810 msgr2=0x7f85e00a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e492f700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85e00bc810 0x7f85e00a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.117+0000 7f85e492f700 1 -- 172.21.15.38:0/2881249779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c80094a0 con 0x7f85e01449d0 2023-07-11T00:00:43.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.118+0000 7f85e492f700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85e01449d0 0x7f85e00a3370 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f85d8002230 tx=0x7f85d800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:43.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.118+0000 7f85dcff9700 1 -- 172.21.15.38:0/2881249779 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d800aac0 con 0x7f85e01449d0 2023-07-11T00:00:43.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.118+0000 7f85dcff9700 1 -- 172.21.15.38:0/2881249779 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d800ac40 con 0x7f85e01449d0 2023-07-11T00:00:43.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.118+0000 7f85e6392700 1 -- 172.21.15.38:0/2881249779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e00a24f0 con 0x7f85e01449d0 2023-07-11T00:00:43.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.118+0000 7f85dcff9700 1 -- 172.21.15.38:0/2881249779 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80070d0 con 0x7f85e01449d0 2023-07-11T00:00:43.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.118+0000 7f85e6392700 1 -- 172.21.15.38:0/2881249779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e00a38b0 con 0x7f85e01449d0 2023-07-11T00:00:43.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.119+0000 7f85e6392700 1 -- 172.21.15.38:0/2881249779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e00a18f0 con 0x7f85e01449d0 2023-07-11T00:00:43.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.119+0000 7f85dcff9700 1 -- 172.21.15.38:0/2881249779 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85d8007250 con 0x7f85e01449d0 2023-07-11T00:00:43.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.120+0000 7f85dcff9700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f85c006ace0 0x7f85c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.120+0000 7f85dcff9700 1 -- 172.21.15.38:0/2881249779 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85d8089180 con 0x7f85e01449d0 2023-07-11T00:00:43.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.120+0000 7f85dffff700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f85c006ace0 0x7f85c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.120+0000 7f85dffff700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f85c006ace0 0x7f85c006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f85c80090b0 tx=0x7f85c801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:43.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.124+0000 7f85dcff9700 1 -- 172.21.15.38:0/2881249779 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f85e00a18f0 con 0x7f85e01449d0 2023-07-11T00:00:43.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.319+0000 7f85e6392700 1 -- 172.21.15.38:0/2881249779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85e00a18c0 con 0x7f85e01449d0 2023-07-11T00:00:43.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.319+0000 7f85dcff9700 1 -- 172.21.15.38:0/2881249779 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85d80542c0 con 0x7f85e01449d0 2023-07-11T00:00:43.323 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-07-11T00:00:43.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.321+0000 7f85e6392700 1 -- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f85c006ace0 msgr2=0x7f85c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.321+0000 7f85e6392700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f85c006ace0 0x7f85c006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f85c80090b0 tx=0x7f85c801c040 comp rx=0 tx=0).stop 2023-07-11T00:00:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.321+0000 7f85e6392700 1 -- 172.21.15.38:0/2881249779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85e01449d0 msgr2=0x7f85e00a3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.321+0000 7f85e6392700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85e01449d0 0x7f85e00a3370 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f85d8002230 tx=0x7f85d800cf50 comp rx=0 tx=0).stop 2023-07-11T00:00:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.321+0000 7f85e6392700 1 -- 172.21.15.38:0/2881249779 shutdown_connections 2023-07-11T00:00:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.321+0000 7f85e6392700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f85c006ace0 0x7f85c006d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.321+0000 7f85e6392700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85e01449d0 0x7f85e00a3370 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.321+0000 7f85e6392700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85e00b8d90 0x7f85e01df530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.321+0000 7f85e6392700 1 --2- 172.21.15.38:0/2881249779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85e00bc810 0x7f85e00a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.321+0000 7f85e6392700 1 -- 172.21.15.38:0/2881249779 >> 172.21.15.38:0/2881249779 conn(0x7f85e00c0860 msgr2=0x7f85e0143bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.322+0000 7f85e6392700 1 -- 172.21.15.38:0/2881249779 shutdown_connections 2023-07-11T00:00:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.322+0000 7f85e6392700 1 -- 172.21.15.38:0/2881249779 wait complete. 2023-07-11T00:00:43.337 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:00:43.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.463+0000 7eff425dc700 1 Processor -- start 2023-07-11T00:00:43.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.463+0000 7eff425dc700 1 -- start start 2023-07-11T00:00:43.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.463+0000 7eff425dc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7eff3c147dc0 0x7eff3c0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.463+0000 7eff425dc700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7eff3c069f30 0x7eff3c071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.463+0000 7eff425dc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c06f680 con 0x7eff3c06a3b0 2023-07-11T00:00:43.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.463+0000 7eff425dc700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c070950 con 0x7eff3c147dc0 2023-07-11T00:00:43.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.463+0000 7eff425dc700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c06f920 con 0x7eff3c069f30 2023-07-11T00:00:43.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff3bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7eff3c147dc0 0x7eff3c0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff40b79700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7eff3c06a3b0 0x7eff3c14dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58870/0 (socket says 172.21.15.38:58870) 2023-07-11T00:00:43.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff40b79700 1 -- 172.21.15.38:0/1200474689 learned_addr learned my addr 172.21.15.38:0/1200474689 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:43.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff3b7fe700 1 --2- 172.21.15.38:0/1200474689 >> v2:172.21.15.70:3300/0 conn(0x7eff3c069f30 0x7eff3c071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff3bfff700 1 -- 172.21.15.38:0/1200474689 >> v2:172.21.15.70:3300/0 conn(0x7eff3c069f30 msgr2=0x7eff3c071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:43.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff3bfff700 1 --2- 172.21.15.38:0/1200474689 >> v2:172.21.15.70:3300/0 conn(0x7eff3c069f30 0x7eff3c071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff3bfff700 1 -- 172.21.15.38:0/1200474689 >> v1:172.21.15.38:6789/0 conn(0x7eff3c06a3b0 legacy=0x7eff3c14dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff3bfff700 1 -- 172.21.15.38:0/1200474689 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0b9660 con 0x7eff3c147dc0 2023-07-11T00:00:43.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff3bfff700 1 --2- 172.21.15.38:0/1200474689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff3c147dc0 0x7eff3c0721e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7eff3c06f090 tx=0x7eff2c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c69b58e2e82c29 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:43.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff3affd700 1 -- 172.21.15.38:0/1200474689 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c011830 con 0x7eff3c147dc0 2023-07-11T00:00:43.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff3affd700 1 -- 172.21.15.38:0/1200474689 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c011990 con 0x7eff3c147dc0 2023-07-11T00:00:43.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.464+0000 7eff3affd700 1 -- 172.21.15.38:0/1200474689 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c011d20 con 0x7eff3c147dc0 2023-07-11T00:00:43.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.465+0000 7eff425dc700 1 -- 172.21.15.38:0/1200474689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff3c147dc0 msgr2=0x7eff3c0721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.465+0000 7eff425dc700 1 --2- 172.21.15.38:0/1200474689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff3c147dc0 0x7eff3c0721e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7eff3c06f090 tx=0x7eff2c009b20 comp rx=0 tx=0).stop 2023-07-11T00:00:43.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.465+0000 7eff425dc700 1 -- 172.21.15.38:0/1200474689 shutdown_connections 2023-07-11T00:00:43.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.465+0000 7eff425dc700 1 --2- 172.21.15.38:0/1200474689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff3c147dc0 0x7eff3c0721e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.465+0000 7eff425dc700 1 --2- 172.21.15.38:0/1200474689 >> v2:172.21.15.70:3300/0 conn(0x7eff3c069f30 0x7eff3c071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.465+0000 7eff425dc700 1 -- 172.21.15.38:0/1200474689 >> 172.21.15.38:0/1200474689 conn(0x7eff3c06d0e0 msgr2=0x7eff3c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:43.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.465+0000 7eff425dc700 1 -- 172.21.15.38:0/1200474689 shutdown_connections 2023-07-11T00:00:43.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.465+0000 7eff425dc700 1 -- 172.21.15.38:0/1200474689 wait complete. 2023-07-11T00:00:43.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.466+0000 7eff425dc700 1 Processor -- start 2023-07-11T00:00:43.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.466+0000 7eff425dc700 1 -- start start 2023-07-11T00:00:43.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff425dc700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7eff3c069f30 0x7eff3c0b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff425dc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c06a3b0 0x7eff3c0b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff425dc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff3c147dc0 0x7eff3c1e2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff425dc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0b5d20 con 0x7eff3c147dc0 2023-07-11T00:00:43.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff425dc700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0b6e60 con 0x7eff3c06a3b0 2023-07-11T00:00:43.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff425dc700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0b7830 con 0x7eff3c069f30 2023-07-11T00:00:43.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff40b79700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff3c147dc0 0x7eff3c1e2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff40b79700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff3c147dc0 0x7eff3c1e2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41284/0 (socket says 172.21.15.38:41284) 2023-07-11T00:00:43.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff40b79700 1 -- 172.21.15.38:0/839238117 learned_addr learned my addr 172.21.15.38:0/839238117 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:43.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff3bfff700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7eff3c069f30 0x7eff3c0b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff3b7fe700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c06a3b0 0x7eff3c0b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff40b79700 1 -- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7eff3c069f30 msgr2=0x7eff3c0b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff40b79700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7eff3c069f30 0x7eff3c0b57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff40b79700 1 -- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c06a3b0 msgr2=0x7eff3c0b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff40b79700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c06a3b0 0x7eff3c0b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff40b79700 1 -- 172.21.15.38:0/839238117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0094a0 con 0x7eff3c147dc0 2023-07-11T00:00:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff40b79700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff3c147dc0 0x7eff3c1e2f60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff3400cbc0 tx=0x7eff3400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff38ff9700 1 -- 172.21.15.38:0/839238117 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3400ab50 con 0x7eff3c147dc0 2023-07-11T00:00:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff38ff9700 1 -- 172.21.15.38:0/839238117 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3400acb0 con 0x7eff3c147dc0 2023-07-11T00:00:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff425dc700 1 -- 172.21.15.38:0/839238117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c14bbb0 con 0x7eff3c147dc0 2023-07-11T00:00:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff38ff9700 1 -- 172.21.15.38:0/839238117 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34012600 con 0x7eff3c147dc0 2023-07-11T00:00:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.467+0000 7eff425dc700 1 -- 172.21.15.38:0/839238117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c0b6af0 con 0x7eff3c147dc0 2023-07-11T00:00:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.468+0000 7eff425dc700 1 -- 172.21.15.38:0/839238117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c074360 con 0x7eff3c147dc0 2023-07-11T00:00:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.469+0000 7eff38ff9700 1 -- 172.21.15.38:0/839238117 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff3401b3b0 con 0x7eff3c147dc0 2023-07-11T00:00:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.469+0000 7eff38ff9700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7eff2806ace0 0x7eff2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.469+0000 7eff38ff9700 1 -- 172.21.15.38:0/839238117 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff34089180 con 0x7eff3c147dc0 2023-07-11T00:00:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.469+0000 7eff3bfff700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7eff2806ace0 0x7eff2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.470+0000 7eff3bfff700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7eff2806ace0 0x7eff2806d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0090b0 tx=0x7eff2c01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.474+0000 7eff38ff9700 1 -- 172.21.15.38:0/839238117 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7eff34054250 con 0x7eff3c147dc0 2023-07-11T00:00:43.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.667+0000 7eff425dc700 1 -- 172.21.15.38:0/839238117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff3c0b81c0 con 0x7eff3c147dc0 2023-07-11T00:00:43.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.667+0000 7eff38ff9700 1 -- 172.21.15.38:0/839238117 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff34017020 con 0x7eff3c147dc0 2023-07-11T00:00:43.670 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-07-11T00:00:43.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 -- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7eff2806ace0 msgr2=0x7eff2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7eff2806ace0 0x7eff2806d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0090b0 tx=0x7eff2c01c040 comp rx=0 tx=0).stop 2023-07-11T00:00:43.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 -- 172.21.15.38:0/839238117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff3c147dc0 msgr2=0x7eff3c1e2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff3c147dc0 0x7eff3c1e2f60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff3400cbc0 tx=0x7eff3400cf80 comp rx=0 tx=0).stop 2023-07-11T00:00:43.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 -- 172.21.15.38:0/839238117 shutdown_connections 2023-07-11T00:00:43.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7eff2806ace0 0x7eff2806d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff3c147dc0 0x7eff3c1e2f60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7eff3c069f30 0x7eff3c0b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 --2- 172.21.15.38:0/839238117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c06a3b0 0x7eff3c0b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 -- 172.21.15.38:0/839238117 >> 172.21.15.38:0/839238117 conn(0x7eff3c06d0e0 msgr2=0x7eff3c145fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:43.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 -- 172.21.15.38:0/839238117 shutdown_connections 2023-07-11T00:00:43.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.669+0000 7eff425dc700 1 -- 172.21.15.38:0/839238117 wait complete. 2023-07-11T00:00:43.726 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-07-11T00:00:43.728 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-07-11T00:00:43.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.852+0000 7f73e5405700 1 Processor -- start 2023-07-11T00:00:43.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.852+0000 7f73e5405700 1 -- start start 2023-07-11T00:00:43.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73e5405700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f73e00b8d90 0x7f73e006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73e5405700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e00b8620 con 0x7f73e01449d0 2023-07-11T00:00:43.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73e5405700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e00b8900 con 0x7f73e00bc810 2023-07-11T00:00:43.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73e5405700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00b97a0 con 0x7f73e00b8d90 2023-07-11T00:00:43.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73deffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f73e01449d0 0x7f73e014db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58886/0 (socket says 172.21.15.38:58886) 2023-07-11T00:00:43.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73deffd700 1 -- 172.21.15.38:0/57095020 learned_addr learned my addr 172.21.15.38:0/57095020 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:43.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73df7fe700 1 --2- 172.21.15.38:0/57095020 >> v2:172.21.15.70:3300/0 conn(0x7f73e00b8d90 0x7f73e006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73ddffb700 1 -- 172.21.15.38:0/57095020 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433249834 0 0) 0x7f73e00b8620 con 0x7f73e01449d0 2023-07-11T00:00:43.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73ddffb700 1 -- 172.21.15.38:0/57095020 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73cc0035b0 con 0x7f73e01449d0 2023-07-11T00:00:43.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73ddffb700 1 -- 172.21.15.38:0/57095020 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1393864124 0 0) 0x7f73cc0035b0 con 0x7f73e01449d0 2023-07-11T00:00:43.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73df7fe700 1 -- 172.21.15.38:0/57095020 >> v1:172.21.15.70:6789/0 conn(0x7f73e00bc810 legacy=0x7f73e00ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73df7fe700 1 -- 172.21.15.38:0/57095020 >> v1:172.21.15.38:6789/0 conn(0x7f73e01449d0 legacy=0x7f73e014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.853+0000 7f73df7fe700 1 -- 172.21.15.38:0/57095020 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e00bac40 con 0x7f73e00b8d90 2023-07-11T00:00:43.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.854+0000 7f73df7fe700 1 --2- 172.21.15.38:0/57095020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e00b8d90 0x7f73e006ade0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009d90 tx=0x7f73d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90d402de5af7604 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:43.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.854+0000 7f73ddffb700 1 -- 172.21.15.38:0/57095020 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800e070 con 0x7f73e00b8d90 2023-07-11T00:00:43.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.854+0000 7f73ddffb700 1 -- 172.21.15.38:0/57095020 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d8003a20 con 0x7f73e00b8d90 2023-07-11T00:00:43.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.854+0000 7f73ddffb700 1 -- 172.21.15.38:0/57095020 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0001670 con 0x7f73e00b8d90 2023-07-11T00:00:43.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.854+0000 7f73e5405700 1 -- 172.21.15.38:0/57095020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e00b8d90 msgr2=0x7f73e006ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.854+0000 7f73e5405700 1 --2- 172.21.15.38:0/57095020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e00b8d90 0x7f73e006ade0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009d90 tx=0x7f73d800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:43.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.854+0000 7f73e5405700 1 -- 172.21.15.38:0/57095020 shutdown_connections 2023-07-11T00:00:43.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.854+0000 7f73e5405700 1 --2- 172.21.15.38:0/57095020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e00b8d90 0x7f73e006ade0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.854+0000 7f73e5405700 1 -- 172.21.15.38:0/57095020 >> 172.21.15.38:0/57095020 conn(0x7f73e00c0860 msgr2=0x7f73e00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:43.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.854+0000 7f73e5405700 1 -- 172.21.15.38:0/57095020 shutdown_connections 2023-07-11T00:00:43.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.854+0000 7f73e5405700 1 -- 172.21.15.38:0/57095020 wait complete. 2023-07-11T00:00:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.855+0000 7f73e5405700 1 Processor -- start 2023-07-11T00:00:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73e5405700 1 -- start start 2023-07-11T00:00:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73e5405700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e00b8d90 0x7f73e014d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73e5405700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e00bc810 0x7f73e014ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73e5405700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f73e01449d0 0x7f73e0149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73e5405700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e014da30 con 0x7f73e00b8d90 2023-07-11T00:00:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73e5405700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e014b160 con 0x7f73e00bc810 2023-07-11T00:00:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73e5405700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e0148a50 con 0x7f73e01449d0 2023-07-11T00:00:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73deffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e00b8d90 0x7f73e014d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73deffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e00b8d90 0x7f73e014d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41292/0 (socket says 172.21.15.38:41292) 2023-07-11T00:00:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73deffd700 1 -- 172.21.15.38:0/343517247 learned_addr learned my addr 172.21.15.38:0/343517247 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73df7fe700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f73e01449d0 0x7f73e0149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.856+0000 7f73de7fc700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e00bc810 0x7f73e014ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73deffd700 1 -- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f73e01449d0 msgr2=0x7f73e0149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73deffd700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f73e01449d0 0x7f73e0149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73deffd700 1 -- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e00bc810 msgr2=0x7f73e014ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:43.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73deffd700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e00bc810 0x7f73e014ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:43.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73deffd700 1 -- 172.21.15.38:0/343517247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d8009a70 con 0x7f73e00b8d90 2023-07-11T00:00:43.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73de7fc700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e00bc810 0x7f73e014ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:43.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73deffd700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e00b8d90 0x7f73e014d4f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f73d00011e0 tx=0x7f73d000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:43.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73d77fe700 1 -- 172.21.15.38:0/343517247 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0007560 con 0x7f73e00b8d90 2023-07-11T00:00:43.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73d77fe700 1 -- 172.21.15.38:0/343517247 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d00076c0 con 0x7f73e00b8d90 2023-07-11T00:00:43.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73e5405700 1 -- 172.21.15.38:0/343517247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e0148470 con 0x7f73e00b8d90 2023-07-11T00:00:43.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73d77fe700 1 -- 172.21.15.38:0/343517247 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0004a90 con 0x7f73e00b8d90 2023-07-11T00:00:43.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.857+0000 7f73e5405700 1 -- 172.21.15.38:0/343517247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e014b370 con 0x7f73e00b8d90 2023-07-11T00:00:43.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.858+0000 7f73e5405700 1 -- 172.21.15.38:0/343517247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e0074360 con 0x7f73e00b8d90 2023-07-11T00:00:43.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.858+0000 7f73d77fe700 1 -- 172.21.15.38:0/343517247 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f73d0004bf0 con 0x7f73e00b8d90 2023-07-11T00:00:43.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.859+0000 7f73d77fe700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f73c006ad10 0x7f73c006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:43.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.859+0000 7f73d77fe700 1 -- 172.21.15.38:0/343517247 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73d0088890 con 0x7f73e00b8d90 2023-07-11T00:00:43.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.859+0000 7f73de7fc700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f73c006ad10 0x7f73c006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:43.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.859+0000 7f73de7fc700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f73c006ad10 0x7f73c006d1c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f73e014dc00 tx=0x7f73c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:43.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:43.863+0000 7f73d77fe700 1 -- 172.21.15.38:0/343517247 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f73d00539d0 con 0x7f73e00b8d90 2023-07-11T00:00:44.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:44.145+0000 7f73e5405700 1 -- 172.21.15.38:0/343517247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f73e0143ac0 con 0x7f73e00b8d90 2023-07-11T00:00:45.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.065+0000 7f73d77fe700 1 -- 172.21.15.38:0/343517247 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v46) v1 ==== 166+0+0 (secure 0 0 0) 0x7f73d00180e0 con 0x7f73e00b8d90 2023-07-11T00:00:45.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 -- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f73c006ad10 msgr2=0x7f73c006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:45.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f73c006ad10 0x7f73c006d1c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f73e014dc00 tx=0x7f73c8009040 comp rx=0 tx=0).stop 2023-07-11T00:00:45.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 -- 172.21.15.38:0/343517247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e00b8d90 msgr2=0x7f73e014d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:45.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e00b8d90 0x7f73e014d4f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f73d00011e0 tx=0x7f73d000cb00 comp rx=0 tx=0).stop 2023-07-11T00:00:45.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 -- 172.21.15.38:0/343517247 shutdown_connections 2023-07-11T00:00:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f73c006ad10 0x7f73c006d1c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f73e01449d0 0x7f73e0149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e00b8d90 0x7f73e014d4f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 --2- 172.21.15.38:0/343517247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73e00bc810 0x7f73e014ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 -- 172.21.15.38:0/343517247 >> 172.21.15.38:0/343517247 conn(0x7f73e00c0860 msgr2=0x7f73e00baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 -- 172.21.15.38:0/343517247 shutdown_connections 2023-07-11T00:00:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.068+0000 7f73e5405700 1 -- 172.21.15.38:0/343517247 wait complete. 2023-07-11T00:00:45.086 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-11T00:00:45.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.219+0000 7fce5797c700 1 Processor -- start 2023-07-11T00:00:45.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.219+0000 7fce5797c700 1 -- start start 2023-07-11T00:00:45.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce5797c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fce500bc810 0x7fce500ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:45.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce5797c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce500b8d90 0x7fce5006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:45.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce5797c700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce500b8620 con 0x7fce501449d0 2023-07-11T00:00:45.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce5797c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce500b97a0 con 0x7fce500bc810 2023-07-11T00:00:45.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce5797c700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce50144da0 con 0x7fce500b8d90 2023-07-11T00:00:45.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce54f17700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fce500bc810 0x7fce500ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:45.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce54f17700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fce500bc810 0x7fce500ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41308/0 (socket says 172.21.15.38:41308) 2023-07-11T00:00:45.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce54f17700 1 -- 172.21.15.38:0/547739532 learned_addr learned my addr 172.21.15.38:0/547739532 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:45.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce55f19700 1 --2- 172.21.15.38:0/547739532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce500b8d90 0x7fce5006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:45.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce54f17700 1 -- 172.21.15.38:0/547739532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce500b8d90 msgr2=0x7fce5006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:45.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce54f17700 1 --2- 172.21.15.38:0/547739532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce500b8d90 0x7fce5006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce54f17700 1 -- 172.21.15.38:0/547739532 >> v1:172.21.15.70:6789/0 conn(0x7fce501449d0 legacy=0x7fce5014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:45.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce54f17700 1 -- 172.21.15.38:0/547739532 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce500b8900 con 0x7fce500bc810 2023-07-11T00:00:45.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce54f17700 1 --2- 172.21.15.38:0/547739532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce500bc810 0x7fce500ba530 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fce400098f0 tx=0x7fce40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca778137adae20b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:45.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce47fff700 1 -- 172.21.15.38:0/547739532 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000b8a0 con 0x7fce500bc810 2023-07-11T00:00:45.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce47fff700 1 -- 172.21.15.38:0/547739532 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000ba00 con 0x7fce500bc810 2023-07-11T00:00:45.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.220+0000 7fce47fff700 1 -- 172.21.15.38:0/547739532 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000bd90 con 0x7fce500bc810 2023-07-11T00:00:45.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.221+0000 7fce5797c700 1 -- 172.21.15.38:0/547739532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce500bc810 msgr2=0x7fce500ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:45.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.221+0000 7fce5797c700 1 --2- 172.21.15.38:0/547739532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce500bc810 0x7fce500ba530 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fce400098f0 tx=0x7fce40009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.221+0000 7fce5797c700 1 -- 172.21.15.38:0/547739532 shutdown_connections 2023-07-11T00:00:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.221+0000 7fce5797c700 1 --2- 172.21.15.38:0/547739532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce500b8d90 0x7fce5006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.221+0000 7fce5797c700 1 --2- 172.21.15.38:0/547739532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce500bc810 0x7fce500ba530 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.221+0000 7fce5797c700 1 -- 172.21.15.38:0/547739532 >> 172.21.15.38:0/547739532 conn(0x7fce500c0860 msgr2=0x7fce500c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.221+0000 7fce5797c700 1 -- 172.21.15.38:0/547739532 shutdown_connections 2023-07-11T00:00:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.221+0000 7fce5797c700 1 -- 172.21.15.38:0/547739532 wait complete. 2023-07-11T00:00:45.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.222+0000 7fce5797c700 1 Processor -- start 2023-07-11T00:00:45.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.222+0000 7fce5797c700 1 -- start start 2023-07-11T00:00:45.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce5797c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce500b8d90 0x7fce500b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:45.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce5797c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce500bc810 0x7fce501e3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:45.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce5797c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce501449d0 0x7fce500b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:45.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce5797c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce500b3fa0 con 0x7fce500bc810 2023-07-11T00:00:45.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce5797c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce500b4210 con 0x7fce501449d0 2023-07-11T00:00:45.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce5797c700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce500b20b0 con 0x7fce500b8d90 2023-07-11T00:00:45.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce54f17700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce500bc810 0x7fce501e3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:45.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce54f17700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce500bc810 0x7fce501e3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41314/0 (socket says 172.21.15.38:41314) 2023-07-11T00:00:45.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce54f17700 1 -- 172.21.15.38:0/3200114267 learned_addr learned my addr 172.21.15.38:0/3200114267 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:45.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce55718700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce500b8d90 0x7fce500b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:45.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce55f19700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce501449d0 0x7fce500b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:45.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce54f17700 1 -- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce500b8d90 msgr2=0x7fce500b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:45.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce54f17700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce500b8d90 0x7fce500b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce54f17700 1 -- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce501449d0 msgr2=0x7fce500b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:45.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce54f17700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce501449d0 0x7fce500b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce54f17700 1 -- 172.21.15.38:0/3200114267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40009550 con 0x7fce500bc810 2023-07-11T00:00:45.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce54f17700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce500bc810 0x7fce501e3830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fce40000c00 tx=0x7fce40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:45.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.223+0000 7fce45ffb700 1 -- 172.21.15.38:0/3200114267 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40004380 con 0x7fce500bc810 2023-07-11T00:00:45.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.224+0000 7fce45ffb700 1 -- 172.21.15.38:0/3200114267 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4001f070 con 0x7fce500bc810 2023-07-11T00:00:45.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.224+0000 7fce5797c700 1 -- 172.21.15.38:0/3200114267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce501e3030 con 0x7fce500bc810 2023-07-11T00:00:45.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.224+0000 7fce45ffb700 1 -- 172.21.15.38:0/3200114267 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400036a0 con 0x7fce500bc810 2023-07-11T00:00:45.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.224+0000 7fce5797c700 1 -- 172.21.15.38:0/3200114267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce500be7c0 con 0x7fce500bc810 2023-07-11T00:00:45.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.225+0000 7fce5797c700 1 -- 172.21.15.38:0/3200114267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce50074360 con 0x7fce500bc810 2023-07-11T00:00:45.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.225+0000 7fce45ffb700 1 -- 172.21.15.38:0/3200114267 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce40021030 con 0x7fce500bc810 2023-07-11T00:00:45.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.225+0000 7fce45ffb700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fce3406ace0 0x7fce3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:45.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.226+0000 7fce45ffb700 1 -- 172.21.15.38:0/3200114267 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce4008a7d0 con 0x7fce500bc810 2023-07-11T00:00:45.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.226+0000 7fce55718700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fce3406ace0 0x7fce3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:45.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.226+0000 7fce55718700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fce3406ace0 0x7fce3406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fce4c007fd0 tx=0x7fce4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:45.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.230+0000 7fce45ffb700 1 -- 172.21.15.38:0/3200114267 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fce400559a0 con 0x7fce500bc810 2023-07-11T00:00:45.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.427+0000 7fce5797c700 1 -- 172.21.15.38:0/3200114267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fce500bc330 con 0x7fce500bc810 2023-07-11T00:00:45.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.435+0000 7fce45ffb700 1 -- 172.21.15.38:0/3200114267 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fce40058fc0 con 0x7fce500bc810 2023-07-11T00:00:45.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 -- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fce3406ace0 msgr2=0x7fce3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:45.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fce3406ace0 0x7fce3406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fce4c007fd0 tx=0x7fce4c009040 comp rx=0 tx=0).stop 2023-07-11T00:00:45.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 -- 172.21.15.38:0/3200114267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce500bc810 msgr2=0x7fce501e3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:45.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce500bc810 0x7fce501e3830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fce40000c00 tx=0x7fce40004750 comp rx=0 tx=0).stop 2023-07-11T00:00:45.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 -- 172.21.15.38:0/3200114267 shutdown_connections 2023-07-11T00:00:45.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fce3406ace0 0x7fce3406d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce501449d0 0x7fce500b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce500b8d90 0x7fce500b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 --2- 172.21.15.38:0/3200114267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce500bc810 0x7fce501e3830 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:45.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 -- 172.21.15.38:0/3200114267 >> 172.21.15.38:0/3200114267 conn(0x7fce500c0860 msgr2=0x7fce500baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:45.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 -- 172.21.15.38:0/3200114267 shutdown_connections 2023-07-11T00:00:45.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:45.437+0000 7fce5797c700 1 -- 172.21.15.38:0/3200114267 wait complete. 2023-07-11T00:00:45.452 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-11T00:00:45.452 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-11T00:00:45.540 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-11T00:00:45.629 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-11T00:00:45.740 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-11T00:00:45.740 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-11T00:00:45.741 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:00:45.788 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-11T00:00:45.789 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:00:45.875 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-11T00:00:45.875 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:00:45.962 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:46.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.091+0000 7fc9d8114700 1 Processor -- start 2023-07-11T00:00:46.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.091+0000 7fc9d8114700 1 -- start start 2023-07-11T00:00:46.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.092+0000 7fc9d8114700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc9d00bc810 0x7fc9d00ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.092+0000 7fc9d8114700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00b8620 con 0x7fc9d00b8d90 2023-07-11T00:00:46.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.092+0000 7fc9d8114700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00b8900 con 0x7fc9d01449d0 2023-07-11T00:00:46.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.092+0000 7fc9d8114700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d00b97a0 con 0x7fc9d00bc810 2023-07-11T00:00:46.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.092+0000 7fc9d66b1700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc9d00b8d90 0x7fc9d006ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58902/0 (socket says 172.21.15.38:58902) 2023-07-11T00:00:46.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.092+0000 7fc9d66b1700 1 -- 172.21.15.38:0/2696524938 learned_addr learned my addr 172.21.15.38:0/2696524938 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:46.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d56af700 1 --2- 172.21.15.38:0/2696524938 >> v2:172.21.15.70:3300/0 conn(0x7fc9d00bc810 0x7fc9d00ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759369163 0 0) 0x7fc9d00b8620 con 0x7fc9d00b8d90 2023-07-11T00:00:46.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9bc0035b0 con 0x7fc9d00b8d90 2023-07-11T00:00:46.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 5790428 0 0) 0x7fc9bc0035b0 con 0x7fc9d00b8d90 2023-07-11T00:00:46.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 >> v2:172.21.15.70:3300/0 conn(0x7fc9d00bc810 msgr2=0x7fc9d00ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:46.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 --2- 172.21.15.38:0/2696524938 >> v2:172.21.15.70:3300/0 conn(0x7fc9d00bc810 0x7fc9d00ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 >> v1:172.21.15.70:6789/0 conn(0x7fc9d01449d0 legacy=0x7fc9d014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d006b4f0 con 0x7fc9d00b8d90 2023-07-11T00:00:46.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7fc9c80019f0 con 0x7fc9d00b8d90 2023-07-11T00:00:46.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 >> v1:172.21.15.38:6789/0 conn(0x7fc9d00b8d90 legacy=0x7fc9d006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 --2- 172.21.15.38:0/2696524938 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc9bc003a00 0x7fc9bc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 --2- 172.21.15.38:0/2696524938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9bc004850 0x7fc9bc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 --2- 172.21.15.38:0/2696524938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 0x7fc9bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b97a0 con 0x7fc9bc005200 2023-07-11T00:00:46.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc00c060 con 0x7fc9bc004850 2023-07-11T00:00:46.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc00c220 con 0x7fc9bc003a00 2023-07-11T00:00:46.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d66b1700 1 --2- 172.21.15.38:0/2696524938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 0x7fc9bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d5eb0700 1 --2- 172.21.15.38:0/2696524938 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc9bc003a00 0x7fc9bc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d56af700 1 --2- 172.21.15.38:0/2696524938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9bc004850 0x7fc9bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d66b1700 1 -- 172.21.15.38:0/2696524938 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc9bc003a00 msgr2=0x7fc9bc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:46.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d66b1700 1 --2- 172.21.15.38:0/2696524938 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc9bc003a00 0x7fc9bc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d66b1700 1 -- 172.21.15.38:0/2696524938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9bc004850 msgr2=0x7fc9bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:46.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d66b1700 1 --2- 172.21.15.38:0/2696524938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9bc004850 0x7fc9bc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.093+0000 7fc9d66b1700 1 -- 172.21.15.38:0/2696524938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0035b0 con 0x7fc9bc005200 2023-07-11T00:00:46.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d66b1700 1 -- 172.21.15.38:0/2696524938 reap_dead start 2023-07-11T00:00:46.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d66b1700 1 --2- 172.21.15.38:0/2696524938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 0x7fc9bc00ba10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800a830 tx=0x7fc9bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780265c26ac5b511 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:46.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800a2f0 con 0x7fc9bc005200 2023-07-11T00:00:46.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c8012600 con 0x7fc9bc005200 2023-07-11T00:00:46.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d4eae700 1 -- 172.21.15.38:0/2696524938 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80129b0 con 0x7fc9bc005200 2023-07-11T00:00:46.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d8114700 1 -- 172.21.15.38:0/2696524938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 msgr2=0x7fc9bc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d8114700 1 --2- 172.21.15.38:0/2696524938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 0x7fc9bc00ba10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800a830 tx=0x7fc9bc005880 comp rx=0 tx=0).stop 2023-07-11T00:00:46.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d8114700 1 -- 172.21.15.38:0/2696524938 shutdown_connections 2023-07-11T00:00:46.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d8114700 1 --2- 172.21.15.38:0/2696524938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 0x7fc9bc00ba10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d8114700 1 -- 172.21.15.38:0/2696524938 >> 172.21.15.38:0/2696524938 conn(0x7fc9d00c0860 msgr2=0x7fc9d00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:46.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d8114700 1 -- 172.21.15.38:0/2696524938 shutdown_connections 2023-07-11T00:00:46.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.094+0000 7fc9d8114700 1 -- 172.21.15.38:0/2696524938 wait complete. 2023-07-11T00:00:46.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d8114700 1 Processor -- start 2023-07-11T00:00:46.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d8114700 1 -- start start 2023-07-11T00:00:46.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d8114700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 0x7fc9d00b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d8114700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc9d00b3dc0 0x7fc9d014d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d8114700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9d01d3970 0x7fc9d00b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d8114700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d014d640 con 0x7fc9bc005200 2023-07-11T00:00:46.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d8114700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b1b80 con 0x7fc9d01d3970 2023-07-11T00:00:46.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d8114700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b15a0 con 0x7fc9d00b3dc0 2023-07-11T00:00:46.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d5eb0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 0x7fc9d00b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d5eb0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 0x7fc9d00b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41328/0 (socket says 172.21.15.38:41328) 2023-07-11T00:00:46.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d5eb0700 1 -- 172.21.15.38:0/12793613 learned_addr learned my addr 172.21.15.38:0/12793613 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:46.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d56af700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc9d00b3dc0 0x7fc9d014d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.096+0000 7fc9d66b1700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9d01d3970 0x7fc9d00b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.097+0000 7fc9d5eb0700 1 -- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc9d00b3dc0 msgr2=0x7fc9d014d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.097+0000 7fc9d5eb0700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc9d00b3dc0 0x7fc9d014d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.097+0000 7fc9d5eb0700 1 -- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9d01d3970 msgr2=0x7fc9d00b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.097+0000 7fc9d5eb0700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9d01d3970 0x7fc9d00b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.097+0000 7fc9d5eb0700 1 -- 172.21.15.38:0/12793613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d00b3110 con 0x7fc9bc005200 2023-07-11T00:00:46.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.097+0000 7fc9d5eb0700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 0x7fc9d00b2010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00f820 tx=0x7fc9cc00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:46.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.097+0000 7fc9c67fc700 1 -- 172.21.15.38:0/12793613 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0052e0 con 0x7fc9bc005200 2023-07-11T00:00:46.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.097+0000 7fc9c67fc700 1 -- 172.21.15.38:0/12793613 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc005440 con 0x7fc9bc005200 2023-07-11T00:00:46.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.097+0000 7fc9d8114700 1 -- 172.21.15.38:0/12793613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d00b1810 con 0x7fc9bc005200 2023-07-11T00:00:46.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.097+0000 7fc9c67fc700 1 -- 172.21.15.38:0/12793613 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0038c0 con 0x7fc9bc005200 2023-07-11T00:00:46.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.097+0000 7fc9d8114700 1 -- 172.21.15.38:0/12793613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d01d3dc0 con 0x7fc9bc005200 2023-07-11T00:00:46.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.098+0000 7fc9d8114700 1 -- 172.21.15.38:0/12793613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d0074360 con 0x7fc9bc005200 2023-07-11T00:00:46.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.098+0000 7fc9c67fc700 1 -- 172.21.15.38:0/12793613 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9cc003a20 con 0x7fc9bc005200 2023-07-11T00:00:46.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.099+0000 7fc9c67fc700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc9b406ad10 0x7fc9b406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.099+0000 7fc9c67fc700 1 -- 172.21.15.38:0/12793613 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9cc0890e0 con 0x7fc9bc005200 2023-07-11T00:00:46.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.099+0000 7fc9d56af700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc9b406ad10 0x7fc9b406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.099+0000 7fc9d56af700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc9b406ad10 0x7fc9b406d1c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc9d01d4ae0 tx=0x7fc9c0009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:46.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.103+0000 7fc9c67fc700 1 -- 172.21.15.38:0/12793613 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc9cc054180 con 0x7fc9bc005200 2023-07-11T00:00:46.181 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:00:46.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:00:46.187 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:00:46.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.303+0000 7fc9d8114700 1 -- 172.21.15.38:0/12793613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9d00bc330 con 0x7fc9bc005200 2023-07-11T00:00:46.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.304+0000 7fc9c67fc700 1 -- 172.21.15.38:0/12793613 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7fc9cc0577a0 con 0x7fc9bc005200 2023-07-11T00:00:46.307 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:46.308 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:46.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 -- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc9b406ad10 msgr2=0x7fc9b406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc9b406ad10 0x7fc9b406d1c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc9d01d4ae0 tx=0x7fc9c0009210 comp rx=0 tx=0).stop 2023-07-11T00:00:46.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 -- 172.21.15.38:0/12793613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 msgr2=0x7fc9d00b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 0x7fc9d00b2010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00f820 tx=0x7fc9cc00fb30 comp rx=0 tx=0).stop 2023-07-11T00:00:46.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 -- 172.21.15.38:0/12793613 shutdown_connections 2023-07-11T00:00:46.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc9b406ad10 0x7fc9b406d1c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9d01d3970 0x7fc9d00b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9bc005200 0x7fc9d00b2010 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 --2- 172.21.15.38:0/12793613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc9d00b3dc0 0x7fc9d014d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 -- 172.21.15.38:0/12793613 >> 172.21.15.38:0/12793613 conn(0x7fc9d00c0860 msgr2=0x7fc9d00be760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:46.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 -- 172.21.15.38:0/12793613 shutdown_connections 2023-07-11T00:00:46.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.306+0000 7fc9d8114700 1 -- 172.21.15.38:0/12793613 wait complete. 2023-07-11T00:00:46.321 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:00:14.572121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:00:15.763698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:00:46.322 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:00:46.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.448+0000 7f0a05ba0700 1 Processor -- start 2023-07-11T00:00:46.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.449+0000 7f0a05ba0700 1 -- start start 2023-07-11T00:00:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a05ba0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a0006b220 0x7f0a00071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a05ba0700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a0014ad50 0x7f0a0014b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a05ba0700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a00070bf0 con 0x7f0a0006f100 2023-07-11T00:00:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a05ba0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a000b75e0 con 0x7f0a0006b220 2023-07-11T00:00:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a05ba0700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a000b8460 con 0x7f0a0014ad50 2023-07-11T00:00:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a04b9e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a0006b220 0x7f0a00071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a04b9e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a0006b220 0x7f0a00071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41334/0 (socket says 172.21.15.38:41334) 2023-07-11T00:00:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a04b9e700 1 -- 172.21.15.38:0/1733836271 learned_addr learned my addr 172.21.15.38:0/1733836271 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a0539f700 1 --2- 172.21.15.38:0/1733836271 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a0014ad50 0x7f0a0014b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a04b9e700 1 -- 172.21.15.38:0/1733836271 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a0014ad50 msgr2=0x7f0a0014b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a04b9e700 1 --2- 172.21.15.38:0/1733836271 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a0014ad50 0x7f0a0014b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a04b9e700 1 -- 172.21.15.38:0/1733836271 >> v1:172.21.15.70:6789/0 conn(0x7f0a0006f100 legacy=0x7f0a000b7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a04b9e700 1 -- 172.21.15.38:0/1733836271 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0014b730 con 0x7f0a0006b220 2023-07-11T00:00:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a0539f700 1 --2- 172.21.15.38:0/1733836271 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a0014ad50 0x7f0a0014b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f0a04b9e700 1 --2- 172.21.15.38:0/1733836271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a0006b220 0x7f0a00071260 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0098f0 tx=0x7f09fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbee5f774dce0a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f09f77fe700 1 -- 172.21.15.38:0/1733836271 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc004230 con 0x7f0a0006b220 2023-07-11T00:00:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f09f77fe700 1 -- 172.21.15.38:0/1733836271 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc004390 con 0x7f0a0006b220 2023-07-11T00:00:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.450+0000 7f09f77fe700 1 -- 172.21.15.38:0/1733836271 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0036a0 con 0x7f0a0006b220 2023-07-11T00:00:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.451+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1733836271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a0006b220 msgr2=0x7f0a00071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.451+0000 7f0a05ba0700 1 --2- 172.21.15.38:0/1733836271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a0006b220 0x7f0a00071260 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0098f0 tx=0x7f09fc009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:46.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.451+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1733836271 shutdown_connections 2023-07-11T00:00:46.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.451+0000 7f0a05ba0700 1 --2- 172.21.15.38:0/1733836271 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a0014ad50 0x7f0a0014b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.451+0000 7f0a05ba0700 1 --2- 172.21.15.38:0/1733836271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a0006b220 0x7f0a00071260 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.451+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1733836271 >> 172.21.15.38:0/1733836271 conn(0x7f0a000b96e0 msgr2=0x7f0a000b9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:46.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.451+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1733836271 shutdown_connections 2023-07-11T00:00:46.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.451+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1733836271 wait complete. 2023-07-11T00:00:46.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.452+0000 7f0a05ba0700 1 Processor -- start 2023-07-11T00:00:46.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.452+0000 7f0a05ba0700 1 -- start start 2023-07-11T00:00:46.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a05ba0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a0006b220 0x7f0a001e3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a05ba0700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a0006f100 0x7f0a001d4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a05ba0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a0014ad50 0x7f0a0013ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a05ba0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001e31f0 con 0x7f0a0014ad50 2023-07-11T00:00:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a05ba0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001e34d0 con 0x7f0a0006b220 2023-07-11T00:00:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a05ba0700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00149e70 con 0x7f0a0006f100 2023-07-11T00:00:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a0539f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a0014ad50 0x7f0a0013ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a0539f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a0014ad50 0x7f0a0013ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41348/0 (socket says 172.21.15.38:41348) 2023-07-11T00:00:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a0539f700 1 -- 172.21.15.38:0/1345047877 learned_addr learned my addr 172.21.15.38:0/1345047877 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f09f7fff700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a0006f100 0x7f0a001d4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a04b9e700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a0006b220 0x7f0a001e3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a0539f700 1 -- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a0006f100 msgr2=0x7f0a001d4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a0539f700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a0006f100 0x7f0a001d4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a0539f700 1 -- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a0006b220 msgr2=0x7f0a001e3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a0539f700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a0006b220 0x7f0a001e3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a0539f700 1 -- 172.21.15.38:0/1345047877 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc009550 con 0x7f0a0014ad50 2023-07-11T00:00:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.453+0000 7f0a0539f700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a0014ad50 0x7f0a0013ac90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f09f800cdb0 tx=0x7f09f800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.454+0000 7f09f57fa700 1 -- 172.21.15.38:0/1345047877 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f800f480 con 0x7f0a0014ad50 2023-07-11T00:00:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.454+0000 7f09f57fa700 1 -- 172.21.15.38:0/1345047877 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f800f600 con 0x7f0a0014ad50 2023-07-11T00:00:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.454+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1345047877 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a001dfcf0 con 0x7f0a0014ad50 2023-07-11T00:00:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.454+0000 7f09f57fa700 1 -- 172.21.15.38:0/1345047877 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f800f9b0 con 0x7f0a0014ad50 2023-07-11T00:00:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.454+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1345047877 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0014a3d0 con 0x7f0a0014ad50 2023-07-11T00:00:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.455+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1345047877 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a00141cc0 con 0x7f0a0014ad50 2023-07-11T00:00:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.455+0000 7f09f57fa700 1 -- 172.21.15.38:0/1345047877 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09f800b040 con 0x7f0a0014ad50 2023-07-11T00:00:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.455+0000 7f09f57fa700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f09ec06ace0 0x7f09ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.455+0000 7f09f57fa700 1 -- 172.21.15.38:0/1345047877 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09f8089c10 con 0x7f0a0014ad50 2023-07-11T00:00:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.456+0000 7f0a04b9e700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f09ec06ace0 0x7f09ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.456+0000 7f0a04b9e700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f09ec06ace0 0x7f09ec06d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009130 tx=0x7f09fc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.460+0000 7f09f57fa700 1 -- 172.21.15.38:0/1345047877 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f09f8054cc0 con 0x7f0a0014ad50 2023-07-11T00:00:46.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.656+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1345047877 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a0004ea60 con 0x7f0a0014ad50 2023-07-11T00:00:46.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.656+0000 7f09f57fa700 1 -- 172.21.15.38:0/1345047877 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f09f801d0a0 con 0x7f0a0014ad50 2023-07-11T00:00:46.660 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:00:46.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.658+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f09ec06ace0 msgr2=0x7f09ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.658+0000 7f0a05ba0700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f09ec06ace0 0x7f09ec06d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009130 tx=0x7f09fc008030 comp rx=0 tx=0).stop 2023-07-11T00:00:46.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.658+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1345047877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a0014ad50 msgr2=0x7f0a0013ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.658+0000 7f0a05ba0700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a0014ad50 0x7f0a0013ac90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f09f800cdb0 tx=0x7f09f800a560 comp rx=0 tx=0).stop 2023-07-11T00:00:46.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.659+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1345047877 shutdown_connections 2023-07-11T00:00:46.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.659+0000 7f0a05ba0700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f09ec06ace0 0x7f09ec06d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.659+0000 7f0a05ba0700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a0014ad50 0x7f0a0013ac90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.659+0000 7f0a05ba0700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a0006b220 0x7f0a001e3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.659+0000 7f0a05ba0700 1 --2- 172.21.15.38:0/1345047877 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a0006f100 0x7f0a001d4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.659+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1345047877 >> 172.21.15.38:0/1345047877 conn(0x7f0a000b96e0 msgr2=0x7f0a00141220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:46.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.659+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1345047877 shutdown_connections 2023-07-11T00:00:46.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.659+0000 7f0a05ba0700 1 -- 172.21.15.38:0/1345047877 wait complete. 2023-07-11T00:00:46.673 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:00:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.799+0000 7f4288692700 1 Processor -- start 2023-07-11T00:00:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.800+0000 7f4288692700 1 -- start start 2023-07-11T00:00:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f4288692700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4280141780 0x7f42800ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f4288692700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4280071a30 0x7f428014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f4288692700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4280070e70 con 0x7f42800b96b0 2023-07-11T00:00:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f4288692700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4280071ea0 con 0x7f4280141780 2023-07-11T00:00:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f4288692700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800b9b40 con 0x7f4280071a30 2023-07-11T00:00:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f428642e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4280141780 0x7f42800ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f428642e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4280141780 0x7f42800ba010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41352/0 (socket says 172.21.15.38:41352) 2023-07-11T00:00:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f428642e700 1 -- 172.21.15.38:0/2878077319 learned_addr learned my addr 172.21.15.38:0/2878077319 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f4285c2d700 1 --2- 172.21.15.38:0/2878077319 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4280071a30 0x7f428014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f428642e700 1 -- 172.21.15.38:0/2878077319 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4280071a30 msgr2=0x7f428014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f428642e700 1 --2- 172.21.15.38:0/2878077319 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4280071a30 0x7f428014ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f428642e700 1 -- 172.21.15.38:0/2878077319 >> v1:172.21.15.70:6789/0 conn(0x7f42800b96b0 legacy=0x7f42800b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f428642e700 1 -- 172.21.15.38:0/2878077319 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280070670 con 0x7f4280141780 2023-07-11T00:00:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.801+0000 7f428642e700 1 --2- 172.21.15.38:0/2878077319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4280141780 0x7f42800ba010 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f427c0098f0 tx=0x7f427c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912efe8c03d998ef server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.802+0000 7f428542c700 1 -- 172.21.15.38:0/2878077319 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c011830 con 0x7f4280141780 2023-07-11T00:00:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.802+0000 7f428542c700 1 -- 172.21.15.38:0/2878077319 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c011990 con 0x7f4280141780 2023-07-11T00:00:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.802+0000 7f428542c700 1 -- 172.21.15.38:0/2878077319 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c011d20 con 0x7f4280141780 2023-07-11T00:00:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.802+0000 7f4288692700 1 -- 172.21.15.38:0/2878077319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4280141780 msgr2=0x7f42800ba010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.802+0000 7f4288692700 1 --2- 172.21.15.38:0/2878077319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4280141780 0x7f42800ba010 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f427c0098f0 tx=0x7f427c009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.802+0000 7f4288692700 1 -- 172.21.15.38:0/2878077319 shutdown_connections 2023-07-11T00:00:46.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.802+0000 7f4288692700 1 --2- 172.21.15.38:0/2878077319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4280141780 0x7f42800ba010 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.802+0000 7f4288692700 1 --2- 172.21.15.38:0/2878077319 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4280071a30 0x7f428014ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.802+0000 7f4288692700 1 -- 172.21.15.38:0/2878077319 >> 172.21.15.38:0/2878077319 conn(0x7f428006d0e0 msgr2=0x7f428006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.802+0000 7f4288692700 1 -- 172.21.15.38:0/2878077319 shutdown_connections 2023-07-11T00:00:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.802+0000 7f4288692700 1 -- 172.21.15.38:0/2878077319 wait complete. 2023-07-11T00:00:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.804+0000 7f4288692700 1 Processor -- start 2023-07-11T00:00:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.804+0000 7f4288692700 1 -- start start 2023-07-11T00:00:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.804+0000 7f4288692700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4280071a30 0x7f4280145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.804+0000 7f4288692700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42800b96b0 0x7f4280144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.804+0000 7f4288692700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4280141780 0x7f42801de550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.804+0000 7f4288692700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280149950 con 0x7f4280141780 2023-07-11T00:00:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.804+0000 7f4288692700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42801484f0 con 0x7f42800b96b0 2023-07-11T00:00:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.804+0000 7f4288692700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4280148000 con 0x7f4280071a30 2023-07-11T00:00:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4286c2f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4280141780 0x7f42801de550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4286c2f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4280141780 0x7f42801de550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41358/0 (socket says 172.21.15.38:41358) 2023-07-11T00:00:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4286c2f700 1 -- 172.21.15.38:0/667317516 learned_addr learned my addr 172.21.15.38:0/667317516 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:46.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f428642e700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4280071a30 0x7f4280145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4285c2d700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42800b96b0 0x7f4280144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4286c2f700 1 -- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4280071a30 msgr2=0x7f4280145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4286c2f700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4280071a30 0x7f4280145690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4286c2f700 1 -- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42800b96b0 msgr2=0x7f4280144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:46.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4286c2f700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42800b96b0 0x7f4280144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:46.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4286c2f700 1 -- 172.21.15.38:0/667317516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c009550 con 0x7f4280141780 2023-07-11T00:00:46.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4286c2f700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4280141780 0x7f42801de550 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f427800cbc0 tx=0x7f427800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:46.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4276ffd700 1 -- 172.21.15.38:0/667317516 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278003c00 con 0x7f4280141780 2023-07-11T00:00:46.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4276ffd700 1 -- 172.21.15.38:0/667317516 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278003d60 con 0x7f4280141780 2023-07-11T00:00:46.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4288692700 1 -- 172.21.15.38:0/667317516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4280145d20 con 0x7f4280141780 2023-07-11T00:00:46.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4276ffd700 1 -- 172.21.15.38:0/667317516 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800aae0 con 0x7f4280141780 2023-07-11T00:00:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.805+0000 7f4288692700 1 -- 172.21.15.38:0/667317516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4280148210 con 0x7f4280141780 2023-07-11T00:00:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.806+0000 7f4288692700 1 -- 172.21.15.38:0/667317516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4280074360 con 0x7f4280141780 2023-07-11T00:00:46.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.807+0000 7f4276ffd700 1 -- 172.21.15.38:0/667317516 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f427800ac40 con 0x7f4280141780 2023-07-11T00:00:46.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.807+0000 7f4276ffd700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426406ad10 0x7f426406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:46.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.807+0000 7f4276ffd700 1 -- 172.21.15.38:0/667317516 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f42780894d0 con 0x7f4280141780 2023-07-11T00:00:46.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.807+0000 7f428642e700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426406ad10 0x7f426406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:46.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.808+0000 7f428642e700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426406ad10 0x7f426406d1c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f427c009c40 tx=0x7f427c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:46.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:46.812+0000 7f4276ffd700 1 -- 172.21.15.38:0/667317516 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f42780544e0 con 0x7f4280141780 2023-07-11T00:00:47.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.008+0000 7f4288692700 1 -- 172.21.15.38:0/667317516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42800b3e00 con 0x7f4280141780 2023-07-11T00:00:47.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.008+0000 7f4276ffd700 1 -- 172.21.15.38:0/667317516 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4278057b00 con 0x7f4280141780 2023-07-11T00:00:47.012 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:00:47.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.010+0000 7f4288692700 1 -- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426406ad10 msgr2=0x7f426406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.010+0000 7f4288692700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426406ad10 0x7f426406d1c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f427c009c40 tx=0x7f427c008030 comp rx=0 tx=0).stop 2023-07-11T00:00:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.010+0000 7f4288692700 1 -- 172.21.15.38:0/667317516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4280141780 msgr2=0x7f42801de550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.010+0000 7f4288692700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4280141780 0x7f42801de550 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f427800cbc0 tx=0x7f427800ced0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.011+0000 7f4288692700 1 -- 172.21.15.38:0/667317516 shutdown_connections 2023-07-11T00:00:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.011+0000 7f4288692700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426406ad10 0x7f426406d1c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.011+0000 7f4288692700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4280141780 0x7f42801de550 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.011+0000 7f4288692700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4280071a30 0x7f4280145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.011+0000 7f4288692700 1 --2- 172.21.15.38:0/667317516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42800b96b0 0x7f4280144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.011+0000 7f4288692700 1 -- 172.21.15.38:0/667317516 >> 172.21.15.38:0/667317516 conn(0x7f428006d0e0 msgr2=0x7f4280069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:47.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.011+0000 7f4288692700 1 -- 172.21.15.38:0/667317516 shutdown_connections 2023-07-11T00:00:47.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.011+0000 7f4288692700 1 -- 172.21.15.38:0/667317516 wait complete. 2023-07-11T00:00:47.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:00:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.152+0000 7f4e2521d700 1 Processor -- start 2023-07-11T00:00:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.152+0000 7f4e2521d700 1 -- start start 2023-07-11T00:00:47.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e2521d700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4e20141780 0x7f4e200ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e2521d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e20070e70 con 0x7f4e20071a30 2023-07-11T00:00:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e2521d700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e20071ea0 con 0x7f4e200b96b0 2023-07-11T00:00:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e2521d700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200b9b40 con 0x7f4e20141780 2023-07-11T00:00:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e1e59c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4e20071a30 0x7f4e2014ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58914/0 (socket says 172.21.15.38:58914) 2023-07-11T00:00:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e1e59c700 1 -- 172.21.15.38:0/1571494975 learned_addr learned my addr 172.21.15.38:0/1571494975 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e1ed9d700 1 --2- 172.21.15.38:0/1571494975 >> v2:172.21.15.70:3300/0 conn(0x7f4e20141780 0x7f4e200ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e1dd9b700 1 -- 172.21.15.38:0/1571494975 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015722780 0 0) 0x7f4e20070e70 con 0x7f4e20071a30 2023-07-11T00:00:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e1dd9b700 1 -- 172.21.15.38:0/1571494975 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e080035b0 con 0x7f4e20071a30 2023-07-11T00:00:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e1dd9b700 1 -- 172.21.15.38:0/1571494975 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667781287 0 0) 0x7f4e20071ea0 con 0x7f4e200b96b0 2023-07-11T00:00:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e1dd9b700 1 -- 172.21.15.38:0/1571494975 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e20070e70 con 0x7f4e200b96b0 2023-07-11T00:00:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e1ed9d700 1 -- 172.21.15.38:0/1571494975 >> v1:172.21.15.70:6789/0 conn(0x7f4e200b96b0 legacy=0x7f4e20151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e1ed9d700 1 -- 172.21.15.38:0/1571494975 >> v1:172.21.15.38:6789/0 conn(0x7f4e20071a30 legacy=0x7f4e2014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.153+0000 7f4e1ed9d700 1 -- 172.21.15.38:0/1571494975 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e20070670 con 0x7f4e20141780 2023-07-11T00:00:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.154+0000 7f4e1ed9d700 1 --2- 172.21.15.38:0/1571494975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e20141780 0x7f4e200ba010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009840 tx=0x7f4e14009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0e4a0516034a15 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.154+0000 7f4e1dd9b700 1 -- 172.21.15.38:0/1571494975 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14011830 con 0x7f4e20141780 2023-07-11T00:00:47.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.154+0000 7f4e1dd9b700 1 -- 172.21.15.38:0/1571494975 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e14011990 con 0x7f4e20141780 2023-07-11T00:00:47.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.154+0000 7f4e1dd9b700 1 -- 172.21.15.38:0/1571494975 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14011d00 con 0x7f4e20141780 2023-07-11T00:00:47.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.154+0000 7f4e2521d700 1 -- 172.21.15.38:0/1571494975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e20141780 msgr2=0x7f4e200ba010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.154+0000 7f4e2521d700 1 --2- 172.21.15.38:0/1571494975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e20141780 0x7f4e200ba010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009840 tx=0x7f4e14009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:47.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.154+0000 7f4e2521d700 1 -- 172.21.15.38:0/1571494975 shutdown_connections 2023-07-11T00:00:47.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.154+0000 7f4e2521d700 1 --2- 172.21.15.38:0/1571494975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e20141780 0x7f4e200ba010 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.154+0000 7f4e2521d700 1 -- 172.21.15.38:0/1571494975 >> 172.21.15.38:0/1571494975 conn(0x7f4e2006d0e0 msgr2=0x7f4e2006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:47.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.154+0000 7f4e2521d700 1 -- 172.21.15.38:0/1571494975 shutdown_connections 2023-07-11T00:00:47.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.154+0000 7f4e2521d700 1 -- 172.21.15.38:0/1571494975 wait complete. 2023-07-11T00:00:47.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.156+0000 7f4e2521d700 1 Processor -- start 2023-07-11T00:00:47.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.156+0000 7f4e2521d700 1 -- start start 2023-07-11T00:00:47.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.156+0000 7f4e2521d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e20071a30 0x7f4e2013ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e2521d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e200b96b0 0x7f4e2013ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e2521d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e20141780 0x7f4e20137970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e2521d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2013b390 con 0x7f4e200b96b0 2023-07-11T00:00:47.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e2521d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2013c4e0 con 0x7f4e20071a30 2023-07-11T00:00:47.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e2521d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e20138510 con 0x7f4e20141780 2023-07-11T00:00:47.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1e59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e200b96b0 0x7f4e2013ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1e59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e200b96b0 0x7f4e2013ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41360/0 (socket says 172.21.15.38:41360) 2023-07-11T00:00:47.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1e59c700 1 -- 172.21.15.38:0/3009784327 learned_addr learned my addr 172.21.15.38:0/3009784327 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:47.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1f59e700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e20141780 0x7f4e20137970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1ed9d700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e20071a30 0x7f4e2013ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1e59c700 1 -- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e20141780 msgr2=0x7f4e20137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1e59c700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e20141780 0x7f4e20137970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1e59c700 1 -- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e20071a30 msgr2=0x7f4e2013ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1e59c700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e20071a30 0x7f4e2013ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1e59c700 1 -- 172.21.15.38:0/3009784327 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140094a0 con 0x7f4e200b96b0 2023-07-11T00:00:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1ed9d700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e20071a30 0x7f4e2013ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e1e59c700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e200b96b0 0x7f4e2013ba40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000c500 tx=0x7f4e1000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e077fe700 1 -- 172.21.15.38:0/3009784327 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10005d70 con 0x7f4e200b96b0 2023-07-11T00:00:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e077fe700 1 -- 172.21.15.38:0/3009784327 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e100070d0 con 0x7f4e200b96b0 2023-07-11T00:00:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e2521d700 1 -- 172.21.15.38:0/3009784327 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2013ca80 con 0x7f4e200b96b0 2023-07-11T00:00:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e077fe700 1 -- 172.21.15.38:0/3009784327 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10007460 con 0x7f4e200b96b0 2023-07-11T00:00:47.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.157+0000 7f4e2521d700 1 -- 172.21.15.38:0/3009784327 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2013ce10 con 0x7f4e200b96b0 2023-07-11T00:00:47.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.158+0000 7f4e2521d700 1 -- 172.21.15.38:0/3009784327 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2013d3e0 con 0x7f4e200b96b0 2023-07-11T00:00:47.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.159+0000 7f4e077fe700 1 -- 172.21.15.38:0/3009784327 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e100075c0 con 0x7f4e200b96b0 2023-07-11T00:00:47.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.159+0000 7f4e077fe700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4e0c06ace0 0x7f4e0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.159+0000 7f4e077fe700 1 -- 172.21.15.38:0/3009784327 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e100888a0 con 0x7f4e200b96b0 2023-07-11T00:00:47.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.159+0000 7f4e1ed9d700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4e0c06ace0 0x7f4e0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.160+0000 7f4e1ed9d700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4e0c06ace0 0x7f4e0c06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4e140090b0 tx=0x7f4e1401c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:47.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.164+0000 7f4e077fe700 1 -- 172.21.15.38:0/3009784327 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4e100539e0 con 0x7f4e200b96b0 2023-07-11T00:00:47.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.358+0000 7f4e2521d700 1 -- 172.21.15.38:0/3009784327 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e20074360 con 0x7f4e200b96b0 2023-07-11T00:00:47.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.358+0000 7f4e077fe700 1 -- 172.21.15.38:0/3009784327 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e10017020 con 0x7f4e200b96b0 2023-07-11T00:00:47.361 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-07-11T00:00:47.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 -- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4e0c06ace0 msgr2=0x7f4e0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4e0c06ace0 0x7f4e0c06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4e140090b0 tx=0x7f4e1401c040 comp rx=0 tx=0).stop 2023-07-11T00:00:47.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 -- 172.21.15.38:0/3009784327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e200b96b0 msgr2=0x7f4e2013ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e200b96b0 0x7f4e2013ba40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000c500 tx=0x7f4e1000c810 comp rx=0 tx=0).stop 2023-07-11T00:00:47.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 -- 172.21.15.38:0/3009784327 shutdown_connections 2023-07-11T00:00:47.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f4e0c06ace0 0x7f4e0c06d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e20141780 0x7f4e20137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e20071a30 0x7f4e2013ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 --2- 172.21.15.38:0/3009784327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e200b96b0 0x7f4e2013ba40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 -- 172.21.15.38:0/3009784327 >> 172.21.15.38:0/3009784327 conn(0x7f4e2006d0e0 msgr2=0x7f4e2006d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:47.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 -- 172.21.15.38:0/3009784327 shutdown_connections 2023-07-11T00:00:47.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.360+0000 7f4e2521d700 1 -- 172.21.15.38:0/3009784327 wait complete. 2023-07-11T00:00:47.375 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:00:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.501+0000 7f1e8a88d700 1 Processor -- start 2023-07-11T00:00:47.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.501+0000 7f1e8a88d700 1 -- start start 2023-07-11T00:00:47.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.502+0000 7f1e8a88d700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1e841449d0 0x7f1e8414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.502+0000 7f1e8a88d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e840b8620 con 0x7f1e840bc810 2023-07-11T00:00:47.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.502+0000 7f1e8a88d700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e840b8900 con 0x7f1e840b8d90 2023-07-11T00:00:47.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.502+0000 7f1e8a88d700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e840b97a0 con 0x7f1e841449d0 2023-07-11T00:00:47.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.502+0000 7f1e837fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1e840bc810 0x7f1e840ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58922/0 (socket says 172.21.15.38:58922) 2023-07-11T00:00:47.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.502+0000 7f1e837fe700 1 -- 172.21.15.38:0/2818433045 learned_addr learned my addr 172.21.15.38:0/2818433045 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:47.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.502+0000 7f1e83fff700 1 --2- 172.21.15.38:0/2818433045 >> v2:172.21.15.70:3300/0 conn(0x7f1e841449d0 0x7f1e8414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.502+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331300464 0 0) 0x7f1e840b8620 con 0x7f1e840bc810 2023-07-11T00:00:47.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.502+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e700035b0 con 0x7f1e840bc810 2023-07-11T00:00:47.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3567927785 0 0) 0x7f1e700035b0 con 0x7f1e840bc810 2023-07-11T00:00:47.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 >> v2:172.21.15.70:3300/0 conn(0x7f1e841449d0 msgr2=0x7f1e8414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:47.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 --2- 172.21.15.38:0/2818433045 >> v2:172.21.15.70:3300/0 conn(0x7f1e841449d0 0x7f1e8414db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 >> v1:172.21.15.70:6789/0 conn(0x7f1e840b8d90 legacy=0x7f1e8406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e840bac40 con 0x7f1e840bc810 2023-07-11T00:00:47.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f1e6c001670 con 0x7f1e840bc810 2023-07-11T00:00:47.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e83fff700 1 --2- 172.21.15.38:0/2818433045 >> v2:172.21.15.70:3300/0 conn(0x7f1e841449d0 0x7f1e8414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:47.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 >> v1:172.21.15.38:6789/0 conn(0x7f1e840bc810 legacy=0x7f1e840ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 --2- 172.21.15.38:0/2818433045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e70003a00 0x7f1e70003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 --2- 172.21.15.38:0/2818433045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e70004850 0x7f1e70004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 --2- 172.21.15.38:0/2818433045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e70005200 0x7f1e7000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840b97a0 con 0x7f1e70004850 2023-07-11T00:00:47.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7000c060 con 0x7f1e70003a00 2023-07-11T00:00:47.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7000c220 con 0x7f1e70005200 2023-07-11T00:00:47.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e837fe700 1 --2- 172.21.15.38:0/2818433045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e70004850 0x7f1e70004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e83fff700 1 --2- 172.21.15.38:0/2818433045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e70003a00 0x7f1e70003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e88e2a700 1 --2- 172.21.15.38:0/2818433045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e70005200 0x7f1e7000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e837fe700 1 -- 172.21.15.38:0/2818433045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e70005200 msgr2=0x7f1e7000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:47.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e837fe700 1 --2- 172.21.15.38:0/2818433045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e70005200 0x7f1e7000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e837fe700 1 -- 172.21.15.38:0/2818433045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e70003a00 msgr2=0x7f1e70003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:47.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e837fe700 1 --2- 172.21.15.38:0/2818433045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e70003a00 0x7f1e70003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e837fe700 1 -- 172.21.15.38:0/2818433045 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e700035b0 con 0x7f1e70004850 2023-07-11T00:00:47.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e88e2a700 1 -- 172.21.15.38:0/2818433045 reap_dead start 2023-07-11T00:00:47.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e837fe700 1 --2- 172.21.15.38:0/2818433045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e70004850 0x7f1e70004cc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00c240 tx=0x7f1e70005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440f6e2491d3d076 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:47.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c007c10 con 0x7f1e70004850 2023-07-11T00:00:47.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00ce00 con 0x7f1e70004850 2023-07-11T00:00:47.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.503+0000 7f1e82ffd700 1 -- 172.21.15.38:0/2818433045 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c005ba0 con 0x7f1e70004850 2023-07-11T00:00:47.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.504+0000 7f1e8a88d700 1 -- 172.21.15.38:0/2818433045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e70004850 msgr2=0x7f1e70004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.504+0000 7f1e8a88d700 1 --2- 172.21.15.38:0/2818433045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e70004850 0x7f1e70004cc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00c240 tx=0x7f1e70005880 comp rx=0 tx=0).stop 2023-07-11T00:00:47.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.504+0000 7f1e8a88d700 1 -- 172.21.15.38:0/2818433045 shutdown_connections 2023-07-11T00:00:47.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.504+0000 7f1e8a88d700 1 --2- 172.21.15.38:0/2818433045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e70004850 0x7f1e70004cc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.504+0000 7f1e8a88d700 1 -- 172.21.15.38:0/2818433045 >> 172.21.15.38:0/2818433045 conn(0x7f1e840c0860 msgr2=0x7f1e840c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:47.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.504+0000 7f1e8a88d700 1 -- 172.21.15.38:0/2818433045 shutdown_connections 2023-07-11T00:00:47.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.504+0000 7f1e8a88d700 1 -- 172.21.15.38:0/2818433045 wait complete. 2023-07-11T00:00:47.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.505+0000 7f1e8a88d700 1 Processor -- start 2023-07-11T00:00:47.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.506+0000 7f1e8a88d700 1 -- start start 2023-07-11T00:00:47.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.506+0000 7f1e8a88d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e70004850 0x7f1e8414a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.506+0000 7f1e8a88d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e841d3b50 0x7f1e841e37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.506+0000 7f1e8a88d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e840b3a50 0x7f1e841468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.506+0000 7f1e8a88d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8414a730 con 0x7f1e841d3b50 2023-07-11T00:00:47.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.506+0000 7f1e8a88d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8414b3b0 con 0x7f1e70004850 2023-07-11T00:00:47.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.506+0000 7f1e8a88d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e841e3360 con 0x7f1e840b3a50 2023-07-11T00:00:47.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e837fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e841d3b50 0x7f1e841e37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e837fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e841d3b50 0x7f1e841e37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41372/0 (socket says 172.21.15.38:41372) 2023-07-11T00:00:47.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e837fe700 1 -- 172.21.15.38:0/3834412835 learned_addr learned my addr 172.21.15.38:0/3834412835 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:47.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e83fff700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e70004850 0x7f1e8414a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e88e2a700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e840b3a50 0x7f1e841468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e837fe700 1 -- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e840b3a50 msgr2=0x7f1e841468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e837fe700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e840b3a50 0x7f1e841468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e837fe700 1 -- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e70004850 msgr2=0x7f1e8414a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e837fe700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e70004850 0x7f1e8414a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e837fe700 1 -- 172.21.15.38:0/3834412835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8414b0d0 con 0x7f1e841d3b50 2023-07-11T00:00:47.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e837fe700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e841d3b50 0x7f1e841e37f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00c830 tx=0x7f1e6c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:47.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e80ff9700 1 -- 172.21.15.38:0/3834412835 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c001630 con 0x7f1e841d3b50 2023-07-11T00:00:47.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e80ff9700 1 -- 172.21.15.38:0/3834412835 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c0070d0 con 0x7f1e841d3b50 2023-07-11T00:00:47.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e80ff9700 1 -- 172.21.15.38:0/3834412835 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c007480 con 0x7f1e841d3b50 2023-07-11T00:00:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e8a88d700 1 -- 172.21.15.38:0/3834412835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e841e2ff0 con 0x7f1e841d3b50 2023-07-11T00:00:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.507+0000 7f1e8a88d700 1 -- 172.21.15.38:0/3834412835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e841e3d30 con 0x7f1e841d3b50 2023-07-11T00:00:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.508+0000 7f1e8a88d700 1 -- 172.21.15.38:0/3834412835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e84074360 con 0x7f1e841d3b50 2023-07-11T00:00:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.509+0000 7f1e80ff9700 1 -- 172.21.15.38:0/3834412835 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e6c0075e0 con 0x7f1e841d3b50 2023-07-11T00:00:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.509+0000 7f1e80ff9700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1e6406ace0 0x7f1e6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.509+0000 7f1e80ff9700 1 -- 172.21.15.38:0/3834412835 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e6c08a600 con 0x7f1e841d3b50 2023-07-11T00:00:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.509+0000 7f1e83fff700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1e6406ace0 0x7f1e6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.510+0000 7f1e83fff700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1e6406ace0 0x7f1e6406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009e60 tx=0x7f1e74009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:47.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.514+0000 7f1e80ff9700 1 -- 172.21.15.38:0/3834412835 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1e6c0556c0 con 0x7f1e841d3b50 2023-07-11T00:00:47.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.709+0000 7f1e8a88d700 1 -- 172.21.15.38:0/3834412835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e840b4e40 con 0x7f1e841d3b50 2023-07-11T00:00:47.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.710+0000 7f1e80ff9700 1 -- 172.21.15.38:0/3834412835 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e6c058ce0 con 0x7f1e841d3b50 2023-07-11T00:00:47.713 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-07-11T00:00:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 -- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1e6406ace0 msgr2=0x7f1e6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1e6406ace0 0x7f1e6406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009e60 tx=0x7f1e74009210 comp rx=0 tx=0).stop 2023-07-11T00:00:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 -- 172.21.15.38:0/3834412835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e841d3b50 msgr2=0x7f1e841e37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e841d3b50 0x7f1e841e37f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00c830 tx=0x7f1e6c001a00 comp rx=0 tx=0).stop 2023-07-11T00:00:47.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 -- 172.21.15.38:0/3834412835 shutdown_connections 2023-07-11T00:00:47.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f1e6406ace0 0x7f1e6406d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e840b3a50 0x7f1e841468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e70004850 0x7f1e8414a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 --2- 172.21.15.38:0/3834412835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e841d3b50 0x7f1e841e37f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 -- 172.21.15.38:0/3834412835 >> 172.21.15.38:0/3834412835 conn(0x7f1e840c0860 msgr2=0x7f1e840be760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 -- 172.21.15.38:0/3834412835 shutdown_connections 2023-07-11T00:00:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.712+0000 7f1e8a88d700 1 -- 172.21.15.38:0/3834412835 wait complete. 2023-07-11T00:00:47.727 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-11T00:00:47.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.852+0000 7f47da743700 1 Processor -- start 2023-07-11T00:00:47.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.852+0000 7f47da743700 1 -- start start 2023-07-11T00:00:47.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.852+0000 7f47da743700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f47d4071d20 0x7f47d41458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.852+0000 7f47da743700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d40709c0 0x7f47d4145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.852+0000 7f47da743700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d4070130 con 0x7f47d414bf30 2023-07-11T00:00:47.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.852+0000 7f47da743700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d4146330 con 0x7f47d4071d20 2023-07-11T00:00:47.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.852+0000 7f47da743700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d4070f80 con 0x7f47d40709c0 2023-07-11T00:00:47.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.852+0000 7f47d37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f47d4071d20 0x7f47d41458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.852+0000 7f47d3fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f47d414bf30 0x7f47d40b8ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58936/0 (socket says 172.21.15.38:58936) 2023-07-11T00:00:47.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.852+0000 7f47d3fff700 1 -- 172.21.15.38:0/3770902675 learned_addr learned my addr 172.21.15.38:0/3770902675 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:47.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.853+0000 7f47d8ce0700 1 --2- 172.21.15.38:0/3770902675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d40709c0 0x7f47d4145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.853+0000 7f47d37fe700 1 -- 172.21.15.38:0/3770902675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d40709c0 msgr2=0x7f47d4145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:47.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.853+0000 7f47d37fe700 1 --2- 172.21.15.38:0/3770902675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d40709c0 0x7f47d4145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.853+0000 7f47d37fe700 1 -- 172.21.15.38:0/3770902675 >> v1:172.21.15.38:6789/0 conn(0x7f47d414bf30 legacy=0x7f47d40b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.853+0000 7f47d37fe700 1 -- 172.21.15.38:0/3770902675 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4071260 con 0x7f47d4071d20 2023-07-11T00:00:47.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.853+0000 7f47d8ce0700 1 --2- 172.21.15.38:0/3770902675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d40709c0 0x7f47d4145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:47.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.853+0000 7f47d37fe700 1 --2- 172.21.15.38:0/3770902675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d4071d20 0x7f47d41458b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009840 tx=0x7f47c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdde4771a0d8f48 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:47.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.853+0000 7f47d2ffd700 1 -- 172.21.15.38:0/3770902675 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8011830 con 0x7f47d4071d20 2023-07-11T00:00:47.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.853+0000 7f47d2ffd700 1 -- 172.21.15.38:0/3770902675 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c8011990 con 0x7f47d4071d20 2023-07-11T00:00:47.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.853+0000 7f47d2ffd700 1 -- 172.21.15.38:0/3770902675 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8011d20 con 0x7f47d4071d20 2023-07-11T00:00:47.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.854+0000 7f47da743700 1 -- 172.21.15.38:0/3770902675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d4071d20 msgr2=0x7f47d41458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.854+0000 7f47da743700 1 --2- 172.21.15.38:0/3770902675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d4071d20 0x7f47d41458b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009840 tx=0x7f47c8009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:47.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.854+0000 7f47da743700 1 -- 172.21.15.38:0/3770902675 shutdown_connections 2023-07-11T00:00:47.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.854+0000 7f47da743700 1 --2- 172.21.15.38:0/3770902675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d40709c0 0x7f47d4145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.854+0000 7f47da743700 1 --2- 172.21.15.38:0/3770902675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d4071d20 0x7f47d41458b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.854+0000 7f47da743700 1 -- 172.21.15.38:0/3770902675 >> 172.21.15.38:0/3770902675 conn(0x7f47d40be670 msgr2=0x7f47d40bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:47.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.854+0000 7f47da743700 1 -- 172.21.15.38:0/3770902675 shutdown_connections 2023-07-11T00:00:47.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.854+0000 7f47da743700 1 -- 172.21.15.38:0/3770902675 wait complete. 2023-07-11T00:00:47.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.855+0000 7f47da743700 1 Processor -- start 2023-07-11T00:00:47.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.855+0000 7f47da743700 1 -- start start 2023-07-11T00:00:47.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47da743700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d40709c0 0x7f47d40b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47da743700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d4071d20 0x7f47d40b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47da743700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47d414bf30 0x7f47d41466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47da743700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40b8790 con 0x7f47d40709c0 2023-07-11T00:00:47.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47da743700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40b26f0 con 0x7f47d414bf30 2023-07-11T00:00:47.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47da743700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40b4b30 con 0x7f47d4071d20 2023-07-11T00:00:47.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d40709c0 0x7f47d40b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d40709c0 0x7f47d40b8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41402/0 (socket says 172.21.15.38:41402) 2023-07-11T00:00:47.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d3fff700 1 -- 172.21.15.38:0/854331541 learned_addr learned my addr 172.21.15.38:0/854331541 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:47.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d37fe700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d4071d20 0x7f47d40b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d8ce0700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47d414bf30 0x7f47d41466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d3fff700 1 -- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d4071d20 msgr2=0x7f47d40b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d3fff700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d4071d20 0x7f47d40b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d3fff700 1 -- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47d414bf30 msgr2=0x7f47d41466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:47.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d3fff700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47d414bf30 0x7f47d41466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:47.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d3fff700 1 -- 172.21.15.38:0/854331541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80094a0 con 0x7f47d40709c0 2023-07-11T00:00:47.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d8ce0700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47d414bf30 0x7f47d41466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:47.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d37fe700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d4071d20 0x7f47d40b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:47.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d3fff700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d40709c0 0x7f47d40b8250 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f47c400c480 tx=0x7f47c400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:47.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d0ff9700 1 -- 172.21.15.38:0/854331541 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4005d70 con 0x7f47d40709c0 2023-07-11T00:00:47.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d0ff9700 1 -- 172.21.15.38:0/854331541 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c40070d0 con 0x7f47d40709c0 2023-07-11T00:00:47.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47d0ff9700 1 -- 172.21.15.38:0/854331541 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4007440 con 0x7f47d40709c0 2023-07-11T00:00:47.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47da743700 1 -- 172.21.15.38:0/854331541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d40b4e70 con 0x7f47d40709c0 2023-07-11T00:00:47.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.856+0000 7f47da743700 1 -- 172.21.15.38:0/854331541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d40b1540 con 0x7f47d40709c0 2023-07-11T00:00:47.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.857+0000 7f47da743700 1 -- 172.21.15.38:0/854331541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d40b5290 con 0x7f47d40709c0 2023-07-11T00:00:47.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.858+0000 7f47d0ff9700 1 -- 172.21.15.38:0/854331541 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f47c40075a0 con 0x7f47d40709c0 2023-07-11T00:00:47.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.858+0000 7f47d0ff9700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f47c006ad10 0x7f47c006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:47.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.858+0000 7f47d0ff9700 1 -- 172.21.15.38:0/854331541 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47c40888e0 con 0x7f47d40709c0 2023-07-11T00:00:47.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.858+0000 7f47d37fe700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f47c006ad10 0x7f47c006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:47.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.859+0000 7f47d37fe700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f47c006ad10 0x7f47c006d1c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f47d4140fc0 tx=0x7f47c8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:47.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:47.863+0000 7f47d0ff9700 1 -- 172.21.15.38:0/854331541 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f47d40b5290 con 0x7f47d40709c0 2023-07-11T00:00:48.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.072+0000 7f47da743700 1 -- 172.21.15.38:0/854331541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f47d40b5290 con 0x7f47d40709c0 2023-07-11T00:00:48.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.073+0000 7f47d0ff9700 1 -- 172.21.15.38:0/854331541 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f47d40b5290 con 0x7f47d40709c0 2023-07-11T00:00:48.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 -- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f47c006ad10 msgr2=0x7f47c006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f47c006ad10 0x7f47c006d1c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f47d4140fc0 tx=0x7f47c8008030 comp rx=0 tx=0).stop 2023-07-11T00:00:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 -- 172.21.15.38:0/854331541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d40709c0 msgr2=0x7f47d40b8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d40709c0 0x7f47d40b8250 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f47c400c480 tx=0x7f47c400c840 comp rx=0 tx=0).stop 2023-07-11T00:00:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 -- 172.21.15.38:0/854331541 shutdown_connections 2023-07-11T00:00:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f47c006ad10 0x7f47c006d1c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47d414bf30 0x7f47d41466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d40709c0 0x7f47d40b8250 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 --2- 172.21.15.38:0/854331541 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47d4071d20 0x7f47d40b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 -- 172.21.15.38:0/854331541 >> 172.21.15.38:0/854331541 conn(0x7f47d40be670 msgr2=0x7f47d4145140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 -- 172.21.15.38:0/854331541 shutdown_connections 2023-07-11T00:00:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.075+0000 7f47da743700 1 -- 172.21.15.38:0/854331541 wait complete. 2023-07-11T00:00:48.079 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-07-11T00:00:48.090 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-11T00:00:48.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:48.091 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-11T00:00:48.182 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-07-11T00:00:48.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:00:48.183 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-11T00:00:48.243 INFO:tasks.cephfs.cephfs_test_case:[] 2023-07-11T00:00:48.244 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:00:48.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.368+0000 7fa9017f8700 1 Processor -- start 2023-07-11T00:00:48.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.368+0000 7fa9017f8700 1 -- start start 2023-07-11T00:00:48.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa9017f8700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 0x7fa8fc14b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa9017f8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa8fc070da0 0x7fa8fc06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa9017f8700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8fc070130 con 0x7fa8fc06cd00 2023-07-11T00:00:48.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa9017f8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8fc071540 con 0x7fa8fc070da0 2023-07-11T00:00:48.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa9017f8700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc071260 con 0x7fa8fc071910 2023-07-11T00:00:48.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa8fa7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa8fc070da0 0x7fa8fc06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa8fa7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa8fc070da0 0x7fa8fc06c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41414/0 (socket says 172.21.15.38:41414) 2023-07-11T00:00:48.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa8fa7fc700 1 -- 172.21.15.38:0/124537917 learned_addr learned my addr 172.21.15.38:0/124537917 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:48.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa8faffd700 1 --2- 172.21.15.38:0/124537917 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 0x7fa8fc14b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa8fa7fc700 1 -- 172.21.15.38:0/124537917 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 msgr2=0x7fa8fc14b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:48.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa8fa7fc700 1 --2- 172.21.15.38:0/124537917 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 0x7fa8fc14b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa8fa7fc700 1 -- 172.21.15.38:0/124537917 >> v1:172.21.15.70:6789/0 conn(0x7fa8fc06cd00 legacy=0x7fa8fc14de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:48.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa8fa7fc700 1 -- 172.21.15.38:0/124537917 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc14aa60 con 0x7fa8fc070da0 2023-07-11T00:00:48.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa8faffd700 1 --2- 172.21.15.38:0/124537917 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 0x7fa8fc14b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:48.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa8fa7fc700 1 --2- 172.21.15.38:0/124537917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc070da0 0x7fa8fc06c7c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40098f0 tx=0x7fa8e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d373558f27d30b server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:48.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.369+0000 7fa8f9ffb700 1 -- 172.21.15.38:0/124537917 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4004230 con 0x7fa8fc070da0 2023-07-11T00:00:48.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.370+0000 7fa8f9ffb700 1 -- 172.21.15.38:0/124537917 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4004390 con 0x7fa8fc070da0 2023-07-11T00:00:48.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.370+0000 7fa8f9ffb700 1 -- 172.21.15.38:0/124537917 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e40036a0 con 0x7fa8fc070da0 2023-07-11T00:00:48.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.370+0000 7fa9017f8700 1 -- 172.21.15.38:0/124537917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc070da0 msgr2=0x7fa8fc06c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.370+0000 7fa9017f8700 1 --2- 172.21.15.38:0/124537917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc070da0 0x7fa8fc06c7c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40098f0 tx=0x7fa8e4009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:48.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.370+0000 7fa9017f8700 1 -- 172.21.15.38:0/124537917 shutdown_connections 2023-07-11T00:00:48.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.370+0000 7fa9017f8700 1 --2- 172.21.15.38:0/124537917 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 0x7fa8fc14b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.370+0000 7fa9017f8700 1 --2- 172.21.15.38:0/124537917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc070da0 0x7fa8fc06c7c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.370+0000 7fa9017f8700 1 -- 172.21.15.38:0/124537917 >> 172.21.15.38:0/124537917 conn(0x7fa8fc0be670 msgr2=0x7fa8fc0bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:48.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.370+0000 7fa9017f8700 1 -- 172.21.15.38:0/124537917 shutdown_connections 2023-07-11T00:00:48.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.370+0000 7fa9017f8700 1 -- 172.21.15.38:0/124537917 wait complete. 2023-07-11T00:00:48.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.372+0000 7fa9017f8700 1 Processor -- start 2023-07-11T00:00:48.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.372+0000 7fa9017f8700 1 -- start start 2023-07-11T00:00:48.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa9017f8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8fc06cd00 0x7fa8fc14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa9017f8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc070da0 0x7fa8fc1e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa9017f8700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 0x7fa8fc1e14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa9017f8700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc1e3bd0 con 0x7fa8fc070da0 2023-07-11T00:00:48.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa9017f8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc1d6770 con 0x7fa8fc06cd00 2023-07-11T00:00:48.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa9017f8700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc1d5b60 con 0x7fa8fc071910 2023-07-11T00:00:48.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8fa7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc070da0 0x7fa8fc1e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8fa7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc070da0 0x7fa8fc1e3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41426/0 (socket says 172.21.15.38:41426) 2023-07-11T00:00:48.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8fa7fc700 1 -- 172.21.15.38:0/3459695064 learned_addr learned my addr 172.21.15.38:0/3459695064 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:48.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8fb7fe700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 0x7fa8fc1e14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8faffd700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8fc06cd00 0x7fa8fc14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8fa7fc700 1 -- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 msgr2=0x7fa8fc1e14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8fa7fc700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 0x7fa8fc1e14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8fa7fc700 1 -- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8fc06cd00 msgr2=0x7fa8fc14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8fa7fc700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8fc06cd00 0x7fa8fc14e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8fa7fc700 1 -- 172.21.15.38:0/3459695064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e4009550 con 0x7fa8fc070da0 2023-07-11T00:00:48.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8fb7fe700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 0x7fa8fc1e14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:48.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8fa7fc700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc070da0 0x7fa8fc1e3690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4004000 tx=0x7fa8e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:48.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8f37fe700 1 -- 172.21.15.38:0/3459695064 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4003e70 con 0x7fa8fc070da0 2023-07-11T00:00:48.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8f37fe700 1 -- 172.21.15.38:0/3459695064 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e401f070 con 0x7fa8fc070da0 2023-07-11T00:00:48.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa9017f8700 1 -- 172.21.15.38:0/3459695064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8fc1d4ed0 con 0x7fa8fc070da0 2023-07-11T00:00:48.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa8f37fe700 1 -- 172.21.15.38:0/3459695064 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400b8c0 con 0x7fa8fc070da0 2023-07-11T00:00:48.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.373+0000 7fa9017f8700 1 -- 172.21.15.38:0/3459695064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8fc1e41f0 con 0x7fa8fc070da0 2023-07-11T00:00:48.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.374+0000 7fa9017f8700 1 -- 172.21.15.38:0/3459695064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8fc1e4380 con 0x7fa8fc070da0 2023-07-11T00:00:48.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.375+0000 7fa8f37fe700 1 -- 172.21.15.38:0/3459695064 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8e4021030 con 0x7fa8fc070da0 2023-07-11T00:00:48.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.375+0000 7fa8f37fe700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa8dc06ace0 0x7fa8dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.375+0000 7fa8f37fe700 1 -- 172.21.15.38:0/3459695064 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8e408ab80 con 0x7fa8fc070da0 2023-07-11T00:00:48.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.375+0000 7fa8faffd700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa8dc06ace0 0x7fa8dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.376+0000 7fa8faffd700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa8dc06ace0 0x7fa8dc06d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4008ee0 tx=0x7fa8f4008430 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:48.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.380+0000 7fa8f37fe700 1 -- 172.21.15.38:0/3459695064 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa8e4055d50 con 0x7fa8fc070da0 2023-07-11T00:00:48.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.622+0000 7fa9017f8700 1 -- 172.21.15.38:0/3459695064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8fc1e4380 con 0x7fa8fc070da0 2023-07-11T00:00:48.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.623+0000 7fa8f37fe700 1 -- 172.21.15.38:0/3459695064 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3909 (secure 0 0 0) 0x7fa8e4059370 con 0x7fa8fc070da0 2023-07-11T00:00:48.626 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:48.627 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3612343661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3612343661},{"type":"v1","addr":"172.21.15.38:6834","nonce":3612343661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3097729806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3097729806},{"type":"v1","addr":"172.21.15.70:6835","nonce":3097729806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:00:16.787420+0000","modified":"2023-07-11T00:00:19.806642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3594015619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3594015619},{"type":"v1","addr":"172.21.15.38:6835","nonce":3594015619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:00:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 -- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa8dc06ace0 msgr2=0x7fa8dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa8dc06ace0 0x7fa8dc06d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4008ee0 tx=0x7fa8f4008430 comp rx=0 tx=0).stop 2023-07-11T00:00:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 -- 172.21.15.38:0/3459695064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc070da0 msgr2=0x7fa8fc1e3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc070da0 0x7fa8fc1e3690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4004000 tx=0x7fa8e4004750 comp rx=0 tx=0).stop 2023-07-11T00:00:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 -- 172.21.15.38:0/3459695064 shutdown_connections 2023-07-11T00:00:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa8dc06ace0 0x7fa8dc06d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8fc071910 0x7fa8fc1e14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8fc06cd00 0x7fa8fc14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 --2- 172.21.15.38:0/3459695064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc070da0 0x7fa8fc1e3690 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 -- 172.21.15.38:0/3459695064 >> 172.21.15.38:0/3459695064 conn(0x7fa8fc0be670 msgr2=0x7fa8fc149e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:48.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 -- 172.21.15.38:0/3459695064 shutdown_connections 2023-07-11T00:00:48.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.625+0000 7fa9017f8700 1 -- 172.21.15.38:0/3459695064 wait complete. 2023-07-11T00:00:48.630 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 7 2023-07-11T00:00:48.640 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:48.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.764+0000 7fc646362700 1 Processor -- start 2023-07-11T00:00:48.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.764+0000 7fc646362700 1 -- start start 2023-07-11T00:00:48.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.765+0000 7fc646362700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc640071ab0 0x7fc64006edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.765+0000 7fc646362700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc64006f340 0x7fc640146b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc646362700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6400b93e0 con 0x7fc64006b120 2023-07-11T00:00:48.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc646362700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc640071690 con 0x7fc64006f340 2023-07-11T00:00:48.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc646362700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64006fe90 con 0x7fc640071ab0 2023-07-11T00:00:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc6448ff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc64006f340 0x7fc640146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc6448ff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc64006f340 0x7fc640146b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41436/0 (socket says 172.21.15.38:41436) 2023-07-11T00:00:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc6448ff700 1 -- 172.21.15.38:0/3829245214 learned_addr learned my addr 172.21.15.38:0/3829245214 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc63f7fe700 1 --2- 172.21.15.38:0/3829245214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc640071ab0 0x7fc64006edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc6448ff700 1 -- 172.21.15.38:0/3829245214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc640071ab0 msgr2=0x7fc64006edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc6448ff700 1 --2- 172.21.15.38:0/3829245214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc640071ab0 0x7fc64006edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc6448ff700 1 -- 172.21.15.38:0/3829245214 >> v1:172.21.15.70:6789/0 conn(0x7fc64006b120 legacy=0x7fc640140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc6448ff700 1 -- 172.21.15.38:0/3829245214 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc640147060 con 0x7fc64006f340 2023-07-11T00:00:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc6448ff700 1 --2- 172.21.15.38:0/3829245214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc64006f340 0x7fc640146b20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc638009e50 tx=0x7fc63800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a5e75da55c73b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc63effd700 1 -- 172.21.15.38:0/3829245214 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63800e070 con 0x7fc64006f340 2023-07-11T00:00:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc63effd700 1 -- 172.21.15.38:0/3829245214 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc638003a20 con 0x7fc64006f340 2023-07-11T00:00:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.766+0000 7fc63effd700 1 -- 172.21.15.38:0/3829245214 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638003dd0 con 0x7fc64006f340 2023-07-11T00:00:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.767+0000 7fc646362700 1 -- 172.21.15.38:0/3829245214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc64006f340 msgr2=0x7fc640146b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.767+0000 7fc646362700 1 --2- 172.21.15.38:0/3829245214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc64006f340 0x7fc640146b20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc638009e50 tx=0x7fc63800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.767+0000 7fc646362700 1 -- 172.21.15.38:0/3829245214 shutdown_connections 2023-07-11T00:00:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.767+0000 7fc646362700 1 --2- 172.21.15.38:0/3829245214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc64006f340 0x7fc640146b20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.767+0000 7fc646362700 1 --2- 172.21.15.38:0/3829245214 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc640071ab0 0x7fc64006edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.767+0000 7fc646362700 1 -- 172.21.15.38:0/3829245214 >> 172.21.15.38:0/3829245214 conn(0x7fc6400bd980 msgr2=0x7fc6400b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.767+0000 7fc646362700 1 -- 172.21.15.38:0/3829245214 shutdown_connections 2023-07-11T00:00:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.767+0000 7fc646362700 1 -- 172.21.15.38:0/3829245214 wait complete. 2023-07-11T00:00:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.768+0000 7fc646362700 1 Processor -- start 2023-07-11T00:00:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.768+0000 7fc646362700 1 -- start start 2023-07-11T00:00:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc646362700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc64006b120 0x7fc640141410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc646362700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc64006f340 0x7fc640143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc646362700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc640071ab0 0x7fc6400b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc646362700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc640144500 con 0x7fc640071ab0 2023-07-11T00:00:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc646362700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc640141a70 con 0x7fc64006b120 2023-07-11T00:00:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc646362700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6401d0d80 con 0x7fc64006f340 2023-07-11T00:00:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc6448ff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc640071ab0 0x7fc6400b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc6448ff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc640071ab0 0x7fc6400b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41452/0 (socket says 172.21.15.38:41452) 2023-07-11T00:00:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc6448ff700 1 -- 172.21.15.38:0/1285427467 learned_addr learned my addr 172.21.15.38:0/1285427467 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc63f7fe700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc64006f340 0x7fc640143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc63ffff700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc64006b120 0x7fc640141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc6448ff700 1 -- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc64006f340 msgr2=0x7fc640143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc6448ff700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc64006f340 0x7fc640143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc6448ff700 1 -- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc64006b120 msgr2=0x7fc640141410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc6448ff700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc64006b120 0x7fc640141410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc6448ff700 1 -- 172.21.15.38:0/1285427467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc638009b30 con 0x7fc640071ab0 2023-07-11T00:00:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc63ffff700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc64006b120 0x7fc640141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc6448ff700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc640071ab0 0x7fc6400b2b70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc638015040 tx=0x7fc638004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.769+0000 7fc63cff9700 1 -- 172.21.15.38:0/1285427467 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638004440 con 0x7fc640071ab0 2023-07-11T00:00:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.770+0000 7fc63cff9700 1 -- 172.21.15.38:0/1285427467 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6380045c0 con 0x7fc640071ab0 2023-07-11T00:00:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.770+0000 7fc646362700 1 -- 172.21.15.38:0/1285427467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6401d1060 con 0x7fc640071ab0 2023-07-11T00:00:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.770+0000 7fc63cff9700 1 -- 172.21.15.38:0/1285427467 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638004970 con 0x7fc640071ab0 2023-07-11T00:00:48.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.770+0000 7fc646362700 1 -- 172.21.15.38:0/1285427467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6400b6450 con 0x7fc640071ab0 2023-07-11T00:00:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.770+0000 7fc646362700 1 -- 172.21.15.38:0/1285427467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64004e210 con 0x7fc640071ab0 2023-07-11T00:00:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.771+0000 7fc63cff9700 1 -- 172.21.15.38:0/1285427467 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc638025450 con 0x7fc640071ab0 2023-07-11T00:00:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.772+0000 7fc63cff9700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc62c06ace0 0x7fc62c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.772+0000 7fc63cff9700 1 -- 172.21.15.38:0/1285427467 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc63808ac30 con 0x7fc640071ab0 2023-07-11T00:00:48.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.772+0000 7fc63ffff700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc62c06ace0 0x7fc62c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:48.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.772+0000 7fc63ffff700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc62c06ace0 0x7fc62c06d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc6300017b0 tx=0x7fc630009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:48.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.776+0000 7fc63cff9700 1 -- 172.21.15.38:0/1285427467 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc6380597c0 con 0x7fc640071ab0 2023-07-11T00:00:48.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.971+0000 7fc646362700 1 -- 172.21.15.38:0/1285427467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc640074360 con 0x7fc640071ab0 2023-07-11T00:00:48.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.973+0000 7fc63cff9700 1 -- 172.21.15.38:0/1285427467 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7fc638017090 con 0x7fc640071ab0 2023-07-11T00:00:48.976 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:48.977 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:48.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 -- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc62c06ace0 msgr2=0x7fc62c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc62c06ace0 0x7fc62c06d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc6300017b0 tx=0x7fc630009040 comp rx=0 tx=0).stop 2023-07-11T00:00:48.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 -- 172.21.15.38:0/1285427467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc640071ab0 msgr2=0x7fc6400b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:48.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc640071ab0 0x7fc6400b2b70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc638015040 tx=0x7fc638004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 -- 172.21.15.38:0/1285427467 shutdown_connections 2023-07-11T00:00:48.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc62c06ace0 0x7fc62c06d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc640071ab0 0x7fc6400b2b70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc64006b120 0x7fc640141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 --2- 172.21.15.38:0/1285427467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc64006f340 0x7fc640143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:48.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 -- 172.21.15.38:0/1285427467 >> 172.21.15.38:0/1285427467 conn(0x7fc6400bd980 msgr2=0x7fc64013fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:48.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 -- 172.21.15.38:0/1285427467 shutdown_connections 2023-07-11T00:00:48.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:48.975+0000 7fc646362700 1 -- 172.21.15.38:0/1285427467 wait complete. 2023-07-11T00:00:48.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:00:14.572121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:00:15.763698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:00:48.991 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:00:49.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.117+0000 7f5369dde700 1 Processor -- start 2023-07-11T00:00:49.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.117+0000 7f5369dde700 1 -- start start 2023-07-11T00:00:49.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f5369dde700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53641449d0 0x7f536414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f5369dde700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 0x7f53640ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f5369dde700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53640b8620 con 0x7f53640b8d90 2023-07-11T00:00:49.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f5369dde700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53640b97a0 con 0x7f53641449d0 2023-07-11T00:00:49.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f5369dde700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5364144da0 con 0x7f53640bc810 2023-07-11T00:00:49.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53637fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53641449d0 0x7f536414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53637fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53641449d0 0x7f536414db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41460/0 (socket says 172.21.15.38:41460) 2023-07-11T00:00:49.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53637fe700 1 -- 172.21.15.38:0/918444511 learned_addr learned my addr 172.21.15.38:0/918444511 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:49.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f5363fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f53640b8d90 0x7f536406ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58948/0 (socket says 172.21.15.38:58948) 2023-07-11T00:00:49.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f5362ffd700 1 --2- 172.21.15.38:0/918444511 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 0x7f53640ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53637fe700 1 -- 172.21.15.38:0/918444511 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 msgr2=0x7f53640ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:49.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53637fe700 1 --2- 172.21.15.38:0/918444511 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 0x7f53640ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53637fe700 1 -- 172.21.15.38:0/918444511 >> v1:172.21.15.38:6789/0 conn(0x7f53640b8d90 legacy=0x7f536406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53637fe700 1 -- 172.21.15.38:0/918444511 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53640b8900 con 0x7f53641449d0 2023-07-11T00:00:49.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53627fc700 1 -- 172.21.15.38:0/918444511 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417770069 0 0) 0x7f53640b8620 con 0x7f53640b8d90 2023-07-11T00:00:49.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f5362ffd700 1 --2- 172.21.15.38:0/918444511 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 0x7f53640ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:49.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53637fe700 1 --2- 172.21.15.38:0/918444511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53641449d0 0x7f536414db50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5354009e50 tx=0x7f535400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41237a05fbf0263 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:49.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53627fc700 1 -- 172.21.15.38:0/918444511 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400e070 con 0x7f53641449d0 2023-07-11T00:00:49.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53627fc700 1 -- 172.21.15.38:0/918444511 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535400b9c0 con 0x7f53641449d0 2023-07-11T00:00:49.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.118+0000 7f53627fc700 1 -- 172.21.15.38:0/918444511 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400bd70 con 0x7f53641449d0 2023-07-11T00:00:49.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.119+0000 7f5369dde700 1 -- 172.21.15.38:0/918444511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53641449d0 msgr2=0x7f536414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.119+0000 7f5369dde700 1 --2- 172.21.15.38:0/918444511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53641449d0 0x7f536414db50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5354009e50 tx=0x7f535400b330 comp rx=0 tx=0).stop 2023-07-11T00:00:49.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.119+0000 7f5369dde700 1 -- 172.21.15.38:0/918444511 shutdown_connections 2023-07-11T00:00:49.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.119+0000 7f5369dde700 1 --2- 172.21.15.38:0/918444511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53641449d0 0x7f536414db50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.119+0000 7f5369dde700 1 --2- 172.21.15.38:0/918444511 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 0x7f53640ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.119+0000 7f5369dde700 1 -- 172.21.15.38:0/918444511 >> 172.21.15.38:0/918444511 conn(0x7f53640c0860 msgr2=0x7f53640c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:49.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.119+0000 7f5369dde700 1 -- 172.21.15.38:0/918444511 shutdown_connections 2023-07-11T00:00:49.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.119+0000 7f5369dde700 1 -- 172.21.15.38:0/918444511 wait complete. 2023-07-11T00:00:49.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.120+0000 7f5369dde700 1 Processor -- start 2023-07-11T00:00:49.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.121+0000 7f5369dde700 1 -- start start 2023-07-11T00:00:49.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.121+0000 7f5369dde700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53640b8d90 0x7f53641df530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.121+0000 7f5369dde700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 0x7f53640a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.121+0000 7f5369dde700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53641449d0 0x7f53640a3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5369dde700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53640a6430 con 0x7f53641449d0 2023-07-11T00:00:49.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5369dde700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53640a3ba0 con 0x7f53640b8d90 2023-07-11T00:00:49.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5369dde700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53640a16f0 con 0x7f53640bc810 2023-07-11T00:00:49.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5363fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53641449d0 0x7f53640a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5363fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53641449d0 0x7f53640a3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41468/0 (socket says 172.21.15.38:41468) 2023-07-11T00:00:49.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5363fff700 1 -- 172.21.15.38:0/2811213795 learned_addr learned my addr 172.21.15.38:0/2811213795 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:49.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5362ffd700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 0x7f53640a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f53637fe700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53640b8d90 0x7f53641df530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5363fff700 1 -- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 msgr2=0x7f53640a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5363fff700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 0x7f53640a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5363fff700 1 -- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53640b8d90 msgr2=0x7f53641df530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5363fff700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53640b8d90 0x7f53641df530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5363fff700 1 -- 172.21.15.38:0/2811213795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5354009b30 con 0x7f53641449d0 2023-07-11T00:00:49.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5362ffd700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 0x7f53640a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:49.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5363fff700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53641449d0 0x7f53640a3370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f535c0011e0 tx=0x7f535c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:49.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f534bfff700 1 -- 172.21.15.38:0/2811213795 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c004c80 con 0x7f53641449d0 2023-07-11T00:00:49.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f534bfff700 1 -- 172.21.15.38:0/2811213795 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c004de0 con 0x7f53641449d0 2023-07-11T00:00:49.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f534bfff700 1 -- 172.21.15.38:0/2811213795 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c0072d0 con 0x7f53641449d0 2023-07-11T00:00:49.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5369dde700 1 -- 172.21.15.38:0/2811213795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53640a24f0 con 0x7f53641449d0 2023-07-11T00:00:49.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.122+0000 7f5369dde700 1 -- 172.21.15.38:0/2811213795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53640a38b0 con 0x7f53641449d0 2023-07-11T00:00:49.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.123+0000 7f5369dde700 1 -- 172.21.15.38:0/2811213795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53640a18f0 con 0x7f53641449d0 2023-07-11T00:00:49.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.124+0000 7f534bfff700 1 -- 172.21.15.38:0/2811213795 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f535c007430 con 0x7f53641449d0 2023-07-11T00:00:49.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.124+0000 7f534bfff700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f535006ace0 0x7f535006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.124+0000 7f534bfff700 1 -- 172.21.15.38:0/2811213795 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f535c0891c0 con 0x7f53641449d0 2023-07-11T00:00:49.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.124+0000 7f53637fe700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f535006ace0 0x7f535006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.125+0000 7f53637fe700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f535006ace0 0x7f535006d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5354000f80 tx=0x7f5354009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:49.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.129+0000 7f534bfff700 1 -- 172.21.15.38:0/2811213795 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f53640a18f0 con 0x7f53641449d0 2023-07-11T00:00:49.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.322+0000 7f5369dde700 1 -- 172.21.15.38:0/2811213795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f53640a18c0 con 0x7f53641449d0 2023-07-11T00:00:49.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.322+0000 7f534bfff700 1 -- 172.21.15.38:0/2811213795 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f535c054280 con 0x7f53641449d0 2023-07-11T00:00:49.325 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:00:49.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 -- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f535006ace0 msgr2=0x7f535006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f535006ace0 0x7f535006d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5354000f80 tx=0x7f5354009000 comp rx=0 tx=0).stop 2023-07-11T00:00:49.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 -- 172.21.15.38:0/2811213795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53641449d0 msgr2=0x7f53640a3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53641449d0 0x7f53640a3370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f535c0011e0 tx=0x7f535c00c8b0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 -- 172.21.15.38:0/2811213795 shutdown_connections 2023-07-11T00:00:49.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f535006ace0 0x7f535006d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53641449d0 0x7f53640a3370 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53640b8d90 0x7f53641df530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 --2- 172.21.15.38:0/2811213795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f53640bc810 0x7f53640a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 -- 172.21.15.38:0/2811213795 >> 172.21.15.38:0/2811213795 conn(0x7f53640c0860 msgr2=0x7f5364143bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:49.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 -- 172.21.15.38:0/2811213795 shutdown_connections 2023-07-11T00:00:49.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.324+0000 7f5369dde700 1 -- 172.21.15.38:0/2811213795 wait complete. 2023-07-11T00:00:49.339 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:00:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.468+0000 7f564d563700 1 Processor -- start 2023-07-11T00:00:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.468+0000 7f564d563700 1 -- start start 2023-07-11T00:00:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f564d563700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5648147c00 0x7f56480b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f564d563700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5648071b60 0x7f56480b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f564d563700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480b3bd0 con 0x7f564806b120 2023-07-11T00:00:49.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f564d563700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5648070800 con 0x7f5648071b60 2023-07-11T00:00:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f564d563700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5648141c90 con 0x7f5648147c00 2023-07-11T00:00:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f5646ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f564806b120 0x7f56481474f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58952/0 (socket says 172.21.15.38:58952) 2023-07-11T00:00:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f56477fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5648071b60 0x7f56480b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f5646ffd700 1 -- 172.21.15.38:0/2390007192 learned_addr learned my addr 172.21.15.38:0/2390007192 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f563e7fc700 1 --2- 172.21.15.38:0/2390007192 >> v2:172.21.15.70:3300/0 conn(0x7f5648147c00 0x7f56480b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f56477fe700 1 -- 172.21.15.38:0/2390007192 >> v2:172.21.15.70:3300/0 conn(0x7f5648147c00 msgr2=0x7f56480b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f56477fe700 1 --2- 172.21.15.38:0/2390007192 >> v2:172.21.15.70:3300/0 conn(0x7f5648147c00 0x7f56480b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.469+0000 7f56477fe700 1 -- 172.21.15.38:0/2390007192 >> v1:172.21.15.38:6789/0 conn(0x7f564806b120 legacy=0x7f56481474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f56477fe700 1 -- 172.21.15.38:0/2390007192 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56480714d0 con 0x7f5648071b60 2023-07-11T00:00:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f56467fc700 1 -- 172.21.15.38:0/2390007192 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978092584 0 0) 0x7f56480b3bd0 con 0x7f564806b120 2023-07-11T00:00:49.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f56477fe700 1 --2- 172.21.15.38:0/2390007192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5648071b60 0x7f56480b6970 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f564806e4f0 tx=0x7f564000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24389c447054e1c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:49.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f56467fc700 1 -- 172.21.15.38:0/2390007192 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564000e070 con 0x7f5648071b60 2023-07-11T00:00:49.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f56467fc700 1 -- 172.21.15.38:0/2390007192 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564000bb90 con 0x7f5648071b60 2023-07-11T00:00:49.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f56467fc700 1 -- 172.21.15.38:0/2390007192 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640012430 con 0x7f5648071b60 2023-07-11T00:00:49.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f564d563700 1 -- 172.21.15.38:0/2390007192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5648071b60 msgr2=0x7f56480b6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f564d563700 1 --2- 172.21.15.38:0/2390007192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5648071b60 0x7f56480b6970 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f564806e4f0 tx=0x7f564000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:49.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f564d563700 1 -- 172.21.15.38:0/2390007192 shutdown_connections 2023-07-11T00:00:49.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f564d563700 1 --2- 172.21.15.38:0/2390007192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5648071b60 0x7f56480b6970 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f564d563700 1 --2- 172.21.15.38:0/2390007192 >> v2:172.21.15.70:3300/0 conn(0x7f5648147c00 0x7f56480b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f564d563700 1 -- 172.21.15.38:0/2390007192 >> 172.21.15.38:0/2390007192 conn(0x7f56480bd980 msgr2=0x7f56480b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:49.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f564d563700 1 -- 172.21.15.38:0/2390007192 shutdown_connections 2023-07-11T00:00:49.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.470+0000 7f564d563700 1 -- 172.21.15.38:0/2390007192 wait complete. 2023-07-11T00:00:49.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.471+0000 7f564d563700 1 Processor -- start 2023-07-11T00:00:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.472+0000 7f564d563700 1 -- start start 2023-07-11T00:00:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.472+0000 7f564d563700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f564806b120 0x7f5648144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.472+0000 7f564d563700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5648071b60 0x7f56481ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.472+0000 7f564d563700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5648147c00 0x7f56481dc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.472+0000 7f564d563700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56481445b0 con 0x7f564806b120 2023-07-11T00:00:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.472+0000 7f564d563700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480b55a0 con 0x7f5648071b60 2023-07-11T00:00:49.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.472+0000 7f564d563700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480b5b20 con 0x7f5648147c00 2023-07-11T00:00:49.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.472+0000 7f5646ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f564806b120 0x7f5648144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.472+0000 7f5646ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f564806b120 0x7f5648144070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41486/0 (socket says 172.21.15.38:41486) 2023-07-11T00:00:49.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.472+0000 7f5646ffd700 1 -- 172.21.15.38:0/2346750102 learned_addr learned my addr 172.21.15.38:0/2346750102 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:49.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f563e7fc700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5648071b60 0x7f56481ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f56477fe700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5648147c00 0x7f56481dc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f5646ffd700 1 -- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5648147c00 msgr2=0x7f56481dc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f5646ffd700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5648147c00 0x7f56481dc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f5646ffd700 1 -- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5648071b60 msgr2=0x7f56481ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f5646ffd700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5648071b60 0x7f56481ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f5646ffd700 1 -- 172.21.15.38:0/2346750102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640009a70 con 0x7f564806b120 2023-07-11T00:00:49.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f563e7fc700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5648071b60 0x7f56481ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:49.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f56477fe700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5648147c00 0x7f56481dc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:49.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f5646ffd700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f564806b120 0x7f5648144070 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f56380011e0 tx=0x7f563800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:49.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f563ffff700 1 -- 172.21.15.38:0/2346750102 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800ee10 con 0x7f564806b120 2023-07-11T00:00:49.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f563ffff700 1 -- 172.21.15.38:0/2346750102 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638004a80 con 0x7f564806b120 2023-07-11T00:00:49.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f564d563700 1 -- 172.21.15.38:0/2346750102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56480b6460 con 0x7f564806b120 2023-07-11T00:00:49.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f563ffff700 1 -- 172.21.15.38:0/2346750102 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638004e30 con 0x7f564806b120 2023-07-11T00:00:49.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.473+0000 7f564d563700 1 -- 172.21.15.38:0/2346750102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56481cebd0 con 0x7f564806b120 2023-07-11T00:00:49.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.474+0000 7f564d563700 1 -- 172.21.15.38:0/2346750102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5648074360 con 0x7f564806b120 2023-07-11T00:00:49.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.474+0000 7f563ffff700 1 -- 172.21.15.38:0/2346750102 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56380070d0 con 0x7f564806b120 2023-07-11T00:00:49.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.475+0000 7f563ffff700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f562806ace0 0x7f562806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.475+0000 7f563ffff700 1 -- 172.21.15.38:0/2346750102 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f563808ba80 con 0x7f564806b120 2023-07-11T00:00:49.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.475+0000 7f563e7fc700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f562806ace0 0x7f562806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.476+0000 7f563e7fc700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f562806ace0 0x7f562806d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f56481e0a10 tx=0x7f5630008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:49.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.480+0000 7f563ffff700 1 -- 172.21.15.38:0/2346750102 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5638056bc0 con 0x7f564806b120 2023-07-11T00:00:49.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.674+0000 7f564d563700 1 -- 172.21.15.38:0/2346750102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5648145dc0 con 0x7f564806b120 2023-07-11T00:00:49.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.675+0000 7f563ffff700 1 -- 172.21.15.38:0/2346750102 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56380150a0 con 0x7f564806b120 2023-07-11T00:00:49.678 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:00:49.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 -- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f562806ace0 msgr2=0x7f562806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f562806ace0 0x7f562806d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f56481e0a10 tx=0x7f5630008040 comp rx=0 tx=0).stop 2023-07-11T00:00:49.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 -- 172.21.15.38:0/2346750102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f564806b120 msgr2=0x7f5648144070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f564806b120 0x7f5648144070 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f56380011e0 tx=0x7f563800ecf0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 -- 172.21.15.38:0/2346750102 shutdown_connections 2023-07-11T00:00:49.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f562806ace0 0x7f562806d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5648147c00 0x7f56481dc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f564806b120 0x7f5648144070 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 --2- 172.21.15.38:0/2346750102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5648071b60 0x7f56481ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 -- 172.21.15.38:0/2346750102 >> 172.21.15.38:0/2346750102 conn(0x7f56480bd980 msgr2=0x7f56480bb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:49.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 -- 172.21.15.38:0/2346750102 shutdown_connections 2023-07-11T00:00:49.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.677+0000 7f564d563700 1 -- 172.21.15.38:0/2346750102 wait complete. 2023-07-11T00:00:49.692 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:00:49.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.818+0000 7f6c5055b700 1 Processor -- start 2023-07-11T00:00:49.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.818+0000 7f6c5055b700 1 -- start start 2023-07-11T00:00:49.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c5055b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6c481449d0 0x7f6c4814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c5055b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c480b8d90 0x7f6c4806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c5055b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c480b8620 con 0x7f6c480bc810 2023-07-11T00:00:49.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c5055b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c480b97a0 con 0x7f6c481449d0 2023-07-11T00:00:49.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c5055b700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c48144da0 con 0x7f6c480b8d90 2023-07-11T00:00:49.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c4e2f7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6c481449d0 0x7f6c4814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c4daf6700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6c480bc810 0x7f6c480ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58964/0 (socket says 172.21.15.38:58964) 2023-07-11T00:00:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c4daf6700 1 -- 172.21.15.38:0/2264827341 learned_addr learned my addr 172.21.15.38:0/2264827341 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c4eaf8700 1 --2- 172.21.15.38:0/2264827341 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c480b8d90 0x7f6c4806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c4e2f7700 1 -- 172.21.15.38:0/2264827341 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c480b8d90 msgr2=0x7f6c4806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c4e2f7700 1 --2- 172.21.15.38:0/2264827341 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c480b8d90 0x7f6c4806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c4e2f7700 1 -- 172.21.15.38:0/2264827341 >> v1:172.21.15.38:6789/0 conn(0x7f6c480bc810 legacy=0x7f6c480ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c4e2f7700 1 -- 172.21.15.38:0/2264827341 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c480b8900 con 0x7f6c481449d0 2023-07-11T00:00:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.819+0000 7f6c4d2f5700 1 -- 172.21.15.38:0/2264827341 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273535640 0 0) 0x7f6c480b8620 con 0x7f6c480bc810 2023-07-11T00:00:49.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c4e2f7700 1 --2- 172.21.15.38:0/2264827341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c481449d0 0x7f6c4814db50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009840 tx=0x7f6c38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b2ecb5f4dc45c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:49.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c4d2f5700 1 -- 172.21.15.38:0/2264827341 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38011830 con 0x7f6c481449d0 2023-07-11T00:00:49.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c4d2f5700 1 -- 172.21.15.38:0/2264827341 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c38011990 con 0x7f6c481449d0 2023-07-11T00:00:49.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c4d2f5700 1 -- 172.21.15.38:0/2264827341 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38011d20 con 0x7f6c481449d0 2023-07-11T00:00:49.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c5055b700 1 -- 172.21.15.38:0/2264827341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c481449d0 msgr2=0x7f6c4814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c5055b700 1 --2- 172.21.15.38:0/2264827341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c481449d0 0x7f6c4814db50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009840 tx=0x7f6c38009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:49.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c5055b700 1 -- 172.21.15.38:0/2264827341 shutdown_connections 2023-07-11T00:00:49.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c5055b700 1 --2- 172.21.15.38:0/2264827341 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c480b8d90 0x7f6c4806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c5055b700 1 --2- 172.21.15.38:0/2264827341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c481449d0 0x7f6c4814db50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c5055b700 1 -- 172.21.15.38:0/2264827341 >> 172.21.15.38:0/2264827341 conn(0x7f6c480c0860 msgr2=0x7f6c480c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:49.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c5055b700 1 -- 172.21.15.38:0/2264827341 shutdown_connections 2023-07-11T00:00:49.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.820+0000 7f6c5055b700 1 -- 172.21.15.38:0/2264827341 wait complete. 2023-07-11T00:00:49.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.821+0000 7f6c5055b700 1 Processor -- start 2023-07-11T00:00:49.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c5055b700 1 -- start start 2023-07-11T00:00:49.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c5055b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c480b8d90 0x7f6c481e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c5055b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c480bc810 0x7f6c4814d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c5055b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c481449d0 0x7f6c480a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c5055b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c481e35b0 con 0x7f6c480b8d90 2023-07-11T00:00:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c5055b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4814a2f0 con 0x7f6c480bc810 2023-07-11T00:00:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c5055b700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4814b390 con 0x7f6c481449d0 2023-07-11T00:00:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c4e2f7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c480b8d90 0x7f6c481e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c4e2f7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c480b8d90 0x7f6c481e3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41500/0 (socket says 172.21.15.38:41500) 2023-07-11T00:00:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c4e2f7700 1 -- 172.21.15.38:0/2531439673 learned_addr learned my addr 172.21.15.38:0/2531439673 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c4eaf8700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c481449d0 0x7f6c480a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.822+0000 7f6c4daf6700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c480bc810 0x7f6c4814d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c4e2f7700 1 -- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c481449d0 msgr2=0x7f6c480a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c4e2f7700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c481449d0 0x7f6c480a5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c4e2f7700 1 -- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c480bc810 msgr2=0x7f6c4814d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c4e2f7700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c480bc810 0x7f6c4814d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c4e2f7700 1 -- 172.21.15.38:0/2531439673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c380094a0 con 0x7f6c480b8d90 2023-07-11T00:00:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c4daf6700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c480bc810 0x7f6c4814d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c4e2f7700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c480b8d90 0x7f6c481e3a40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009fd0 tx=0x7f6c38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c3effd700 1 -- 172.21.15.38:0/2531439673 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380036a0 con 0x7f6c480b8d90 2023-07-11T00:00:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c3effd700 1 -- 172.21.15.38:0/2531439673 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3801e070 con 0x7f6c480b8d90 2023-07-11T00:00:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c5055b700 1 -- 172.21.15.38:0/2531439673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c481e3240 con 0x7f6c480b8d90 2023-07-11T00:00:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c3effd700 1 -- 172.21.15.38:0/2531439673 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38003a40 con 0x7f6c480b8d90 2023-07-11T00:00:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.823+0000 7f6c5055b700 1 -- 172.21.15.38:0/2531439673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c481e3f80 con 0x7f6c480b8d90 2023-07-11T00:00:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.824+0000 7f6c5055b700 1 -- 172.21.15.38:0/2531439673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c48074360 con 0x7f6c480b8d90 2023-07-11T00:00:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.824+0000 7f6c3effd700 1 -- 172.21.15.38:0/2531439673 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c38003ba0 con 0x7f6c480b8d90 2023-07-11T00:00:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.825+0000 7f6c3effd700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6c2c06ace0 0x7f6c2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:49.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.825+0000 7f6c3effd700 1 -- 172.21.15.38:0/2531439673 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c3808a420 con 0x7f6c480b8d90 2023-07-11T00:00:49.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.825+0000 7f6c4daf6700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6c2c06ace0 0x7f6c2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:49.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.825+0000 7f6c4daf6700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6c2c06ace0 0x7f6c2c06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6c480c0550 tx=0x7f6c44007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:49.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:49.829+0000 7f6c3effd700 1 -- 172.21.15.38:0/2531439673 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6c38055560 con 0x7f6c480b8d90 2023-07-11T00:00:50.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.024+0000 7f6c5055b700 1 -- 172.21.15.38:0/2531439673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c481e3890 con 0x7f6c480b8d90 2023-07-11T00:00:50.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.025+0000 7f6c3effd700 1 -- 172.21.15.38:0/2531439673 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c38058b80 con 0x7f6c480b8d90 2023-07-11T00:00:50.028 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-07-11T00:00:50.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.026+0000 7f6c5055b700 1 -- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6c2c06ace0 msgr2=0x7f6c2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.026+0000 7f6c5055b700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6c2c06ace0 0x7f6c2c06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6c480c0550 tx=0x7f6c44007ca0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.027+0000 7f6c5055b700 1 -- 172.21.15.38:0/2531439673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c480b8d90 msgr2=0x7f6c481e3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.027+0000 7f6c5055b700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c480b8d90 0x7f6c481e3a40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009fd0 tx=0x7f6c38004750 comp rx=0 tx=0).stop 2023-07-11T00:00:50.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.027+0000 7f6c5055b700 1 -- 172.21.15.38:0/2531439673 shutdown_connections 2023-07-11T00:00:50.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.027+0000 7f6c5055b700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f6c2c06ace0 0x7f6c2c06d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.027+0000 7f6c5055b700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c481449d0 0x7f6c480a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.027+0000 7f6c5055b700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c480b8d90 0x7f6c481e3a40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.027+0000 7f6c5055b700 1 --2- 172.21.15.38:0/2531439673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c480bc810 0x7f6c4814d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.027+0000 7f6c5055b700 1 -- 172.21.15.38:0/2531439673 >> 172.21.15.38:0/2531439673 conn(0x7f6c480c0860 msgr2=0x7f6c480bf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:50.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.027+0000 7f6c5055b700 1 -- 172.21.15.38:0/2531439673 shutdown_connections 2023-07-11T00:00:50.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.027+0000 7f6c5055b700 1 -- 172.21.15.38:0/2531439673 wait complete. 2023-07-11T00:00:50.041 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:00:50.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.170+0000 7f38f0ffe700 1 Processor -- start 2023-07-11T00:00:50.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.170+0000 7f38f0ffe700 1 -- start start 2023-07-11T00:00:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.171+0000 7f38f0ffe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f38ec0ba160 0x7f38ec071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.171+0000 7f38f0ffe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38ec0b5fc0 0x7f38ec0b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.171+0000 7f38f0ffe700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ec0b7180 con 0x7f38ec06b120 2023-07-11T00:00:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.171+0000 7f38f0ffe700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ec0b90b0 con 0x7f38ec0ba160 2023-07-11T00:00:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.171+0000 7f38f0ffe700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec0b6980 con 0x7f38ec0b5fc0 2023-07-11T00:00:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38e1d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f38ec0ba160 0x7f38ec071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38e1d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f38ec0ba160 0x7f38ec071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49986/0 (socket says 172.21.15.38:49986) 2023-07-11T00:00:50.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38e1d9b700 1 -- 172.21.15.38:0/619455927 learned_addr learned my addr 172.21.15.38:0/619455927 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38ead9d700 1 --2- 172.21.15.38:0/619455927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38ec0b5fc0 0x7f38ec0b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38e1d9b700 1 -- 172.21.15.38:0/619455927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38ec0b5fc0 msgr2=0x7f38ec0b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38e1d9b700 1 --2- 172.21.15.38:0/619455927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38ec0b5fc0 0x7f38ec0b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38e1d9b700 1 -- 172.21.15.38:0/619455927 >> v1:172.21.15.70:6789/0 conn(0x7f38ec06b120 legacy=0x7f38ec1485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38e1d9b700 1 -- 172.21.15.38:0/619455927 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec071070 con 0x7f38ec0ba160 2023-07-11T00:00:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38e1d9b700 1 --2- 172.21.15.38:0/619455927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38ec0ba160 0x7f38ec071350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f38d40098f0 tx=0x7f38d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816dd6101e4c60ee server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38e9d9b700 1 -- 172.21.15.38:0/619455927 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4011830 con 0x7f38ec0ba160 2023-07-11T00:00:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38e9d9b700 1 -- 172.21.15.38:0/619455927 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d4011990 con 0x7f38ec0ba160 2023-07-11T00:00:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.172+0000 7f38e9d9b700 1 -- 172.21.15.38:0/619455927 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4011d20 con 0x7f38ec0ba160 2023-07-11T00:00:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.173+0000 7f38f0ffe700 1 -- 172.21.15.38:0/619455927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38ec0ba160 msgr2=0x7f38ec071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.173+0000 7f38f0ffe700 1 --2- 172.21.15.38:0/619455927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38ec0ba160 0x7f38ec071350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f38d40098f0 tx=0x7f38d4009c00 comp rx=0 tx=0).stop 2023-07-11T00:00:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.173+0000 7f38f0ffe700 1 -- 172.21.15.38:0/619455927 shutdown_connections 2023-07-11T00:00:50.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.173+0000 7f38f0ffe700 1 --2- 172.21.15.38:0/619455927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38ec0b5fc0 0x7f38ec0b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.173+0000 7f38f0ffe700 1 --2- 172.21.15.38:0/619455927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38ec0ba160 0x7f38ec071350 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.173+0000 7f38f0ffe700 1 -- 172.21.15.38:0/619455927 >> 172.21.15.38:0/619455927 conn(0x7f38ec0bd980 msgr2=0x7f38ec0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:50.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.173+0000 7f38f0ffe700 1 -- 172.21.15.38:0/619455927 shutdown_connections 2023-07-11T00:00:50.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.173+0000 7f38f0ffe700 1 -- 172.21.15.38:0/619455927 wait complete. 2023-07-11T00:00:50.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.174+0000 7f38f0ffe700 1 Processor -- start 2023-07-11T00:00:50.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.174+0000 7f38f0ffe700 1 -- start start 2023-07-11T00:00:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38f0ffe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38ec06b120 0x7f38ec1cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38f0ffe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38ec0b5fc0 0x7f38ec1e3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38f0ffe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38ec0ba160 0x7f38ec06f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38f0ffe700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec06edc0 con 0x7f38ec0ba160 2023-07-11T00:00:50.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38f0ffe700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec1cfe20 con 0x7f38ec06b120 2023-07-11T00:00:50.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38f0ffe700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec1d01c0 con 0x7f38ec0b5fc0 2023-07-11T00:00:50.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38ead9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38ec0ba160 0x7f38ec06f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38ead9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38ec0ba160 0x7f38ec06f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49992/0 (socket says 172.21.15.38:49992) 2023-07-11T00:00:50.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38ead9d700 1 -- 172.21.15.38:0/1659631317 learned_addr learned my addr 172.21.15.38:0/1659631317 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:50.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38ea59c700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38ec06b120 0x7f38ec1cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38e1d9b700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38ec0b5fc0 0x7f38ec1e3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38ead9d700 1 -- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38ec0b5fc0 msgr2=0x7f38ec1e3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38ead9d700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38ec0b5fc0 0x7f38ec1e3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38ead9d700 1 -- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38ec06b120 msgr2=0x7f38ec1cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38ead9d700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38ec06b120 0x7f38ec1cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38ead9d700 1 -- 172.21.15.38:0/1659631317 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4009550 con 0x7f38ec0ba160 2023-07-11T00:00:50.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.175+0000 7f38ead9d700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38ec0ba160 0x7f38ec06f8a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009dd0 tx=0x7f38e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:50.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.176+0000 7f38e37fe700 1 -- 172.21.15.38:0/1659631317 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4009c40 con 0x7f38ec0ba160 2023-07-11T00:00:50.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.176+0000 7f38e37fe700 1 -- 172.21.15.38:0/1659631317 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e400f040 con 0x7f38ec0ba160 2023-07-11T00:00:50.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.176+0000 7f38f0ffe700 1 -- 172.21.15.38:0/1659631317 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ec1d25d0 con 0x7f38ec0ba160 2023-07-11T00:00:50.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.176+0000 7f38e37fe700 1 -- 172.21.15.38:0/1659631317 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e400ceb0 con 0x7f38ec0ba160 2023-07-11T00:00:50.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.176+0000 7f38f0ffe700 1 -- 172.21.15.38:0/1659631317 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ec1e3790 con 0x7f38ec0ba160 2023-07-11T00:00:50.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.177+0000 7f38f0ffe700 1 -- 172.21.15.38:0/1659631317 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ec1461d0 con 0x7f38ec0ba160 2023-07-11T00:00:50.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.177+0000 7f38e37fe700 1 -- 172.21.15.38:0/1659631317 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38e4014480 con 0x7f38ec0ba160 2023-07-11T00:00:50.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.177+0000 7f38e37fe700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f38cc06ace0 0x7f38cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.178+0000 7f38e37fe700 1 -- 172.21.15.38:0/1659631317 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38e4089c30 con 0x7f38ec0ba160 2023-07-11T00:00:50.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.178+0000 7f38ea59c700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f38cc06ace0 0x7f38cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.178+0000 7f38ea59c700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f38cc06ace0 0x7f38cc06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f38dc007fd0 tx=0x7f38dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:50.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.182+0000 7f38e37fe700 1 -- 172.21.15.38:0/1659631317 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f38e4058780 con 0x7f38ec0ba160 2023-07-11T00:00:50.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.375+0000 7f38f0ffe700 1 -- 172.21.15.38:0/1659631317 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38ec074360 con 0x7f38ec0ba160 2023-07-11T00:00:50.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.376+0000 7f38e37fe700 1 -- 172.21.15.38:0/1659631317 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38e4058310 con 0x7f38ec0ba160 2023-07-11T00:00:50.379 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-07-11T00:00:50.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.377+0000 7f38f0ffe700 1 -- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f38cc06ace0 msgr2=0x7f38cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.377+0000 7f38f0ffe700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f38cc06ace0 0x7f38cc06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f38dc007fd0 tx=0x7f38dc009040 comp rx=0 tx=0).stop 2023-07-11T00:00:50.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.377+0000 7f38f0ffe700 1 -- 172.21.15.38:0/1659631317 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38ec0ba160 msgr2=0x7f38ec06f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.377+0000 7f38f0ffe700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38ec0ba160 0x7f38ec06f8a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009dd0 tx=0x7f38e400c3a0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.378+0000 7f38f0ffe700 1 -- 172.21.15.38:0/1659631317 shutdown_connections 2023-07-11T00:00:50.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.378+0000 7f38f0ffe700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f38cc06ace0 0x7f38cc06d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.378+0000 7f38f0ffe700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38ec0ba160 0x7f38ec06f8a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.378+0000 7f38f0ffe700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38ec06b120 0x7f38ec1cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.378+0000 7f38f0ffe700 1 --2- 172.21.15.38:0/1659631317 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38ec0b5fc0 0x7f38ec1e3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.378+0000 7f38f0ffe700 1 -- 172.21.15.38:0/1659631317 >> 172.21.15.38:0/1659631317 conn(0x7f38ec0bd980 msgr2=0x7f38ec1d2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.378+0000 7f38f0ffe700 1 -- 172.21.15.38:0/1659631317 shutdown_connections 2023-07-11T00:00:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.378+0000 7f38f0ffe700 1 -- 172.21.15.38:0/1659631317 wait complete. 2023-07-11T00:00:50.393 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:00:50.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.515+0000 7f373b7d8700 1 Processor -- start 2023-07-11T00:00:50.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.515+0000 7f373b7d8700 1 -- start start 2023-07-11T00:00:50.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.516+0000 7f373b7d8700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f37341449d0 0x7f373414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.516+0000 7f373b7d8700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37340b8d90 0x7f373406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.516+0000 7f373b7d8700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37340b8620 con 0x7f37340bc810 2023-07-11T00:00:50.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.516+0000 7f373b7d8700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37340b97a0 con 0x7f37341449d0 2023-07-11T00:00:50.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.516+0000 7f373b7d8700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3734144da0 con 0x7f37340b8d90 2023-07-11T00:00:50.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.516+0000 7f3738d73700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f37340bc810 0x7f37340ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54372/0 (socket says 172.21.15.38:54372) 2023-07-11T00:00:50.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.516+0000 7f3738d73700 1 -- 172.21.15.38:0/3313980122 learned_addr learned my addr 172.21.15.38:0/3313980122 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:50.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.516+0000 7f3739d75700 1 --2- 172.21.15.38:0/3313980122 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37340b8d90 0x7f373406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.516+0000 7f3739574700 1 --2- 172.21.15.38:0/3313980122 >> v2:172.21.15.70:3300/0 conn(0x7f37341449d0 0x7f373414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.516+0000 7f372bfff700 1 -- 172.21.15.38:0/3313980122 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891250413 0 0) 0x7f37340b8620 con 0x7f37340bc810 2023-07-11T00:00:50.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.516+0000 7f372bfff700 1 -- 172.21.15.38:0/3313980122 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37200035b0 con 0x7f37340bc810 2023-07-11T00:00:50.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.517+0000 7f372bfff700 1 -- 172.21.15.38:0/3313980122 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 166816219 0 0) 0x7f37200035b0 con 0x7f37340bc810 2023-07-11T00:00:50.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.517+0000 7f3739574700 1 -- 172.21.15.38:0/3313980122 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37340b8d90 msgr2=0x7f373406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:50.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.517+0000 7f3739574700 1 --2- 172.21.15.38:0/3313980122 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37340b8d90 0x7f373406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.517+0000 7f3739574700 1 -- 172.21.15.38:0/3313980122 >> v1:172.21.15.38:6789/0 conn(0x7f37340bc810 legacy=0x7f37340ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.517+0000 7f3739574700 1 -- 172.21.15.38:0/3313980122 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37340b8900 con 0x7f37341449d0 2023-07-11T00:00:50.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.517+0000 7f3739d75700 1 --2- 172.21.15.38:0/3313980122 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37340b8d90 0x7f373406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:50.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.517+0000 7f3739574700 1 --2- 172.21.15.38:0/3313980122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37341449d0 0x7f373414db50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3724009840 tx=0x7f3724009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c92d215e3f221e04 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:50.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.517+0000 7f372bfff700 1 -- 172.21.15.38:0/3313980122 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730001670 con 0x7f37341449d0 2023-07-11T00:00:50.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.517+0000 7f372bfff700 1 -- 172.21.15.38:0/3313980122 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3724004030 con 0x7f37341449d0 2023-07-11T00:00:50.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.517+0000 7f372bfff700 1 -- 172.21.15.38:0/3313980122 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37240043c0 con 0x7f37341449d0 2023-07-11T00:00:50.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.518+0000 7f373b7d8700 1 -- 172.21.15.38:0/3313980122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37341449d0 msgr2=0x7f373414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.518+0000 7f373b7d8700 1 --2- 172.21.15.38:0/3313980122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37341449d0 0x7f373414db50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3724009840 tx=0x7f3724009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:50.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.518+0000 7f373b7d8700 1 -- 172.21.15.38:0/3313980122 shutdown_connections 2023-07-11T00:00:50.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.518+0000 7f373b7d8700 1 --2- 172.21.15.38:0/3313980122 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37340b8d90 0x7f373406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.518+0000 7f373b7d8700 1 --2- 172.21.15.38:0/3313980122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37341449d0 0x7f373414db50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.518+0000 7f373b7d8700 1 -- 172.21.15.38:0/3313980122 >> 172.21.15.38:0/3313980122 conn(0x7f37340c0860 msgr2=0x7f37340c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:50.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.518+0000 7f373b7d8700 1 -- 172.21.15.38:0/3313980122 shutdown_connections 2023-07-11T00:00:50.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.518+0000 7f373b7d8700 1 -- 172.21.15.38:0/3313980122 wait complete. 2023-07-11T00:00:50.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.519+0000 7f373b7d8700 1 Processor -- start 2023-07-11T00:00:50.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.519+0000 7f373b7d8700 1 -- start start 2023-07-11T00:00:50.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.519+0000 7f373b7d8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37340b8d90 0x7f3734149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.519+0000 7f373b7d8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37340bc810 0x7f37341e2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.519+0000 7f373b7d8700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37341449d0 0x7f37341e30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.519+0000 7f373b7d8700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37341478f0 con 0x7f37340b8d90 2023-07-11T00:00:50.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.519+0000 7f373b7d8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373414aa00 con 0x7f37340bc810 2023-07-11T00:00:50.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.519+0000 7f373b7d8700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37340b4300 con 0x7f37341449d0 2023-07-11T00:00:50.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.519+0000 7f3739574700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37340b8d90 0x7f3734149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.519+0000 7f3739574700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37340b8d90 0x7f3734149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50004/0 (socket says 172.21.15.38:50004) 2023-07-11T00:00:50.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3739574700 1 -- 172.21.15.38:0/3885494210 learned_addr learned my addr 172.21.15.38:0/3885494210 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:50.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3739d75700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37341449d0 0x7f37341e30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3738d73700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37340bc810 0x7f37341e2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3739574700 1 -- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37341449d0 msgr2=0x7f37341e30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3739574700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37341449d0 0x7f37341e30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3739574700 1 -- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37340bc810 msgr2=0x7f37341e2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3739574700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37340bc810 0x7f37341e2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3739574700 1 -- 172.21.15.38:0/3885494210 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c009a70 con 0x7f37340b8d90 2023-07-11T00:00:50.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3739d75700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37341449d0 0x7f37341e30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:50.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3738d73700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37340bc810 0x7f37341e2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:50.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3739574700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37340b8d90 0x7f3734149650 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f372400a010 tx=0x7f3724004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:50.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3729ffb700 1 -- 172.21.15.38:0/3885494210 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724003c40 con 0x7f37340b8d90 2023-07-11T00:00:50.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3729ffb700 1 -- 172.21.15.38:0/3885494210 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372401f070 con 0x7f37340b8d90 2023-07-11T00:00:50.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f373b7d8700 1 -- 172.21.15.38:0/3885494210 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37240094a0 con 0x7f37340b8d90 2023-07-11T00:00:50.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f3729ffb700 1 -- 172.21.15.38:0/3885494210 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724011630 con 0x7f37340b8d90 2023-07-11T00:00:50.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.520+0000 7f373b7d8700 1 -- 172.21.15.38:0/3885494210 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373414acb0 con 0x7f37340b8d90 2023-07-11T00:00:50.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.521+0000 7f373b7d8700 1 -- 172.21.15.38:0/3885494210 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3734074360 con 0x7f37340b8d90 2023-07-11T00:00:50.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.522+0000 7f3729ffb700 1 -- 172.21.15.38:0/3885494210 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3724021030 con 0x7f37340b8d90 2023-07-11T00:00:50.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.522+0000 7f3729ffb700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f371806ace0 0x7f371806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.522+0000 7f3729ffb700 1 -- 172.21.15.38:0/3885494210 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f372408a790 con 0x7f37340b8d90 2023-07-11T00:00:50.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.522+0000 7f3738d73700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f371806ace0 0x7f371806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.523+0000 7f3738d73700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f371806ace0 0x7f371806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37340c0130 tx=0x7f3730009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:50.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.527+0000 7f3729ffb700 1 -- 172.21.15.38:0/3885494210 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f37240558d0 con 0x7f37340b8d90 2023-07-11T00:00:50.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.769+0000 7f373b7d8700 1 -- 172.21.15.38:0/3885494210 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37340bc330 con 0x7f37340b8d90 2023-07-11T00:00:50.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.770+0000 7f3729ffb700 1 -- 172.21.15.38:0/3885494210 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3909 (secure 0 0 0) 0x7f3724058ef0 con 0x7f37340b8d90 2023-07-11T00:00:50.773 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:50.773 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3612343661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3612343661},{"type":"v1","addr":"172.21.15.38:6834","nonce":3612343661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3097729806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3097729806},{"type":"v1","addr":"172.21.15.70:6835","nonce":3097729806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:00:16.787420+0000","modified":"2023-07-11T00:00:19.806642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3594015619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3594015619},{"type":"v1","addr":"172.21.15.38:6835","nonce":3594015619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:00:50.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 -- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f371806ace0 msgr2=0x7f371806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f371806ace0 0x7f371806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37340c0130 tx=0x7f3730009040 comp rx=0 tx=0).stop 2023-07-11T00:00:50.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 -- 172.21.15.38:0/3885494210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37340b8d90 msgr2=0x7f3734149650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37340b8d90 0x7f3734149650 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f372400a010 tx=0x7f3724004750 comp rx=0 tx=0).stop 2023-07-11T00:00:50.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 -- 172.21.15.38:0/3885494210 shutdown_connections 2023-07-11T00:00:50.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f371806ace0 0x7f371806d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37341449d0 0x7f37341e30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37340b8d90 0x7f3734149650 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 --2- 172.21.15.38:0/3885494210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37340bc810 0x7f37341e2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 -- 172.21.15.38:0/3885494210 >> 172.21.15.38:0/3885494210 conn(0x7f37340c0860 msgr2=0x7f37340be760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:50.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 -- 172.21.15.38:0/3885494210 shutdown_connections 2023-07-11T00:00:50.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.772+0000 7f373b7d8700 1 -- 172.21.15.38:0/3885494210 wait complete. 2023-07-11T00:00:50.777 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 7 2023-07-11T00:00:50.787 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:50.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.911+0000 7f490137b700 1 Processor -- start 2023-07-11T00:00:50.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.911+0000 7f490137b700 1 -- start start 2023-07-11T00:00:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.912+0000 7f490137b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f48fc1449d0 0x7f48fc14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.912+0000 7f490137b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48fc0b8d90 0x7f48fc06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.912+0000 7f490137b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48fc0b8620 con 0x7f48fc0bc810 2023-07-11T00:00:50.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.912+0000 7f490137b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48fc0b97a0 con 0x7f48fc1449d0 2023-07-11T00:00:50.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.912+0000 7f490137b700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc144da0 con 0x7f48fc0b8d90 2023-07-11T00:00:50.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.912+0000 7f48faffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f48fc1449d0 0x7f48fc14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.912+0000 7f48fa7fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f48fc0bc810 0x7f48fc0ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54382/0 (socket says 172.21.15.38:54382) 2023-07-11T00:00:50.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.912+0000 7f48fa7fc700 1 -- 172.21.15.38:0/3671992334 learned_addr learned my addr 172.21.15.38:0/3671992334 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:50.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.912+0000 7f48fb7fe700 1 --2- 172.21.15.38:0/3671992334 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48fc0b8d90 0x7f48fc06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f48faffd700 1 -- 172.21.15.38:0/3671992334 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48fc0b8d90 msgr2=0x7f48fc06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:50.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f48faffd700 1 --2- 172.21.15.38:0/3671992334 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48fc0b8d90 0x7f48fc06ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f48faffd700 1 -- 172.21.15.38:0/3671992334 >> v1:172.21.15.38:6789/0 conn(0x7f48fc0bc810 legacy=0x7f48fc0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f48faffd700 1 -- 172.21.15.38:0/3671992334 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0b8900 con 0x7f48fc1449d0 2023-07-11T00:00:50.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f48f9ffb700 1 -- 172.21.15.38:0/3671992334 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026100595 0 0) 0x7f48fc0b8620 con 0x7f48fc0bc810 2023-07-11T00:00:50.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f48faffd700 1 --2- 172.21.15.38:0/3671992334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1449d0 0x7f48fc14db50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009d90 tx=0x7f48ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9d08228c8f6504 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:50.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f48f9ffb700 1 -- 172.21.15.38:0/3671992334 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec00e070 con 0x7f48fc1449d0 2023-07-11T00:00:50.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f48f9ffb700 1 -- 172.21.15.38:0/3671992334 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec00bb20 con 0x7f48fc1449d0 2023-07-11T00:00:50.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f48f9ffb700 1 -- 172.21.15.38:0/3671992334 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec012430 con 0x7f48fc1449d0 2023-07-11T00:00:50.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f490137b700 1 -- 172.21.15.38:0/3671992334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1449d0 msgr2=0x7f48fc14db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f490137b700 1 --2- 172.21.15.38:0/3671992334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1449d0 0x7f48fc14db50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009d90 tx=0x7f48ec00b330 comp rx=0 tx=0).stop 2023-07-11T00:00:50.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f490137b700 1 -- 172.21.15.38:0/3671992334 shutdown_connections 2023-07-11T00:00:50.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f490137b700 1 --2- 172.21.15.38:0/3671992334 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48fc0b8d90 0x7f48fc06ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f490137b700 1 --2- 172.21.15.38:0/3671992334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1449d0 0x7f48fc14db50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.913+0000 7f490137b700 1 -- 172.21.15.38:0/3671992334 >> 172.21.15.38:0/3671992334 conn(0x7f48fc0c0860 msgr2=0x7f48fc0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:50.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.914+0000 7f490137b700 1 -- 172.21.15.38:0/3671992334 shutdown_connections 2023-07-11T00:00:50.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.914+0000 7f490137b700 1 -- 172.21.15.38:0/3671992334 wait complete. 2023-07-11T00:00:50.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.915+0000 7f490137b700 1 Processor -- start 2023-07-11T00:00:50.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.915+0000 7f490137b700 1 -- start start 2023-07-11T00:00:50.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.915+0000 7f490137b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc0b8d90 0x7f48fc14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.915+0000 7f490137b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48fc0bc810 0x7f48fc1e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.915+0000 7f490137b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48fc1449d0 0x7f48fc1e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.915+0000 7f490137b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0b46e0 con 0x7f48fc0b8d90 2023-07-11T00:00:50.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.915+0000 7f490137b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc14d130 con 0x7f48fc1449d0 2023-07-11T00:00:50.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.915+0000 7f490137b700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0b3a00 con 0x7f48fc0bc810 2023-07-11T00:00:50.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48faffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc0b8d90 0x7f48fc14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48faffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc0b8d90 0x7f48fc14cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50022/0 (socket says 172.21.15.38:50022) 2023-07-11T00:00:50.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48faffd700 1 -- 172.21.15.38:0/779420809 learned_addr learned my addr 172.21.15.38:0/779420809 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:50.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48fb7fe700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48fc1449d0 0x7f48fc1e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48fa7fc700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48fc0bc810 0x7f48fc1e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48faffd700 1 -- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48fc0bc810 msgr2=0x7f48fc1e31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48faffd700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48fc0bc810 0x7f48fc1e31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48faffd700 1 -- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48fc1449d0 msgr2=0x7f48fc1e36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:50.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48faffd700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48fc1449d0 0x7f48fc1e36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:50.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48faffd700 1 -- 172.21.15.38:0/779420809 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec009a70 con 0x7f48fc0b8d90 2023-07-11T00:00:50.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48fa7fc700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48fc0bc810 0x7f48fc1e31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:50.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48faffd700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc0b8d90 0x7f48fc14cbf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f48fc06d000 tx=0x7f48ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:50.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48f37fe700 1 -- 172.21.15.38:0/779420809 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec012430 con 0x7f48fc0b8d90 2023-07-11T00:00:50.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f490137b700 1 -- 172.21.15.38:0/779420809 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48fc14d810 con 0x7f48fc0b8d90 2023-07-11T00:00:50.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f490137b700 1 -- 172.21.15.38:0/779420809 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48fc0b4300 con 0x7f48fc0b8d90 2023-07-11T00:00:50.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48f37fe700 1 -- 172.21.15.38:0/779420809 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec020070 con 0x7f48fc0b8d90 2023-07-11T00:00:50.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.916+0000 7f48f37fe700 1 -- 172.21.15.38:0/779420809 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec004240 con 0x7f48fc0b8d90 2023-07-11T00:00:50.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.918+0000 7f48f37fe700 1 -- 172.21.15.38:0/779420809 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f48ec0043a0 con 0x7f48fc0b8d90 2023-07-11T00:00:50.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.918+0000 7f490137b700 1 -- 172.21.15.38:0/779420809 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48fc0b4820 con 0x7f48fc0b8d90 2023-07-11T00:00:50.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.918+0000 7f48f37fe700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f48dc06ace0 0x7f48dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:50.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.918+0000 7f48f37fe700 1 -- 172.21.15.38:0/779420809 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48ec022070 con 0x7f48fc0b8d90 2023-07-11T00:00:50.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.918+0000 7f48fa7fc700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f48dc06ace0 0x7f48dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:50.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.919+0000 7f48fa7fc700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f48dc06ace0 0x7f48dc06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0b7340 tx=0x7f48e4007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:50.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:50.923+0000 7f48f37fe700 1 -- 172.21.15.38:0/779420809 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f48ec056a90 con 0x7f48fc0b8d90 2023-07-11T00:00:51.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.122+0000 7f490137b700 1 -- 172.21.15.38:0/779420809 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48fc074360 con 0x7f48fc0b8d90 2023-07-11T00:00:51.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.123+0000 7f48f37fe700 1 -- 172.21.15.38:0/779420809 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f48ec05a0b0 con 0x7f48fc0b8d90 2023-07-11T00:00:51.126 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:51.126 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:51.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.125+0000 7f490137b700 1 -- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f48dc06ace0 msgr2=0x7f48dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.125+0000 7f490137b700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f48dc06ace0 0x7f48dc06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0b7340 tx=0x7f48e4007ca0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.125+0000 7f490137b700 1 -- 172.21.15.38:0/779420809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc0b8d90 msgr2=0x7f48fc14cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.125+0000 7f490137b700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc0b8d90 0x7f48fc14cbf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f48fc06d000 tx=0x7f48ec004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.126+0000 7f490137b700 1 -- 172.21.15.38:0/779420809 shutdown_connections 2023-07-11T00:00:51.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.126+0000 7f490137b700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f48dc06ace0 0x7f48dc06d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.126+0000 7f490137b700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48fc1449d0 0x7f48fc1e36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.126+0000 7f490137b700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc0b8d90 0x7f48fc14cbf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.126+0000 7f490137b700 1 --2- 172.21.15.38:0/779420809 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48fc0bc810 0x7f48fc1e31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.126+0000 7f490137b700 1 -- 172.21.15.38:0/779420809 >> 172.21.15.38:0/779420809 conn(0x7f48fc0c0860 msgr2=0x7f48fc143ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:51.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.126+0000 7f490137b700 1 -- 172.21.15.38:0/779420809 shutdown_connections 2023-07-11T00:00:51.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.126+0000 7f490137b700 1 -- 172.21.15.38:0/779420809 wait complete. 2023-07-11T00:00:51.141 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-11T00:00:51.141 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:00:51.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.263+0000 7f64d530f700 1 Processor -- start 2023-07-11T00:00:51.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.263+0000 7f64d530f700 1 -- start start 2023-07-11T00:00:51.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.264+0000 7f64d530f700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f64d014bf30 0x7f64d00b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.264+0000 7f64d530f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f64d0145fc0 0x7f64d0153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.264+0000 7f64d530f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d0070130 con 0x7f64d0071d20 2023-07-11T00:00:51.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.264+0000 7f64d530f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d0070f80 con 0x7f64d0145fc0 2023-07-11T00:00:51.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.264+0000 7f64d530f700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d0071260 con 0x7f64d014bf30 2023-07-11T00:00:51.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.264+0000 7f64cf7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f64d0145fc0 0x7f64d0153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.264+0000 7f64ce7fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f64d0071d20 0x7f64d01458b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54384/0 (socket says 172.21.15.38:54384) 2023-07-11T00:00:51.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.264+0000 7f64ce7fc700 1 -- 172.21.15.38:0/653087441 learned_addr learned my addr 172.21.15.38:0/653087441 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:51.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.264+0000 7f64ceffd700 1 --2- 172.21.15.38:0/653087441 >> v2:172.21.15.70:3300/0 conn(0x7f64d014bf30 0x7f64d00b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64cf7fe700 1 -- 172.21.15.38:0/653087441 >> v2:172.21.15.70:3300/0 conn(0x7f64d014bf30 msgr2=0x7f64d00b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:51.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64cf7fe700 1 --2- 172.21.15.38:0/653087441 >> v2:172.21.15.70:3300/0 conn(0x7f64d014bf30 0x7f64d00b8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64cf7fe700 1 -- 172.21.15.38:0/653087441 >> v1:172.21.15.38:6789/0 conn(0x7f64d0071d20 legacy=0x7f64d01458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64cf7fe700 1 -- 172.21.15.38:0/653087441 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0071540 con 0x7f64d0145fc0 2023-07-11T00:00:51.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64cdffb700 1 -- 172.21.15.38:0/653087441 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692235530 0 0) 0x7f64d0070130 con 0x7f64d0071d20 2023-07-11T00:00:51.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64ceffd700 1 --2- 172.21.15.38:0/653087441 >> v2:172.21.15.70:3300/0 conn(0x7f64d014bf30 0x7f64d00b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:51.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64cf7fe700 1 --2- 172.21.15.38:0/653087441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64d0145fc0 0x7f64d0153080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f64d00674f0 tx=0x7f64c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecc3cf22a3d8d18 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:51.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64cdffb700 1 -- 172.21.15.38:0/653087441 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800e070 con 0x7f64d0145fc0 2023-07-11T00:00:51.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64cdffb700 1 -- 172.21.15.38:0/653087441 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c800bbd0 con 0x7f64d0145fc0 2023-07-11T00:00:51.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64cdffb700 1 -- 172.21.15.38:0/653087441 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8012430 con 0x7f64d0145fc0 2023-07-11T00:00:51.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64d530f700 1 -- 172.21.15.38:0/653087441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64d0145fc0 msgr2=0x7f64d0153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64d530f700 1 --2- 172.21.15.38:0/653087441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64d0145fc0 0x7f64d0153080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f64d00674f0 tx=0x7f64c800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:51.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64d530f700 1 -- 172.21.15.38:0/653087441 shutdown_connections 2023-07-11T00:00:51.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64d530f700 1 --2- 172.21.15.38:0/653087441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64d0145fc0 0x7f64d0153080 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64d530f700 1 --2- 172.21.15.38:0/653087441 >> v2:172.21.15.70:3300/0 conn(0x7f64d014bf30 0x7f64d00b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.265+0000 7f64d530f700 1 -- 172.21.15.38:0/653087441 >> 172.21.15.38:0/653087441 conn(0x7f64d00be670 msgr2=0x7f64d00bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:51.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.266+0000 7f64d530f700 1 -- 172.21.15.38:0/653087441 shutdown_connections 2023-07-11T00:00:51.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.266+0000 7f64d530f700 1 -- 172.21.15.38:0/653087441 wait complete. 2023-07-11T00:00:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.267+0000 7f64d530f700 1 Processor -- start 2023-07-11T00:00:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.267+0000 7f64d530f700 1 -- start start 2023-07-11T00:00:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.267+0000 7f64d530f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64d0071d20 0x7f64d01e0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.267+0000 7f64d530f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64d0145fc0 0x7f64d0146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.267+0000 7f64d530f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d014bf30 0x7f64d0147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.267+0000 7f64d530f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d0147760 con 0x7f64d0071d20 2023-07-11T00:00:51.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.267+0000 7f64d530f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d01491b0 con 0x7f64d014bf30 2023-07-11T00:00:51.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.267+0000 7f64d530f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d0147480 con 0x7f64d0145fc0 2023-07-11T00:00:51.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.267+0000 7f64ceffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64d0071d20 0x7f64d01e0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.267+0000 7f64ceffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64d0071d20 0x7f64d01e0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50040/0 (socket says 172.21.15.38:50040) 2023-07-11T00:00:51.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.267+0000 7f64ceffd700 1 -- 172.21.15.38:0/3650422084 learned_addr learned my addr 172.21.15.38:0/3650422084 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:51.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64ce7fc700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64d0145fc0 0x7f64d0146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64cf7fe700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d014bf30 0x7f64d0147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64ceffd700 1 -- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64d0145fc0 msgr2=0x7f64d0146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64ceffd700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64d0145fc0 0x7f64d0146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64ceffd700 1 -- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d014bf30 msgr2=0x7f64d0147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64ceffd700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d014bf30 0x7f64d0147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64ceffd700 1 -- 172.21.15.38:0/3650422084 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c8009a70 con 0x7f64d0071d20 2023-07-11T00:00:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64ceffd700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64d0071d20 0x7f64d01e0190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f64c400e810 tx=0x7f64c400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:51.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64b77fe700 1 -- 172.21.15.38:0/3650422084 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c400c020 con 0x7f64d0071d20 2023-07-11T00:00:51.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64b77fe700 1 -- 172.21.15.38:0/3650422084 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4004230 con 0x7f64d0071d20 2023-07-11T00:00:51.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64d530f700 1 -- 172.21.15.38:0/3650422084 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d0148ea0 con 0x7f64d0071d20 2023-07-11T00:00:51.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64b77fe700 1 -- 172.21.15.38:0/3650422084 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40036a0 con 0x7f64d0071d20 2023-07-11T00:00:51.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.268+0000 7f64d530f700 1 -- 172.21.15.38:0/3650422084 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d006b280 con 0x7f64d0071d20 2023-07-11T00:00:51.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.269+0000 7f64d530f700 1 -- 172.21.15.38:0/3650422084 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d0148ca0 con 0x7f64d0071d20 2023-07-11T00:00:51.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.270+0000 7f64b77fe700 1 -- 172.21.15.38:0/3650422084 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64c4003800 con 0x7f64d0071d20 2023-07-11T00:00:51.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.270+0000 7f64b77fe700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f64bc06ace0 0x7f64bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.270+0000 7f64b77fe700 1 -- 172.21.15.38:0/3650422084 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64c4089050 con 0x7f64d0071d20 2023-07-11T00:00:51.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.270+0000 7f64ce7fc700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f64bc06ace0 0x7f64bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.271+0000 7f64ce7fc700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f64bc06ace0 0x7f64bc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f64d00b0ad0 tx=0x7f64c0007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:51.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.275+0000 7f64b77fe700 1 -- 172.21.15.38:0/3650422084 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f64c4054190 con 0x7f64d0071d20 2023-07-11T00:00:51.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.516+0000 7f64d530f700 1 -- 172.21.15.38:0/3650422084 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64d0074360 con 0x7f64d0071d20 2023-07-11T00:00:51.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.516+0000 7f64b77fe700 1 -- 172.21.15.38:0/3650422084 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3909 (secure 0 0 0) 0x7f64c40577b0 con 0x7f64d0071d20 2023-07-11T00:00:51.519 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:51.519 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3612343661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3612343661},{"type":"v1","addr":"172.21.15.38:6834","nonce":3612343661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3097729806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3097729806},{"type":"v1","addr":"172.21.15.70:6835","nonce":3097729806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:00:16.787420+0000","modified":"2023-07-11T00:00:19.806642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3594015619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3594015619},{"type":"v1","addr":"172.21.15.38:6835","nonce":3594015619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:00:51.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 -- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f64bc06ace0 msgr2=0x7f64bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f64bc06ace0 0x7f64bc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f64d00b0ad0 tx=0x7f64c0007de0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 -- 172.21.15.38:0/3650422084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64d0071d20 msgr2=0x7f64d01e0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64d0071d20 0x7f64d01e0190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f64c400e810 tx=0x7f64c400eb20 comp rx=0 tx=0).stop 2023-07-11T00:00:51.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 -- 172.21.15.38:0/3650422084 shutdown_connections 2023-07-11T00:00:51.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f64bc06ace0 0x7f64bc06d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d014bf30 0x7f64d0147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64d0071d20 0x7f64d01e0190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 --2- 172.21.15.38:0/3650422084 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64d0145fc0 0x7f64d0146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 -- 172.21.15.38:0/3650422084 >> 172.21.15.38:0/3650422084 conn(0x7f64d00be670 msgr2=0x7f64d014a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:51.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 -- 172.21.15.38:0/3650422084 shutdown_connections 2023-07-11T00:00:51.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.518+0000 7f64d530f700 1 -- 172.21.15.38:0/3650422084 wait complete. 2023-07-11T00:00:51.523 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 7 2023-07-11T00:00:51.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:00:51.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.656+0000 7f33ce927700 1 Processor -- start 2023-07-11T00:00:51.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.657+0000 7f33ce927700 1 -- start start 2023-07-11T00:00:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33ce927700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f33c80b9340 0x7f33c8071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33ce927700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f33c80b3b50 0x7f33c8071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33ce927700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c806fb30 con 0x7f33c806b120 2023-07-11T00:00:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33ce927700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c806f4e0 con 0x7f33c80b3b50 2023-07-11T00:00:51.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33ce927700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c806f7c0 con 0x7f33c80b9340 2023-07-11T00:00:51.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33c7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f33c806b120 0x7f33c8140ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54398/0 (socket says 172.21.15.38:54398) 2023-07-11T00:00:51.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33ccec4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f33c80b3b50 0x7f33c8071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33c7fff700 1 -- 172.21.15.38:0/4132411689 learned_addr learned my addr 172.21.15.38:0/4132411689 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:51.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33c77fe700 1 --2- 172.21.15.38:0/4132411689 >> v2:172.21.15.70:3300/0 conn(0x7f33c80b9340 0x7f33c8071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33ccec4700 1 -- 172.21.15.38:0/4132411689 >> v2:172.21.15.70:3300/0 conn(0x7f33c80b9340 msgr2=0x7f33c8071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:51.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33ccec4700 1 --2- 172.21.15.38:0/4132411689 >> v2:172.21.15.70:3300/0 conn(0x7f33c80b9340 0x7f33c8071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33ccec4700 1 -- 172.21.15.38:0/4132411689 >> v1:172.21.15.38:6789/0 conn(0x7f33c806b120 legacy=0x7f33c8140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33ccec4700 1 -- 172.21.15.38:0/4132411689 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c81411e0 con 0x7f33c80b3b50 2023-07-11T00:00:51.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33c6ffd700 1 -- 172.21.15.38:0/4132411689 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287708966 0 0) 0x7f33c806fb30 con 0x7f33c806b120 2023-07-11T00:00:51.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33ccec4700 1 --2- 172.21.15.38:0/4132411689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33c80b3b50 0x7f33c8071950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f33c806e4f0 tx=0x7f33c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e502fcd4ba418ff8 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33c6ffd700 1 -- 172.21.15.38:0/4132411689 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000e070 con 0x7f33c80b3b50 2023-07-11T00:00:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33c6ffd700 1 -- 172.21.15.38:0/4132411689 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c000bbd0 con 0x7f33c80b3b50 2023-07-11T00:00:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.658+0000 7f33c6ffd700 1 -- 172.21.15.38:0/4132411689 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0012430 con 0x7f33c80b3b50 2023-07-11T00:00:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.659+0000 7f33ce927700 1 -- 172.21.15.38:0/4132411689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33c80b3b50 msgr2=0x7f33c8071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.659+0000 7f33ce927700 1 --2- 172.21.15.38:0/4132411689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33c80b3b50 0x7f33c8071950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f33c806e4f0 tx=0x7f33c000b330 comp rx=0 tx=0).stop 2023-07-11T00:00:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.659+0000 7f33ce927700 1 -- 172.21.15.38:0/4132411689 shutdown_connections 2023-07-11T00:00:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.659+0000 7f33ce927700 1 --2- 172.21.15.38:0/4132411689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33c80b3b50 0x7f33c8071950 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.659+0000 7f33ce927700 1 --2- 172.21.15.38:0/4132411689 >> v2:172.21.15.70:3300/0 conn(0x7f33c80b9340 0x7f33c8071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.659+0000 7f33ce927700 1 -- 172.21.15.38:0/4132411689 >> 172.21.15.38:0/4132411689 conn(0x7f33c80bd980 msgr2=0x7f33c80b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.659+0000 7f33ce927700 1 -- 172.21.15.38:0/4132411689 shutdown_connections 2023-07-11T00:00:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.659+0000 7f33ce927700 1 -- 172.21.15.38:0/4132411689 wait complete. 2023-07-11T00:00:51.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.660+0000 7f33ce927700 1 Processor -- start 2023-07-11T00:00:51.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.660+0000 7f33ce927700 1 -- start start 2023-07-11T00:00:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ce927700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c806b120 0x7f33c812c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ce927700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33c80b3b50 0x7f33c81e01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ce927700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33c80b9340 0x7f33c813c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ce927700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c81dd3f0 con 0x7f33c80b9340 2023-07-11T00:00:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ce927700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8146ff0 con 0x7f33c806b120 2023-07-11T00:00:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ce927700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c81dfd50 con 0x7f33c80b3b50 2023-07-11T00:00:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ccec4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33c80b9340 0x7f33c813c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ccec4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33c80b9340 0x7f33c813c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50060/0 (socket says 172.21.15.38:50060) 2023-07-11T00:00:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ccec4700 1 -- 172.21.15.38:0/2953405514 learned_addr learned my addr 172.21.15.38:0/2953405514 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33c7fff700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c806b120 0x7f33c812c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33c77fe700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33c80b3b50 0x7f33c81e01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ccec4700 1 -- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33c80b3b50 msgr2=0x7f33c81e01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ccec4700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33c80b3b50 0x7f33c81e01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ccec4700 1 -- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c806b120 msgr2=0x7f33c812c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ccec4700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c806b120 0x7f33c812c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ccec4700 1 -- 172.21.15.38:0/2953405514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c0009a70 con 0x7f33c80b9340 2023-07-11T00:00:51.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33c7fff700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c806b120 0x7f33c812c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:51.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33c77fe700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33c80b3b50 0x7f33c81e01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:51.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.661+0000 7f33ccec4700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33c80b9340 0x7f33c813c6e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f33c000b730 tx=0x7f33c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:51.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.662+0000 7f33c4ff9700 1 -- 172.21.15.38:0/2953405514 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0012430 con 0x7f33c80b9340 2023-07-11T00:00:51.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.662+0000 7f33c4ff9700 1 -- 172.21.15.38:0/2953405514 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c0020070 con 0x7f33c80b9340 2023-07-11T00:00:51.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.662+0000 7f33ce927700 1 -- 172.21.15.38:0/2953405514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c806f2b0 con 0x7f33c80b9340 2023-07-11T00:00:51.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.662+0000 7f33c4ff9700 1 -- 172.21.15.38:0/2953405514 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0004280 con 0x7f33c80b9340 2023-07-11T00:00:51.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.662+0000 7f33ce927700 1 -- 172.21.15.38:0/2953405514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c81df9e0 con 0x7f33c80b9340 2023-07-11T00:00:51.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.663+0000 7f33ce927700 1 -- 172.21.15.38:0/2953405514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c8074360 con 0x7f33c80b9340 2023-07-11T00:00:51.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.663+0000 7f33c4ff9700 1 -- 172.21.15.38:0/2953405514 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33c00043e0 con 0x7f33c80b9340 2023-07-11T00:00:51.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.663+0000 7f33c4ff9700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f33b406ace0 0x7f33b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:51.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.664+0000 7f33c4ff9700 1 -- 172.21.15.38:0/2953405514 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33c0022070 con 0x7f33c80b9340 2023-07-11T00:00:51.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.664+0000 7f33c7fff700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f33b406ace0 0x7f33b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:51.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.664+0000 7f33c7fff700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f33b406ace0 0x7f33b406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f33b8000f60 tx=0x7f33b8007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:51.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.668+0000 7f33c4ff9700 1 -- 172.21.15.38:0/2953405514 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f33c0056360 con 0x7f33c80b9340 2023-07-11T00:00:51.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.907+0000 7f33ce927700 1 -- 172.21.15.38:0/2953405514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33c81dfe90 con 0x7f33c80b9340 2023-07-11T00:00:51.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.908+0000 7f33c4ff9700 1 -- 172.21.15.38:0/2953405514 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3909 (secure 0 0 0) 0x7f33c0059980 con 0x7f33c80b9340 2023-07-11T00:00:51.912 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:51.912 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3612343661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3612343661},{"type":"v1","addr":"172.21.15.38:6834","nonce":3612343661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3097729806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3097729806},{"type":"v1","addr":"172.21.15.70:6835","nonce":3097729806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:00:16.787420+0000","modified":"2023-07-11T00:00:19.806642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3594015619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3594015619},{"type":"v1","addr":"172.21.15.38:6835","nonce":3594015619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-11T00:00:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 -- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f33b406ace0 msgr2=0x7f33b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f33b406ace0 0x7f33b406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f33b8000f60 tx=0x7f33b8007ca0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 -- 172.21.15.38:0/2953405514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33c80b9340 msgr2=0x7f33c813c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33c80b9340 0x7f33c813c6e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f33c000b730 tx=0x7f33c0004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 -- 172.21.15.38:0/2953405514 shutdown_connections 2023-07-11T00:00:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f33b406ace0 0x7f33b406d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33c80b9340 0x7f33c813c6e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c806b120 0x7f33c812c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 --2- 172.21.15.38:0/2953405514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33c80b3b50 0x7f33c81e01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 -- 172.21.15.38:0/2953405514 >> 172.21.15.38:0/2953405514 conn(0x7f33c80bd980 msgr2=0x7f33c80b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 -- 172.21.15.38:0/2953405514 shutdown_connections 2023-07-11T00:00:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:51.910+0000 7f33ce927700 1 -- 172.21.15.38:0/2953405514 wait complete. 2023-07-11T00:00:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 7 2023-07-11T00:00:51.925 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:52.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.047+0000 7f980f88f700 1 Processor -- start 2023-07-11T00:00:52.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.048+0000 7f980f88f700 1 -- start start 2023-07-11T00:00:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f980f88f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9808071a30 0x7f980814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f980f88f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9808070e70 con 0x7f9808141780 2023-07-11T00:00:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f980f88f700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98080ba720 con 0x7f98080b96b0 2023-07-11T00:00:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f980f88f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9808071ea0 con 0x7f9808071a30 2023-07-11T00:00:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f980d62b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9808141780 0x7f98080ba010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54408/0 (socket says 172.21.15.38:54408) 2023-07-11T00:00:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f980d62b700 1 -- 172.21.15.38:0/2031804680 learned_addr learned my addr 172.21.15.38:0/2031804680 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:52.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f980ce2a700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9808071a30 0x7f980814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907429403 0 0) 0x7f9808070e70 con 0x7f9808141780 2023-07-11T00:00:52.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f40035b0 con 0x7f9808141780 2023-07-11T00:00:52.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4069657557 0 0) 0x7f97f40035b0 con 0x7f9808141780 2023-07-11T00:00:52.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9808071a30 msgr2=0x7f980814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:52.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9808071a30 0x7f980814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 >> v1:172.21.15.70:6789/0 conn(0x7f98080b96b0 legacy=0x7f9808151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080b9b40 con 0x7f9808141780 2023-07-11T00:00:52.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f9804001670 con 0x7f9808141780 2023-07-11T00:00:52.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 >> v1:172.21.15.38:6789/0 conn(0x7f9808141780 legacy=0x7f98080ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97f4003a30 0x7f97f4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9808071a30 0x7f97f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97f4004d90 0x7f97f4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9808071ea0 con 0x7f97f4004d90 2023-07-11T00:00:52.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f400bac0 con 0x7f97f4003a30 2023-07-11T00:00:52.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.049+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f400bc50 con 0x7f9808071a30 2023-07-11T00:00:52.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f980de2c700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97f4004d90 0x7f97f4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f980d62b700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97f4003a30 0x7f97f4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f980ce2a700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9808071a30 0x7f97f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f980de2c700 1 -- 172.21.15.38:0/2031804680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9808071a30 msgr2=0x7f97f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:52.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f980de2c700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9808071a30 0x7f97f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f980de2c700 1 -- 172.21.15.38:0/2031804680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97f4003a30 msgr2=0x7f97f4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:52.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f980de2c700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97f4003a30 0x7f97f4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f980de2c700 1 -- 172.21.15.38:0/2031804680 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40035b0 con 0x7f97f4004d90 2023-07-11T00:00:52.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f980de2c700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97f4004d90 0x7f97f4005200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f980000c260 tx=0x7f97f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1d15ea42a11cd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:52.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800001e70 con 0x7f97f4004d90 2023-07-11T00:00:52.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980000ce20 con 0x7f97f4004d90 2023-07-11T00:00:52.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.050+0000 7f97fffff700 1 -- 172.21.15.38:0/2031804680 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800012660 con 0x7f97f4004d90 2023-07-11T00:00:52.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.051+0000 7f980f88f700 1 -- 172.21.15.38:0/2031804680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97f4004d90 msgr2=0x7f97f4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.051+0000 7f980f88f700 1 --2- 172.21.15.38:0/2031804680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97f4004d90 0x7f97f4005200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f980000c260 tx=0x7f97f4005880 comp rx=0 tx=0).stop 2023-07-11T00:00:52.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.051+0000 7f980de2c700 1 -- 172.21.15.38:0/2031804680 reap_dead start 2023-07-11T00:00:52.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.051+0000 7f980f88f700 1 -- 172.21.15.38:0/2031804680 shutdown_connections 2023-07-11T00:00:52.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.051+0000 7f980f88f700 1 -- 172.21.15.38:0/2031804680 >> 172.21.15.38:0/2031804680 conn(0x7f980806d0e0 msgr2=0x7f980806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:52.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.051+0000 7f980f88f700 1 -- 172.21.15.38:0/2031804680 shutdown_connections 2023-07-11T00:00:52.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.051+0000 7f980f88f700 1 -- 172.21.15.38:0/2031804680 wait complete. 2023-07-11T00:00:52.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.052+0000 7f980f88f700 1 Processor -- start 2023-07-11T00:00:52.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.052+0000 7f980f88f700 1 -- start start 2023-07-11T00:00:52.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.052+0000 7f980f88f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f97f4004d90 0x7f9808135c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.052+0000 7f980f88f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980813d780 0x7f980814b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.052+0000 7f980f88f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9808144100 0x7f9808132860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.052+0000 7f980f88f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9808136170 con 0x7f9808144100 2023-07-11T00:00:52.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980f88f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980814b690 con 0x7f980813d780 2023-07-11T00:00:52.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980f88f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980814acc0 con 0x7f97f4004d90 2023-07-11T00:00:52.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980de2c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9808144100 0x7f9808132860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980de2c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9808144100 0x7f9808132860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50064/0 (socket says 172.21.15.38:50064) 2023-07-11T00:00:52.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980de2c700 1 -- 172.21.15.38:0/1148252104 learned_addr learned my addr 172.21.15.38:0/1148252104 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:52.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980d62b700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f97f4004d90 0x7f9808135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980ce2a700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980813d780 0x7f980814b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980de2c700 1 -- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f97f4004d90 msgr2=0x7f9808135c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980de2c700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f97f4004d90 0x7f9808135c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980de2c700 1 -- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980813d780 msgr2=0x7f980814b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980de2c700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980813d780 0x7f980814b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980de2c700 1 -- 172.21.15.38:0/1148252104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9808144610 con 0x7f9808144100 2023-07-11T00:00:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980de2c700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9808144100 0x7f9808132860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f980000cfb0 tx=0x7f98000015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f97fdffb700 1 -- 172.21.15.38:0/1148252104 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800003c10 con 0x7f9808144100 2023-07-11T00:00:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f97fdffb700 1 -- 172.21.15.38:0/1148252104 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800003d70 con 0x7f9808144100 2023-07-11T00:00:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980f88f700 1 -- 172.21.15.38:0/1148252104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9808142d80 con 0x7f9808144100 2023-07-11T00:00:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f97fdffb700 1 -- 172.21.15.38:0/1148252104 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800005310 con 0x7f9808144100 2023-07-11T00:00:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.053+0000 7f980f88f700 1 -- 172.21.15.38:0/1148252104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9808143340 con 0x7f9808144100 2023-07-11T00:00:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.054+0000 7f980f88f700 1 -- 172.21.15.38:0/1148252104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9808074360 con 0x7f9808144100 2023-07-11T00:00:52.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.055+0000 7f97fdffb700 1 -- 172.21.15.38:0/1148252104 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9800005470 con 0x7f9808144100 2023-07-11T00:00:52.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.055+0000 7f97fdffb700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f97ec06ace0 0x7f97ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.055+0000 7f97fdffb700 1 -- 172.21.15.38:0/1148252104 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f980008aa70 con 0x7f9808144100 2023-07-11T00:00:52.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.055+0000 7f980d62b700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f97ec06ace0 0x7f97ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.056+0000 7f980d62b700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f97ec06ace0 0x7f97ec06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9804000c00 tx=0x7f9804000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:52.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.060+0000 7f97fdffb700 1 -- 172.21.15.38:0/1148252104 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9800055bb0 con 0x7f9808144100 2023-07-11T00:00:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.258+0000 7f980f88f700 1 -- 172.21.15.38:0/1148252104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f980814ae00 con 0x7f9808144100 2023-07-11T00:00:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.259+0000 7f97fdffb700 1 -- 172.21.15.38:0/1148252104 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f98000591d0 con 0x7f9808144100 2023-07-11T00:00:52.262 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:52.263 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:18.365470+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:00:14.572121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-11T00:00:15.763698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:00:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 -- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f97ec06ace0 msgr2=0x7f97ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f97ec06ace0 0x7f97ec06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9804000c00 tx=0x7f9804000f80 comp rx=0 tx=0).stop 2023-07-11T00:00:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 -- 172.21.15.38:0/1148252104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9808144100 msgr2=0x7f9808132860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9808144100 0x7f9808132860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f980000cfb0 tx=0x7f98000015b0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 -- 172.21.15.38:0/1148252104 shutdown_connections 2023-07-11T00:00:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f97ec06ace0 0x7f97ec06d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9808144100 0x7f9808132860 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f97f4004d90 0x7f9808135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 --2- 172.21.15.38:0/1148252104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980813d780 0x7f980814b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 -- 172.21.15.38:0/1148252104 >> 172.21.15.38:0/1148252104 conn(0x7f980806d0e0 msgr2=0x7f9808140270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 -- 172.21.15.38:0/1148252104 shutdown_connections 2023-07-11T00:00:52.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.261+0000 7f980f88f700 1 -- 172.21.15.38:0/1148252104 wait complete. 2023-07-11T00:00:52.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-11T00:00:52.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.400+0000 7f2d14549700 1 Processor -- start 2023-07-11T00:00:52.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.400+0000 7f2d14549700 1 -- start start 2023-07-11T00:00:52.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.401+0000 7f2d14549700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2d0c0717f0 0x7f2d0c0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.401+0000 7f2d14549700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c071bc0 0x7f2d0c0ba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.401+0000 7f2d14549700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c0ba010 con 0x7f2d0c0b8e60 2023-07-11T00:00:52.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.401+0000 7f2d14549700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c0b85a0 con 0x7f2d0c0717f0 2023-07-11T00:00:52.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.401+0000 7f2d14549700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c0b7470 con 0x7f2d0c071bc0 2023-07-11T00:00:52.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d11ae4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c071bc0 0x7f2d0c0ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d122e5700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2d0c0717f0 0x7f2d0c0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d11ae4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c071bc0 0x7f2d0c0ba3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:55026/0 (socket says 172.21.15.38:55026) 2023-07-11T00:00:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d11ae4700 1 -- 172.21.15.38:0/45325262 learned_addr learned my addr 172.21.15.38:0/45325262 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d12ae6700 1 --1- 172.21.15.38:0/45325262 >> v1:172.21.15.70:6789/0 conn(0x7f2d0c0b8e60 0x7f2d0c142410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:37332/0 (socket says 172.21.15.38:37332) 2023-07-11T00:00:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d11ae4700 1 -- 172.21.15.38:0/45325262 >> v2:172.21.15.70:3300/0 conn(0x7f2d0c0717f0 msgr2=0x7f2d0c0b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d11ae4700 1 --2- 172.21.15.38:0/45325262 >> v2:172.21.15.70:3300/0 conn(0x7f2d0c0717f0 0x7f2d0c0b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d11ae4700 1 -- 172.21.15.38:0/45325262 >> v1:172.21.15.70:6789/0 conn(0x7f2d0c0b8e60 legacy=0x7f2d0c142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d11ae4700 1 -- 172.21.15.38:0/45325262 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0b7750 con 0x7f2d0c071bc0 2023-07-11T00:00:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d122e5700 1 --2- 172.21.15.38:0/45325262 >> v2:172.21.15.70:3300/0 conn(0x7f2d0c0717f0 0x7f2d0c0b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d11ae4700 1 --2- 172.21.15.38:0/45325262 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c071bc0 0x7f2d0c0ba3e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009920 tx=0x7f2d08009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af84cb91b0910dc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d112e3700 1 -- 172.21.15.38:0/45325262 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08011830 con 0x7f2d0c071bc0 2023-07-11T00:00:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d112e3700 1 -- 172.21.15.38:0/45325262 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d08011990 con 0x7f2d0c071bc0 2023-07-11T00:00:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.402+0000 7f2d112e3700 1 -- 172.21.15.38:0/45325262 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08011d20 con 0x7f2d0c071bc0 2023-07-11T00:00:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.403+0000 7f2d14549700 1 -- 172.21.15.38:0/45325262 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c071bc0 msgr2=0x7f2d0c0ba3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.403+0000 7f2d14549700 1 --2- 172.21.15.38:0/45325262 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c071bc0 0x7f2d0c0ba3e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009920 tx=0x7f2d08009c30 comp rx=0 tx=0).stop 2023-07-11T00:00:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.403+0000 7f2d14549700 1 -- 172.21.15.38:0/45325262 shutdown_connections 2023-07-11T00:00:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.403+0000 7f2d14549700 1 --2- 172.21.15.38:0/45325262 >> v2:172.21.15.70:3300/0 conn(0x7f2d0c0717f0 0x7f2d0c0b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.403+0000 7f2d14549700 1 --2- 172.21.15.38:0/45325262 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c071bc0 0x7f2d0c0ba3e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.403+0000 7f2d14549700 1 -- 172.21.15.38:0/45325262 >> 172.21.15.38:0/45325262 conn(0x7f2d0c06d0e0 msgr2=0x7f2d0c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.403+0000 7f2d14549700 1 -- 172.21.15.38:0/45325262 shutdown_connections 2023-07-11T00:00:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.403+0000 7f2d14549700 1 -- 172.21.15.38:0/45325262 wait complete. 2023-07-11T00:00:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.404+0000 7f2d14549700 1 Processor -- start 2023-07-11T00:00:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.404+0000 7f2d14549700 1 -- start start 2023-07-11T00:00:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d14549700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c0717f0 0x7f2d0c06f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d14549700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d0c071bc0 0x7f2d0c13b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d14549700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d0c0b8e60 0x7f2d0c070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d14549700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c13be10 con 0x7f2d0c071bc0 2023-07-11T00:00:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d14549700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c1d04a0 con 0x7f2d0c0b8e60 2023-07-11T00:00:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d14549700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c1cfb70 con 0x7f2d0c0717f0 2023-07-11T00:00:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d11ae4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d0c071bc0 0x7f2d0c13b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d11ae4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d0c071bc0 0x7f2d0c13b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50068/0 (socket says 172.21.15.38:50068) 2023-07-11T00:00:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d11ae4700 1 -- 172.21.15.38:0/2999253833 learned_addr learned my addr 172.21.15.38:0/2999253833 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d12ae6700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d0c0b8e60 0x7f2d0c070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d122e5700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c0717f0 0x7f2d0c06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d11ae4700 1 -- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c0717f0 msgr2=0x7f2d0c06f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d11ae4700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c0717f0 0x7f2d0c06f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d11ae4700 1 -- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d0c0b8e60 msgr2=0x7f2d0c070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d11ae4700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d0c0b8e60 0x7f2d0c070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d11ae4700 1 -- 172.21.15.38:0/2999253833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc0094a0 con 0x7f2d0c071bc0 2023-07-11T00:00:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d11ae4700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d0c071bc0 0x7f2d0c13b8d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009130 tx=0x7f2d08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d02ffd700 1 -- 172.21.15.38:0/2999253833 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08004550 con 0x7f2d0c071bc0 2023-07-11T00:00:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d02ffd700 1 -- 172.21.15.38:0/2999253833 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0801f070 con 0x7f2d0c071bc0 2023-07-11T00:00:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d14549700 1 -- 172.21.15.38:0/2999253833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d08009550 con 0x7f2d0c071bc0 2023-07-11T00:00:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.405+0000 7f2d02ffd700 1 -- 172.21.15.38:0/2999253833 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d080038c0 con 0x7f2d0c071bc0 2023-07-11T00:00:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.406+0000 7f2d14549700 1 -- 172.21.15.38:0/2999253833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c1d0130 con 0x7f2d0c071bc0 2023-07-11T00:00:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.406+0000 7f2d14549700 1 -- 172.21.15.38:0/2999253833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c074360 con 0x7f2d0c071bc0 2023-07-11T00:00:52.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.407+0000 7f2d02ffd700 1 -- 172.21.15.38:0/2999253833 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d08003a20 con 0x7f2d0c071bc0 2023-07-11T00:00:52.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.407+0000 7f2d02ffd700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2cf006ace0 0x7f2cf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.407+0000 7f2d02ffd700 1 -- 172.21.15.38:0/2999253833 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d08021070 con 0x7f2d0c071bc0 2023-07-11T00:00:52.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.408+0000 7f2d122e5700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2cf006ace0 0x7f2cf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.408+0000 7f2d122e5700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2cf006ace0 0x7f2cf006d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc009d70 tx=0x7f2cfc009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:52.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.412+0000 7f2d02ffd700 1 -- 172.21.15.38:0/2999253833 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2d08055d70 con 0x7f2d0c071bc0 2023-07-11T00:00:52.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.653+0000 7f2d14549700 1 -- 172.21.15.38:0/2999253833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2d0c1d02c0 con 0x7f2d0c071bc0 2023-07-11T00:00:52.656 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-07-11T00:00:52.654+0000 7f86940e7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-11T00:00:52.667 INFO:tasks.ceph.mds.c.smithi038.stderr: -4023> 2023-07-11T00:00:22.409+0000 7f2d8a3a8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-11T00:00:52.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.666+0000 7f2d02ffd700 1 -- 172.21.15.38:0/2999253833 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2d08015090 con 0x7f2d0c071bc0 2023-07-11T00:00:52.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 -- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2cf006ace0 msgr2=0x7f2cf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2cf006ace0 0x7f2cf006d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc009d70 tx=0x7f2cfc009210 comp rx=0 tx=0).stop 2023-07-11T00:00:52.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 -- 172.21.15.38:0/2999253833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d0c071bc0 msgr2=0x7f2d0c13b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d0c071bc0 0x7f2d0c13b8d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009130 tx=0x7f2d08004750 comp rx=0 tx=0).stop 2023-07-11T00:00:52.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 -- 172.21.15.38:0/2999253833 shutdown_connections 2023-07-11T00:00:52.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2cf006ace0 0x7f2cf006d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d0c0b8e60 0x7f2d0c070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d0c0717f0 0x7f2d0c06f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 --2- 172.21.15.38:0/2999253833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d0c071bc0 0x7f2d0c13b8d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 -- 172.21.15.38:0/2999253833 >> 172.21.15.38:0/2999253833 conn(0x7f2d0c06d0e0 msgr2=0x7f2d0c069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:52.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 -- 172.21.15.38:0/2999253833 shutdown_connections 2023-07-11T00:00:52.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.668+0000 7f2d14549700 1 -- 172.21.15.38:0/2999253833 wait complete. 2023-07-11T00:00:52.673 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-11T00:00:52.684 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-11T00:00:52.697 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-07-11T00:00:52.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.810+0000 7f5d2ddaf700 1 Processor -- start 2023-07-11T00:00:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.811+0000 7f5d2ddaf700 1 -- start start 2023-07-11T00:00:52.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.811+0000 7f5d2ddaf700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5d280721e0 0x7f5d28071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.811+0000 7f5d2ddaf700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2806a640 con 0x7f5d28071670 2023-07-11T00:00:52.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.811+0000 7f5d2ddaf700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2806f680 con 0x7f5d28147dc0 2023-07-11T00:00:52.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.811+0000 7f5d2ddaf700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28072630 con 0x7f5d280721e0 2023-07-11T00:00:52.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.811+0000 7f5d27fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5d28071670 0x7f5d28154ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54432/0 (socket says 172.21.15.38:54432) 2023-07-11T00:00:52.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.811+0000 7f5d27fff700 1 -- 172.21.15.38:0/1970937072 learned_addr learned my addr 172.21.15.38:0/1970937072 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:52.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.811+0000 7f5d277fe700 1 --1- 172.21.15.38:0/1970937072 >> v1:172.21.15.70:6789/0 conn(0x7f5d28147dc0 0x7f5d28069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:37338/0 (socket says 172.21.15.38:37338) 2023-07-11T00:00:52.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.811+0000 7f5d26ffd700 1 --2- 172.21.15.38:0/1970937072 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5d280721e0 0x7f5d28071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.812+0000 7f5d267fc700 1 -- 172.21.15.38:0/1970937072 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501243038 0 0) 0x7f5d2806a640 con 0x7f5d28071670 2023-07-11T00:00:52.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.812+0000 7f5d267fc700 1 -- 172.21.15.38:0/1970937072 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d100035b0 con 0x7f5d28071670 2023-07-11T00:00:52.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.812+0000 7f5d26ffd700 1 -- 172.21.15.38:0/1970937072 >> v1:172.21.15.70:6789/0 conn(0x7f5d28147dc0 legacy=0x7f5d28069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.812+0000 7f5d26ffd700 1 -- 172.21.15.38:0/1970937072 >> v1:172.21.15.38:6789/0 conn(0x7f5d28071670 legacy=0x7f5d28154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.812+0000 7f5d26ffd700 1 -- 172.21.15.38:0/1970937072 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2806f920 con 0x7f5d280721e0 2023-07-11T00:00:52.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.812+0000 7f5d26ffd700 1 --2- 172.21.15.38:0/1970937072 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5d280721e0 0x7f5d28071130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009870 tx=0x7f5d1c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dd3dd2aa96b6017 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:52.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.813+0000 7f5d267fc700 1 -- 172.21.15.38:0/1970937072 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c011830 con 0x7f5d280721e0 2023-07-11T00:00:52.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.813+0000 7f5d267fc700 1 -- 172.21.15.38:0/1970937072 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c011990 con 0x7f5d280721e0 2023-07-11T00:00:52.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.813+0000 7f5d267fc700 1 -- 172.21.15.38:0/1970937072 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c011d20 con 0x7f5d280721e0 2023-07-11T00:00:52.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.813+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/1970937072 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5d280721e0 msgr2=0x7f5d28071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.813+0000 7f5d2ddaf700 1 --2- 172.21.15.38:0/1970937072 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5d280721e0 0x7f5d28071130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009870 tx=0x7f5d1c009b80 comp rx=0 tx=0).stop 2023-07-11T00:00:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.813+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/1970937072 shutdown_connections 2023-07-11T00:00:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.813+0000 7f5d2ddaf700 1 --2- 172.21.15.38:0/1970937072 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5d280721e0 0x7f5d28071130 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.813+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/1970937072 >> 172.21.15.38:0/1970937072 conn(0x7f5d2806d0e0 msgr2=0x7f5d2806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.813+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/1970937072 shutdown_connections 2023-07-11T00:00:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.813+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/1970937072 wait complete. 2023-07-11T00:00:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.814+0000 7f5d2ddaf700 1 Processor -- start 2023-07-11T00:00:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d2ddaf700 1 -- start start 2023-07-11T00:00:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d2ddaf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d28071670 0x7f5d280b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d2ddaf700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5d280721e0 0x7f5d2814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d2ddaf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28147dc0 0x7f5d280b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d2ddaf700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2814eb70 con 0x7f5d28147dc0 2023-07-11T00:00:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d2ddaf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2813fcb0 con 0x7f5d28071670 2023-07-11T00:00:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d2ddaf700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28140d60 con 0x7f5d280721e0 2023-07-11T00:00:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d27fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28147dc0 0x7f5d280b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d27fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28147dc0 0x7f5d280b6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50086/0 (socket says 172.21.15.38:50086) 2023-07-11T00:00:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d27fff700 1 -- 172.21.15.38:0/102820318 learned_addr learned my addr 172.21.15.38:0/102820318 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d26ffd700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5d280721e0 0x7f5d2814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.815+0000 7f5d277fe700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d28071670 0x7f5d280b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.816+0000 7f5d27fff700 1 -- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5d280721e0 msgr2=0x7f5d2814e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.816+0000 7f5d27fff700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5d280721e0 0x7f5d2814e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.816+0000 7f5d27fff700 1 -- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d28071670 msgr2=0x7f5d280b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.816+0000 7f5d27fff700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d28071670 0x7f5d280b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.816+0000 7f5d27fff700 1 -- 172.21.15.38:0/102820318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0094a0 con 0x7f5d28147dc0 2023-07-11T00:00:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.816+0000 7f5d27fff700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28147dc0 0x7f5d280b6810 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000cb40 tx=0x7f5d2000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.816+0000 7f5d0ffff700 1 -- 172.21.15.38:0/102820318 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000a9e0 con 0x7f5d28147dc0 2023-07-11T00:00:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.816+0000 7f5d0ffff700 1 -- 172.21.15.38:0/102820318 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2000ab40 con 0x7f5d28147dc0 2023-07-11T00:00:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.816+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/102820318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d280b60c0 con 0x7f5d28147dc0 2023-07-11T00:00:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.816+0000 7f5d0ffff700 1 -- 172.21.15.38:0/102820318 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20012400 con 0x7f5d28147dc0 2023-07-11T00:00:52.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.816+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/102820318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2813fec0 con 0x7f5d28147dc0 2023-07-11T00:00:52.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.817+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/102820318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d280b64f0 con 0x7f5d28147dc0 2023-07-11T00:00:52.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.817+0000 7f5d0ffff700 1 -- 172.21.15.38:0/102820318 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d2001b3b0 con 0x7f5d28147dc0 2023-07-11T00:00:52.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.818+0000 7f5d0ffff700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5d1406ace0 0x7f5d1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:52.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.818+0000 7f5d0ffff700 1 -- 172.21.15.38:0/102820318 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5d20089140 con 0x7f5d28147dc0 2023-07-11T00:00:52.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.818+0000 7f5d277fe700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5d1406ace0 0x7f5d1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.818+0000 7f5d277fe700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5d1406ace0 0x7f5d1406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d18000f60 tx=0x7f5d18007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:52.822+0000 7f5d0ffff700 1 -- 172.21.15.38:0/102820318 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5d20054110 con 0x7f5d28147dc0 2023-07-11T00:00:53.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.066+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/102820318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5d28074360 con 0x7f5d28147dc0 2023-07-11T00:00:53.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.663+0000 7f5d0ffff700 1 -- 172.21.15.38:0/102820318 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5d20057730 con 0x7f5d28147dc0 2023-07-11T00:00:53.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5d1406ace0 msgr2=0x7f5d1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:53.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5d1406ace0 0x7f5d1406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d18000f60 tx=0x7f5d18007eb0 comp rx=0 tx=0).stop 2023-07-11T00:00:53.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/102820318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28147dc0 msgr2=0x7f5d280b6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:53.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28147dc0 0x7f5d280b6810 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000cb40 tx=0x7f5d2000ce50 comp rx=0 tx=0).stop 2023-07-11T00:00:53.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/102820318 shutdown_connections 2023-07-11T00:00:53.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5d1406ace0 0x7f5d1406d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:53.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28147dc0 0x7f5d280b6810 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:53.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d28071670 0x7f5d280b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:53.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 --2- 172.21.15.38:0/102820318 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5d280721e0 0x7f5d2814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:53.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/102820318 >> 172.21.15.38:0/102820318 conn(0x7f5d2806d0e0 msgr2=0x7f5d280b9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:53.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/102820318 shutdown_connections 2023-07-11T00:00:53.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.667+0000 7f5d2ddaf700 1 -- 172.21.15.38:0/102820318 wait complete. 2023-07-11T00:00:53.685 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-11T00:00:53.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.862+0000 7f8818693700 1 Processor -- start 2023-07-11T00:00:53.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.862+0000 7f8818693700 1 -- start start 2023-07-11T00:00:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f8818693700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f88100bbf90 0x7f8810144840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f8818693700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88100bb380 con 0x7f88101443d0 2023-07-11T00:00:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f8818693700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88100bc4c0 con 0x7f88100b6980 2023-07-11T00:00:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f8818693700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88100b7dd0 con 0x7f88100bbf90 2023-07-11T00:00:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f8816c30700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f88100bbf90 0x7f8810144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f8815c2e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f88101443d0 0x7f88100bb880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54444/0 (socket says 172.21.15.38:54444) 2023-07-11T00:00:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f8815c2e700 1 -- 172.21.15.38:0/3487233750 learned_addr learned my addr 172.21.15.38:0/3487233750 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f8816c30700 1 -- 172.21.15.38:0/3487233750 >> v1:172.21.15.70:6789/0 conn(0x7f88100b6980 legacy=0x7f881014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f8816c30700 1 -- 172.21.15.38:0/3487233750 >> v1:172.21.15.38:6789/0 conn(0x7f88101443d0 legacy=0x7f88100bb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f8816c30700 1 -- 172.21.15.38:0/3487233750 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881014aff0 con 0x7f88100bbf90 2023-07-11T00:00:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f881542d700 1 -- 172.21.15.38:0/3487233750 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010852016 0 0) 0x7f88100bb380 con 0x7f88101443d0 2023-07-11T00:00:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f8816c30700 1 --2- 172.21.15.38:0/3487233750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88100bbf90 0x7f8810144840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8808009d90 tx=0x7f880800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a37d3ba85b03fe server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:53.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f881542d700 1 -- 172.21.15.38:0/3487233750 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880800e070 con 0x7f88100bbf90 2023-07-11T00:00:53.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.863+0000 7f881542d700 1 -- 172.21.15.38:0/3487233750 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880800bbd0 con 0x7f88100bbf90 2023-07-11T00:00:53.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.864+0000 7f881542d700 1 -- 172.21.15.38:0/3487233750 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808012430 con 0x7f88100bbf90 2023-07-11T00:00:53.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.864+0000 7f8818693700 1 -- 172.21.15.38:0/3487233750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88100bbf90 msgr2=0x7f8810144840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:53.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.864+0000 7f8818693700 1 --2- 172.21.15.38:0/3487233750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88100bbf90 0x7f8810144840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8808009d90 tx=0x7f880800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:53.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.864+0000 7f8818693700 1 -- 172.21.15.38:0/3487233750 shutdown_connections 2023-07-11T00:00:53.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.864+0000 7f8818693700 1 --2- 172.21.15.38:0/3487233750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88100bbf90 0x7f8810144840 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:53.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.864+0000 7f8818693700 1 -- 172.21.15.38:0/3487233750 >> 172.21.15.38:0/3487233750 conn(0x7f8810071660 msgr2=0x7f8810071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:53.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.864+0000 7f8818693700 1 -- 172.21.15.38:0/3487233750 shutdown_connections 2023-07-11T00:00:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.864+0000 7f8818693700 1 -- 172.21.15.38:0/3487233750 wait complete. 2023-07-11T00:00:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.865+0000 7f8818693700 1 Processor -- start 2023-07-11T00:00:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.865+0000 7f8818693700 1 -- start start 2023-07-11T00:00:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f8818693700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88100b6980 0x7f88100b95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f8818693700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f88100bbf90 0x7f8810142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f8818693700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88101443d0 0x7f881013e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f8818693700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88100b9b00 con 0x7f88100b6980 2023-07-11T00:00:53.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f8818693700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881013d210 con 0x7f88101443d0 2023-07-11T00:00:53.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f8818693700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88100b9d10 con 0x7f88100bbf90 2023-07-11T00:00:53.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f881642f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88100b6980 0x7f88100b95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:53.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f881642f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88100b6980 0x7f88100b95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50110/0 (socket says 172.21.15.38:50110) 2023-07-11T00:00:53.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f881642f700 1 -- 172.21.15.38:0/2037761629 learned_addr learned my addr 172.21.15.38:0/2037761629 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:53.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f8816c30700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88101443d0 0x7f881013e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:53.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f8815c2e700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f88100bbf90 0x7f8810142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:53.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f881642f700 1 -- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f88100bbf90 msgr2=0x7f8810142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:53.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f881642f700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f88100bbf90 0x7f8810142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:53.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f881642f700 1 -- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88101443d0 msgr2=0x7f881013e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:53.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f881642f700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88101443d0 0x7f881013e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:53.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f881642f700 1 -- 172.21.15.38:0/2037761629 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808009a70 con 0x7f88100b6980 2023-07-11T00:00:53.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f8815c2e700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f88100bbf90 0x7f8810142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:53.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.866+0000 7f881642f700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88100b6980 0x7f88100b95c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c450 tx=0x7f880c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:53.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.867+0000 7f8806ffd700 1 -- 172.21.15.38:0/2037761629 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0052d0 con 0x7f88100b6980 2023-07-11T00:00:53.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.867+0000 7f8806ffd700 1 -- 172.21.15.38:0/2037761629 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c005430 con 0x7f88100b6980 2023-07-11T00:00:53.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.867+0000 7f8818693700 1 -- 172.21.15.38:0/2037761629 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881014a640 con 0x7f88100b6980 2023-07-11T00:00:53.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.867+0000 7f8806ffd700 1 -- 172.21.15.38:0/2037761629 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0038c0 con 0x7f88100b6980 2023-07-11T00:00:53.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.867+0000 7f8818693700 1 -- 172.21.15.38:0/2037761629 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881013d490 con 0x7f88100b6980 2023-07-11T00:00:53.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.868+0000 7f8818693700 1 -- 172.21.15.38:0/2037761629 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88100ba1f0 con 0x7f88100b6980 2023-07-11T00:00:53.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.868+0000 7f8806ffd700 1 -- 172.21.15.38:0/2037761629 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f880c003a20 con 0x7f88100b6980 2023-07-11T00:00:53.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.869+0000 7f8806ffd700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f87f406ace0 0x7f87f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:53.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.869+0000 7f8806ffd700 1 -- 172.21.15.38:0/2037761629 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f880c088900 con 0x7f88100b6980 2023-07-11T00:00:53.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.869+0000 7f8815c2e700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f87f406ace0 0x7f87f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:53.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.869+0000 7f8815c2e700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f87f406ace0 0x7f87f406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f881014a8c0 tx=0x7f8800007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:53.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:53.873+0000 7f8806ffd700 1 -- 172.21.15.38:0/2037761629 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f88100ba1f0 con 0x7f88100b6980 2023-07-11T00:00:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.071+0000 7f8818693700 1 -- 172.21.15.38:0/2037761629 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f88100ba1f0 con 0x7f88100b6980 2023-07-11T00:00:54.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.667+0000 7f8806ffd700 1 -- 172.21.15.38:0/2037761629 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f88100ba1f0 con 0x7f88100b6980 2023-07-11T00:00:54.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.671+0000 7f8818693700 1 -- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f87f406ace0 msgr2=0x7f87f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:54.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.671+0000 7f8818693700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f87f406ace0 0x7f87f406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f881014a8c0 tx=0x7f8800007ce0 comp rx=0 tx=0).stop 2023-07-11T00:00:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.671+0000 7f8818693700 1 -- 172.21.15.38:0/2037761629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88100b6980 msgr2=0x7f88100b95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.671+0000 7f8818693700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88100b6980 0x7f88100b95c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c450 tx=0x7f880c00c760 comp rx=0 tx=0).stop 2023-07-11T00:00:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.671+0000 7f8818693700 1 -- 172.21.15.38:0/2037761629 shutdown_connections 2023-07-11T00:00:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.671+0000 7f8818693700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f87f406ace0 0x7f87f406d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.671+0000 7f8818693700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88101443d0 0x7f881013e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.671+0000 7f8818693700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88100b6980 0x7f88100b95c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.671+0000 7f8818693700 1 --2- 172.21.15.38:0/2037761629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f88100bbf90 0x7f8810142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:54.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.672+0000 7f8818693700 1 -- 172.21.15.38:0/2037761629 >> 172.21.15.38:0/2037761629 conn(0x7f8810071660 msgr2=0x7f881013de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:54.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.672+0000 7f8818693700 1 -- 172.21.15.38:0/2037761629 shutdown_connections 2023-07-11T00:00:54.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.672+0000 7f8818693700 1 -- 172.21.15.38:0/2037761629 wait complete. 2023-07-11T00:00:54.677 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-07-11T00:00:54.691 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-11T00:00:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.825+0000 7fa0e08b1700 1 Processor -- start 2023-07-11T00:00:54.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.825+0000 7fa0e08b1700 1 -- start start 2023-07-11T00:00:54.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.826+0000 7fa0e08b1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa0dc071d20 0x7fa0dc1458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.826+0000 7fa0e08b1700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0dc0709c0 0x7fa0dc145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.826+0000 7fa0e08b1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc070130 con 0x7fa0dc14bf30 2023-07-11T00:00:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.826+0000 7fa0e08b1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc146330 con 0x7fa0dc071d20 2023-07-11T00:00:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.826+0000 7fa0e08b1700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc070f80 con 0x7fa0dc0709c0 2023-07-11T00:00:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.826+0000 7fa0d9d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa0dc071d20 0x7fa0dc1458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.826+0000 7fa0da59c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa0dc14bf30 0x7fa0dc0b8ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54450/0 (socket says 172.21.15.38:54450) 2023-07-11T00:00:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.826+0000 7fa0da59c700 1 -- 172.21.15.38:0/2344854668 learned_addr learned my addr 172.21.15.38:0/2344854668 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.826+0000 7fa0dad9d700 1 --2- 172.21.15.38:0/2344854668 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0dc0709c0 0x7fa0dc145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.827+0000 7fa0d9d9b700 1 -- 172.21.15.38:0/2344854668 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0dc0709c0 msgr2=0x7fa0dc145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.827+0000 7fa0d9d9b700 1 --2- 172.21.15.38:0/2344854668 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0dc0709c0 0x7fa0dc145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.827+0000 7fa0d9d9b700 1 -- 172.21.15.38:0/2344854668 >> v1:172.21.15.38:6789/0 conn(0x7fa0dc14bf30 legacy=0x7fa0dc0b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.827+0000 7fa0d9d9b700 1 -- 172.21.15.38:0/2344854668 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc071260 con 0x7fa0dc071d20 2023-07-11T00:00:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.827+0000 7fa0d959a700 1 -- 172.21.15.38:0/2344854668 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110066608 0 0) 0x7fa0dc070130 con 0x7fa0dc14bf30 2023-07-11T00:00:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.827+0000 7fa0d9d9b700 1 --2- 172.21.15.38:0/2344854668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc071d20 0x7fa0dc1458b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009840 tx=0x7fa0cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e638a498089d1a39 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.827+0000 7fa0d959a700 1 -- 172.21.15.38:0/2344854668 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011830 con 0x7fa0dc071d20 2023-07-11T00:00:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.827+0000 7fa0d959a700 1 -- 172.21.15.38:0/2344854668 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc011990 con 0x7fa0dc071d20 2023-07-11T00:00:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.827+0000 7fa0d959a700 1 -- 172.21.15.38:0/2344854668 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011d20 con 0x7fa0dc071d20 2023-07-11T00:00:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.827+0000 7fa0e08b1700 1 -- 172.21.15.38:0/2344854668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc071d20 msgr2=0x7fa0dc1458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.827+0000 7fa0e08b1700 1 --2- 172.21.15.38:0/2344854668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc071d20 0x7fa0dc1458b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009840 tx=0x7fa0cc009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.828+0000 7fa0e08b1700 1 -- 172.21.15.38:0/2344854668 shutdown_connections 2023-07-11T00:00:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.828+0000 7fa0e08b1700 1 --2- 172.21.15.38:0/2344854668 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0dc0709c0 0x7fa0dc145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.828+0000 7fa0e08b1700 1 --2- 172.21.15.38:0/2344854668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc071d20 0x7fa0dc1458b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.828+0000 7fa0e08b1700 1 -- 172.21.15.38:0/2344854668 >> 172.21.15.38:0/2344854668 conn(0x7fa0dc0be670 msgr2=0x7fa0dc0bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.828+0000 7fa0e08b1700 1 -- 172.21.15.38:0/2344854668 shutdown_connections 2023-07-11T00:00:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.828+0000 7fa0e08b1700 1 -- 172.21.15.38:0/2344854668 wait complete. 2023-07-11T00:00:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.829+0000 7fa0e08b1700 1 Processor -- start 2023-07-11T00:00:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.829+0000 7fa0e08b1700 1 -- start start 2023-07-11T00:00:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.829+0000 7fa0e08b1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0dc0709c0 0x7fa0dc0b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.829+0000 7fa0e08b1700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0dc071d20 0x7fa0dc0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:54.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0e08b1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc14bf30 0x7fa0dc0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:54.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0e08b1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0b2d40 con 0x7fa0dc14bf30 2023-07-11T00:00:54.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0e08b1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0b2330 con 0x7fa0dc0709c0 2023-07-11T00:00:54.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0e08b1700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc06c270 con 0x7fa0dc071d20 2023-07-11T00:00:54.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0dad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc14bf30 0x7fa0dc0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:54.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0dad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc14bf30 0x7fa0dc0b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50132/0 (socket says 172.21.15.38:50132) 2023-07-11T00:00:54.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0dad9d700 1 -- 172.21.15.38:0/866417365 learned_addr learned my addr 172.21.15.38:0/866417365 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:54.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0d9d9b700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0dc071d20 0x7fa0dc0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:54.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0da59c700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0dc0709c0 0x7fa0dc0b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:54.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0dad9d700 1 -- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0dc071d20 msgr2=0x7fa0dc0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:54.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0dad9d700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0dc071d20 0x7fa0dc0b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:54.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0dad9d700 1 -- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0dc0709c0 msgr2=0x7fa0dc0b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:54.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0dad9d700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0dc0709c0 0x7fa0dc0b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:54.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0dad9d700 1 -- 172.21.15.38:0/866417365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc0094a0 con 0x7fa0dc14bf30 2023-07-11T00:00:54.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0da59c700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0dc0709c0 0x7fa0dc0b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:54.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0dad9d700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc14bf30 0x7fa0dc0b49f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400efc0 tx=0x7fa0d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:54.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0caffd700 1 -- 172.21.15.38:0/866417365 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4009ea0 con 0x7fa0dc14bf30 2023-07-11T00:00:54.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0caffd700 1 -- 172.21.15.38:0/866417365 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d400f040 con 0x7fa0dc14bf30 2023-07-11T00:00:54.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0e08b1700 1 -- 172.21.15.38:0/866417365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc06be80 con 0x7fa0dc14bf30 2023-07-11T00:00:54.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0caffd700 1 -- 172.21.15.38:0/866417365 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4014480 con 0x7fa0dc14bf30 2023-07-11T00:00:54.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.830+0000 7fa0e08b1700 1 -- 172.21.15.38:0/866417365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc142850 con 0x7fa0dc14bf30 2023-07-11T00:00:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.831+0000 7fa0e08b1700 1 -- 172.21.15.38:0/866417365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc06c3e0 con 0x7fa0dc14bf30 2023-07-11T00:00:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.832+0000 7fa0caffd700 1 -- 172.21.15.38:0/866417365 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0d40145e0 con 0x7fa0dc14bf30 2023-07-11T00:00:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.832+0000 7fa0caffd700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa0bc06ace0 0x7fa0bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.832+0000 7fa0caffd700 1 -- 172.21.15.38:0/866417365 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fa0d4089ed0 con 0x7fa0dc14bf30 2023-07-11T00:00:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.832+0000 7fa0da59c700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa0bc06ace0 0x7fa0bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.833+0000 7fa0da59c700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa0bc06ace0 0x7fa0bc06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0000f60 tx=0x7fa0d0007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:54.837+0000 7fa0caffd700 1 -- 172.21.15.38:0/866417365 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa0d40550d0 con 0x7fa0dc14bf30 2023-07-11T00:00:55.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.034+0000 7fa0e08b1700 1 -- 172.21.15.38:0/866417365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa0dc0b42d0 con 0x7fa0dc14bf30 2023-07-11T00:00:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.671+0000 7fa0caffd700 1 -- 172.21.15.38:0/866417365 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa0d40586f0 con 0x7fa0dc14bf30 2023-07-11T00:00:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 -- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa0bc06ace0 msgr2=0x7fa0bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa0bc06ace0 0x7fa0bc06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0000f60 tx=0x7fa0d0007d30 comp rx=0 tx=0).stop 2023-07-11T00:00:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 -- 172.21.15.38:0/866417365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc14bf30 msgr2=0x7fa0dc0b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc14bf30 0x7fa0dc0b49f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400efc0 tx=0x7fa0d400c3a0 comp rx=0 tx=0).stop 2023-07-11T00:00:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 -- 172.21.15.38:0/866417365 shutdown_connections 2023-07-11T00:00:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa0bc06ace0 0x7fa0bc06d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0dc14bf30 0x7fa0dc0b49f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0dc0709c0 0x7fa0dc0b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 --2- 172.21.15.38:0/866417365 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0dc071d20 0x7fa0dc0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 -- 172.21.15.38:0/866417365 >> 172.21.15.38:0/866417365 conn(0x7fa0dc0be670 msgr2=0x7fa0dc0bd210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 -- 172.21.15.38:0/866417365 shutdown_connections 2023-07-11T00:00:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.675+0000 7fa0e08b1700 1 -- 172.21.15.38:0/866417365 wait complete. 2023-07-11T00:00:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-07-11T00:00:55.694 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-11T00:00:55.695 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-11T00:00:55.695 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-11T00:00:55.695 INFO:teuthology.orchestra.run:waiting for 300 2023-07-11T00:00:55.695 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-11T00:00:55.696 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-11T00:00:55.696 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-11T00:00:55.696 INFO:teuthology.orchestra.run:waiting for 300 2023-07-11T00:00:55.696 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-11T00:00:55.697 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-11T00:00:55.697 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-11T00:00:55.697 INFO:teuthology.orchestra.run:waiting for 300 2023-07-11T00:00:55.705 INFO:tasks.ceph.mds.a:Stopped 2023-07-11T00:00:55.706 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-11T00:00:55.706 INFO:tasks.ceph.mds.c:Stopped 2023-07-11T00:00:55.707 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-11T00:00:55.708 INFO:tasks.ceph.mds.b:Stopped 2023-07-11T00:00:55.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-11T00:00:55.748 INFO:tasks.ceph.mds.a:Started 2023-07-11T00:00:55.748 DEBUG:teuthology.parallel:result is None 2023-07-11T00:00:55.749 INFO:tasks.ceph.mds.c:Started 2023-07-11T00:00:55.749 DEBUG:teuthology.parallel:result is None 2023-07-11T00:00:55.750 INFO:tasks.ceph.mds.b:Started 2023-07-11T00:00:55.750 DEBUG:teuthology.parallel:result is None 2023-07-11T00:00:55.751 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-11T00:00:55.833 INFO:tasks.ceph.mds.b.smithi070.stdout:starting mds.b at 2023-07-11T00:00:55.835 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-07-11T00:00:55.836 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-07-11T00:00:55.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.887+0000 7f13cdcc3700 1 Processor -- start 2023-07-11T00:00:55.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.887+0000 7f13cdcc3700 1 -- start start 2023-07-11T00:00:55.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.887+0000 7f13cdcc3700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f13c8144820 0x7f13c80b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:55.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.887+0000 7f13cdcc3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f13c80b5a10 0x7f13c80b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:55.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.887+0000 7f13cdcc3700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c80b5f00 con 0x7f13c814a800 2023-07-11T00:00:55.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.887+0000 7f13cdcc3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c80b61e0 con 0x7f13c80b5a10 2023-07-11T00:00:55.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.887+0000 7f13cdcc3700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c80c17d0 con 0x7f13c8144820 2023-07-11T00:00:55.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.887+0000 7f13beffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f13c80b5a10 0x7f13c80b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:55.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.887+0000 7f13beffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f13c80b5a10 0x7f13c80b6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50150/0 (socket says 172.21.15.38:50150) 2023-07-11T00:00:55.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.887+0000 7f13beffd700 1 -- 172.21.15.38:0/1626196511 learned_addr learned my addr 172.21.15.38:0/1626196511 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:55.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.887+0000 7f13c77fe700 1 --2- 172.21.15.38:0/1626196511 >> v2:172.21.15.70:3300/0 conn(0x7f13c8144820 0x7f13c80b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:55.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.888+0000 7f13beffd700 1 -- 172.21.15.38:0/1626196511 >> v2:172.21.15.70:3300/0 conn(0x7f13c8144820 msgr2=0x7f13c80b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:55.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.888+0000 7f13beffd700 1 --2- 172.21.15.38:0/1626196511 >> v2:172.21.15.70:3300/0 conn(0x7f13c8144820 0x7f13c80b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:55.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.888+0000 7f13beffd700 1 -- 172.21.15.38:0/1626196511 >> v1:172.21.15.70:6789/0 conn(0x7f13c814a800 legacy=0x7f13c814ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:55.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.888+0000 7f13beffd700 1 -- 172.21.15.38:0/1626196511 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c80b7160 con 0x7f13c80b5a10 2023-07-11T00:00:55.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.888+0000 7f13beffd700 1 --2- 172.21.15.38:0/1626196511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13c80b5a10 0x7f13c80b6b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f13c8067500 tx=0x7f13b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973a5ed11566c214 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:55.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.888+0000 7f13c6ffd700 1 -- 172.21.15.38:0/1626196511 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0011830 con 0x7f13c80b5a10 2023-07-11T00:00:55.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.888+0000 7f13c6ffd700 1 -- 172.21.15.38:0/1626196511 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b0011990 con 0x7f13c80b5a10 2023-07-11T00:00:55.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.888+0000 7f13c6ffd700 1 -- 172.21.15.38:0/1626196511 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0011d20 con 0x7f13c80b5a10 2023-07-11T00:00:55.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.889+0000 7f13cdcc3700 1 -- 172.21.15.38:0/1626196511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13c80b5a10 msgr2=0x7f13c80b6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:55.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.889+0000 7f13cdcc3700 1 --2- 172.21.15.38:0/1626196511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13c80b5a10 0x7f13c80b6b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f13c8067500 tx=0x7f13b0009bd0 comp rx=0 tx=0).stop 2023-07-11T00:00:55.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.889+0000 7f13cdcc3700 1 -- 172.21.15.38:0/1626196511 shutdown_connections 2023-07-11T00:00:55.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.889+0000 7f13cdcc3700 1 --2- 172.21.15.38:0/1626196511 >> v2:172.21.15.70:3300/0 conn(0x7f13c8144820 0x7f13c80b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:55.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.889+0000 7f13cdcc3700 1 --2- 172.21.15.38:0/1626196511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13c80b5a10 0x7f13c80b6b10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:55.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.889+0000 7f13cdcc3700 1 -- 172.21.15.38:0/1626196511 >> 172.21.15.38:0/1626196511 conn(0x7f13c80c08f0 msgr2=0x7f13c80c0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:55.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.889+0000 7f13cdcc3700 1 -- 172.21.15.38:0/1626196511 shutdown_connections 2023-07-11T00:00:55.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.889+0000 7f13cdcc3700 1 -- 172.21.15.38:0/1626196511 wait complete. 2023-07-11T00:00:55.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.890+0000 7f13cdcc3700 1 Processor -- start 2023-07-11T00:00:55.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.890+0000 7f13cdcc3700 1 -- start start 2023-07-11T00:00:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13cdcc3700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13c80b5a10 0x7f13c81d2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13cdcc3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13c8144820 0x7f13c81d1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13cdcc3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13c814a800 0x7f13c81d3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13cdcc3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c81d1ca0 con 0x7f13c8144820 2023-07-11T00:00:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13cdcc3700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c8147b70 con 0x7f13c814a800 2023-07-11T00:00:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13cdcc3700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c81475a0 con 0x7f13c80b5a10 2023-07-11T00:00:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13beffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13c8144820 0x7f13c81d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13beffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13c8144820 0x7f13c81d1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50156/0 (socket says 172.21.15.38:50156) 2023-07-11T00:00:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13beffd700 1 -- 172.21.15.38:0/767417555 learned_addr learned my addr 172.21.15.38:0/767417555 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13c77fe700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13c80b5a10 0x7f13c81d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13c7fff700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13c814a800 0x7f13c81d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:55.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13beffd700 1 -- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13c80b5a10 msgr2=0x7f13c81d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:55.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13beffd700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13c80b5a10 0x7f13c81d2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:55.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13beffd700 1 -- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13c814a800 msgr2=0x7f13c81d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:55.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13beffd700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13c814a800 0x7f13c81d3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:55.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13beffd700 1 -- 172.21.15.38:0/767417555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0009550 con 0x7f13c8144820 2023-07-11T00:00:55.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.891+0000 7f13c7fff700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13c814a800 0x7f13c81d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:55.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.892+0000 7f13beffd700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13c8144820 0x7f13c81d1340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009c10 tx=0x7f13b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:55.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.892+0000 7f13c4ff9700 1 -- 172.21.15.38:0/767417555 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0004570 con 0x7f13c8144820 2023-07-11T00:00:55.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.892+0000 7f13c4ff9700 1 -- 172.21.15.38:0/767417555 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b001f070 con 0x7f13c8144820 2023-07-11T00:00:55.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.892+0000 7f13cdcc3700 1 -- 172.21.15.38:0/767417555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c81d2c50 con 0x7f13c8144820 2023-07-11T00:00:55.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.892+0000 7f13c4ff9700 1 -- 172.21.15.38:0/767417555 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00038e0 con 0x7f13c8144820 2023-07-11T00:00:55.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.892+0000 7f13cdcc3700 1 -- 172.21.15.38:0/767417555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c814a2d0 con 0x7f13c8144820 2023-07-11T00:00:55.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.893+0000 7f13cdcc3700 1 -- 172.21.15.38:0/767417555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c8074360 con 0x7f13c8144820 2023-07-11T00:00:55.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.893+0000 7f13c4ff9700 1 -- 172.21.15.38:0/767417555 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13b0021030 con 0x7f13c8144820 2023-07-11T00:00:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.894+0000 7f13c4ff9700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f13a806ace0 0x7f13a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.894+0000 7f13c4ff9700 1 -- 172.21.15.38:0/767417555 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f13b008a6c0 con 0x7f13c8144820 2023-07-11T00:00:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.894+0000 7f13c77fe700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f13a806ace0 0x7f13a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.894+0000 7f13c77fe700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f13a806ace0 0x7f13a806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009b70 tx=0x7f13b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:55.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:55.899+0000 7f13c4ff9700 1 -- 172.21.15.38:0/767417555 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f13b0055a80 con 0x7f13c8144820 2023-07-11T00:00:56.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.129+0000 7f13cdcc3700 1 -- 172.21.15.38:0/767417555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f13c8147cb0 con 0x7f13c8144820 2023-07-11T00:00:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.701+0000 7f13c4ff9700 1 -- 172.21.15.38:0/767417555 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f13b00590a0 con 0x7f13c8144820 2023-07-11T00:00:56.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 -- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f13a806ace0 msgr2=0x7f13a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:56.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f13a806ace0 0x7f13a806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009b70 tx=0x7f13b8008040 comp rx=0 tx=0).stop 2023-07-11T00:00:56.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 -- 172.21.15.38:0/767417555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13c8144820 msgr2=0x7f13c81d1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:56.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13c8144820 0x7f13c81d1340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009c10 tx=0x7f13b0004750 comp rx=0 tx=0).stop 2023-07-11T00:00:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 -- 172.21.15.38:0/767417555 shutdown_connections 2023-07-11T00:00:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f13a806ace0 0x7f13a806d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13c814a800 0x7f13c81d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13c80b5a10 0x7f13c81d2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 --2- 172.21.15.38:0/767417555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13c8144820 0x7f13c81d1340 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 -- 172.21.15.38:0/767417555 >> 172.21.15.38:0/767417555 conn(0x7f13c80c08f0 msgr2=0x7f13c80bf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 -- 172.21.15.38:0/767417555 shutdown_connections 2023-07-11T00:00:56.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.704+0000 7f13cdcc3700 1 -- 172.21.15.38:0/767417555 wait complete. 2023-07-11T00:00:56.708 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blocklist entries 2023-07-11T00:00:56.722 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-11T00:00:56.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.853+0000 7f8ca6093700 1 Processor -- start 2023-07-11T00:00:56.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.853+0000 7f8ca6093700 1 -- start start 2023-07-11T00:00:56.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.854+0000 7f8ca6093700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8ca006f340 0x7f8ca006edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:56.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.854+0000 7f8ca6093700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca00b93e0 con 0x7f8ca0071ab0 2023-07-11T00:00:56.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.854+0000 7f8ca6093700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca0141200 con 0x7f8ca006b120 2023-07-11T00:00:56.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.854+0000 7f8ca6093700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca0071690 con 0x7f8ca006f340 2023-07-11T00:00:56.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.854+0000 7f8c97fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8ca0071ab0 0x7f8ca014f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54468/0 (socket says 172.21.15.38:54468) 2023-07-11T00:00:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.854+0000 7f8c97fff700 1 -- 172.21.15.38:0/2269798619 learned_addr learned my addr 172.21.15.38:0/2269798619 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9ffff700 1 --2- 172.21.15.38:0/2269798619 >> v2:172.21.15.70:3300/0 conn(0x7f8ca006f340 0x7f8ca006edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9effd700 1 -- 172.21.15.38:0/2269798619 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014380868 0 0) 0x7f8ca00b93e0 con 0x7f8ca0071ab0 2023-07-11T00:00:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9effd700 1 -- 172.21.15.38:0/2269798619 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c8c0046c0 con 0x7f8ca0071ab0 2023-07-11T00:00:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9effd700 1 -- 172.21.15.38:0/2269798619 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128501749 0 0) 0x7f8ca0141200 con 0x7f8ca006b120 2023-07-11T00:00:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9effd700 1 -- 172.21.15.38:0/2269798619 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca00b93e0 con 0x7f8ca006b120 2023-07-11T00:00:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9effd700 1 -- 172.21.15.38:0/2269798619 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310844396 0 0) 0x7f8c8c0046c0 con 0x7f8ca0071ab0 2023-07-11T00:00:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9ffff700 1 -- 172.21.15.38:0/2269798619 >> v1:172.21.15.70:6789/0 conn(0x7f8ca006b120 legacy=0x7f8ca0140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9ffff700 1 -- 172.21.15.38:0/2269798619 >> v1:172.21.15.38:6789/0 conn(0x7f8ca0071ab0 legacy=0x7f8ca014f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9ffff700 1 -- 172.21.15.38:0/2269798619 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca006f8d0 con 0x7f8ca006f340 2023-07-11T00:00:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9ffff700 1 --2- 172.21.15.38:0/2269798619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ca006f340 0x7f8ca006edc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009d90 tx=0x7f8c9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a13008f42c7f47 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:56.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9effd700 1 -- 172.21.15.38:0/2269798619 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800e070 con 0x7f8ca006f340 2023-07-11T00:00:56.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9effd700 1 -- 172.21.15.38:0/2269798619 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c98003a20 con 0x7f8ca006f340 2023-07-11T00:00:56.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.855+0000 7f8c9effd700 1 -- 172.21.15.38:0/2269798619 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88001670 con 0x7f8ca006f340 2023-07-11T00:00:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.856+0000 7f8ca6093700 1 -- 172.21.15.38:0/2269798619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ca006f340 msgr2=0x7f8ca006edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.856+0000 7f8ca6093700 1 --2- 172.21.15.38:0/2269798619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ca006f340 0x7f8ca006edc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009d90 tx=0x7f8c9800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.856+0000 7f8ca6093700 1 -- 172.21.15.38:0/2269798619 shutdown_connections 2023-07-11T00:00:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.856+0000 7f8ca6093700 1 --2- 172.21.15.38:0/2269798619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ca006f340 0x7f8ca006edc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:56.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.856+0000 7f8ca6093700 1 -- 172.21.15.38:0/2269798619 >> 172.21.15.38:0/2269798619 conn(0x7f8ca00bd980 msgr2=0x7f8ca00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:56.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.856+0000 7f8ca6093700 1 -- 172.21.15.38:0/2269798619 shutdown_connections 2023-07-11T00:00:56.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.856+0000 7f8ca6093700 1 -- 172.21.15.38:0/2269798619 wait complete. 2023-07-11T00:00:56.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.857+0000 7f8ca6093700 1 Processor -- start 2023-07-11T00:00:56.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.857+0000 7f8ca6093700 1 -- start start 2023-07-11T00:00:56.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8ca6093700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ca006b120 0x7f8ca00b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:56.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8ca6093700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ca006f340 0x7f8ca0143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:56.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8ca6093700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ca0071ab0 0x7f8ca0142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:56.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8ca6093700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00b6810 con 0x7f8ca006f340 2023-07-11T00:00:56.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8ca6093700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca013ec90 con 0x7f8ca006b120 2023-07-11T00:00:56.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8ca6093700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca01d0890 con 0x7f8ca0071ab0 2023-07-11T00:00:56.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c97fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ca006f340 0x7f8ca0143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:56.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c97fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ca006f340 0x7f8ca0143b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50158/0 (socket says 172.21.15.38:50158) 2023-07-11T00:00:56.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c97fff700 1 -- 172.21.15.38:0/4288989065 learned_addr learned my addr 172.21.15.38:0/4288989065 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:56.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c9ffff700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ca0071ab0 0x7f8ca0142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:56.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c9f7fe700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ca006b120 0x7f8ca00b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:56.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c97fff700 1 -- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ca0071ab0 msgr2=0x7f8ca0142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:56.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c97fff700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ca0071ab0 0x7f8ca0142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:56.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c97fff700 1 -- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ca006b120 msgr2=0x7f8ca00b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:56.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c97fff700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ca006b120 0x7f8ca00b62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:56.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c97fff700 1 -- 172.21.15.38:0/4288989065 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c98009a70 con 0x7f8ca006f340 2023-07-11T00:00:56.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c97fff700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ca006f340 0x7f8ca0143b20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c6e0 tx=0x7f8c8800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:56.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c9cff9700 1 -- 172.21.15.38:0/4288989065 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88004c80 con 0x7f8ca006f340 2023-07-11T00:00:56.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c9cff9700 1 -- 172.21.15.38:0/4288989065 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c88004de0 con 0x7f8ca006f340 2023-07-11T00:00:56.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8ca6093700 1 -- 172.21.15.38:0/4288989065 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca00b6ae0 con 0x7f8ca006f340 2023-07-11T00:00:56.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.858+0000 7f8c9cff9700 1 -- 172.21.15.38:0/4288989065 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c880072f0 con 0x7f8ca006f340 2023-07-11T00:00:56.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.859+0000 7f8ca6093700 1 -- 172.21.15.38:0/4288989065 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca01d0240 con 0x7f8ca006f340 2023-07-11T00:00:56.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.859+0000 7f8ca6093700 1 -- 172.21.15.38:0/4288989065 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca0074360 con 0x7f8ca006f340 2023-07-11T00:00:56.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.860+0000 7f8c9cff9700 1 -- 172.21.15.38:0/4288989065 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c88007520 con 0x7f8ca006f340 2023-07-11T00:00:56.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.860+0000 7f8c9cff9700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8c8006ace0 0x7f8c8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:56.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.860+0000 7f8c9cff9700 1 -- 172.21.15.38:0/4288989065 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8c88088df0 con 0x7f8ca006f340 2023-07-11T00:00:56.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.861+0000 7f8c9f7fe700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8c8006ace0 0x7f8c8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.861+0000 7f8c9f7fe700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8c8006ace0 0x7f8c8006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8c900011e0 tx=0x7f8c90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:56.865+0000 7f8c9cff9700 1 -- 172.21.15.38:0/4288989065 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8c88054200 con 0x7f8ca006f340 2023-07-11T00:00:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.143+0000 7f8ca6093700 1 -- 172.21.15.38:0/4288989065 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8ca01d09d0 con 0x7f8ca006f340 2023-07-11T00:00:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.144+0000 7f8c9cff9700 1 -- 172.21.15.38:0/4288989065 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f8c88057820 con 0x7f8ca006f340 2023-07-11T00:00:57.146 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:00:57.146 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-07-11T00:00:57.146 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2023-07-11T00:00:57.146 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.147 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2023-07-11T00:00:57.147 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBWm6xkbB8QLRAA+IQjo9ZNyYp9OGIs2tnqag==", 2023-07-11T00:00:57.147 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.147 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-07-11T00:00:57.147 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-07-11T00:00:57.147 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-07-11T00:00:57.147 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.147 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.148 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.148 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2023-07-11T00:00:57.148 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBWm6xkJ3F+ORAAWiFR4khi2jq+tsviZacfAg==", 2023-07-11T00:00:57.148 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.148 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-07-11T00:00:57.148 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-07-11T00:00:57.149 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-07-11T00:00:57.149 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.149 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.149 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.149 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.149 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.c", 2023-07-11T00:00:57.149 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBWm6xkYD99NBAAx5BeEt4Aiz3YzqO1xA7K0Q==", 2023-07-11T00:00:57.150 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.150 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-07-11T00:00:57.150 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-07-11T00:00:57.150 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-07-11T00:00:57.150 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.150 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.151 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.151 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.151 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2023-07-11T00:00:57.151 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBdm6xkkEk1FRAAvhNW50CDb2JTxTYd9UYxfg==", 2023-07-11T00:00:57.151 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.151 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-07-11T00:00:57.151 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-07-11T00:00:57.151 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2023-07-11T00:00:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBgm6xknYRWFRAAiPrNBYnp4QYUeeaYQd1ccA==", 2023-07-11T00:00:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-07-11T00:00:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-07-11T00:00:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2023-07-11T00:00:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBjm6xkltMgFRAAZCnjPeWhPMuVtpE9Dg5oqg==", 2023-07-11T00:00:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-07-11T00:00:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-07-11T00:00:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2023-07-11T00:00:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBmm6xkMAqqFRAA93MscOA23FCPHGQVO+uFWA==", 2023-07-11T00:00:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-07-11T00:00:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-07-11T00:00:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.156 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2023-07-11T00:00:57.156 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBqm6xkHTZpIRAA1Ym+ij8qSYuqBpPDKH5dAg==", 2023-07-11T00:00:57.156 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.156 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-07-11T00:00:57.156 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-07-11T00:00:57.156 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.156 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.156 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.157 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.157 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2023-07-11T00:00:57.157 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBtm6xkRs1VHxAAFc+RXZsL0wfXu9sOjpoEIA==", 2023-07-11T00:00:57.157 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.157 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-07-11T00:00:57.157 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-07-11T00:00:57.157 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.158 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.158 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.158 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.158 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2023-07-11T00:00:57.158 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBwm6xkSLymHRAAEhCG8B5mMyral0VLsnXaPw==", 2023-07-11T00:00:57.159 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.159 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-07-11T00:00:57.159 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-07-11T00:00:57.159 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.159 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.159 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.159 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.160 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2023-07-11T00:00:57.160 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBzm6xkqg5AHBAAyCqCl7EPuYidSwdtZK2brg==", 2023-07-11T00:00:57.160 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.160 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-07-11T00:00:57.160 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-07-11T00:00:57.160 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.160 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.160 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.161 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.161 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2023-07-11T00:00:57.161 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBXm6xks53eBRAAIEobJD+VB3RoJP54ghJ6rw==", 2023-07-11T00:00:57.161 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.161 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-07-11T00:00:57.161 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-07-11T00:00:57.162 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-07-11T00:00:57.162 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-07-11T00:00:57.162 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.162 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.162 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.162 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2023-07-11T00:00:57.162 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBWm6xkpB9DARAAb1EeiWTaX/KaKrt6QktY8A==", 2023-07-11T00:00:57.163 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.163 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-07-11T00:00:57.163 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-07-11T00:00:57.163 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-07-11T00:00:57.163 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.163 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.164 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.164 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-mds", 2023-07-11T00:00:57.164 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQB+m6xkE8VKAxAAsFF+RflFvGtYtq2KH7gKGw==", 2023-07-11T00:00:57.165 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.165 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-mds" 2023-07-11T00:00:57.165 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.165 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.166 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.166 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-mgr", 2023-07-11T00:00:57.166 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQB+m6xk+dFKAxAA6td2IcU9FS5DKZiZ4Vv3FA==", 2023-07-11T00:00:57.167 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.167 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-11T00:00:57.167 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.168 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.168 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-osd", 2023-07-11T00:00:57.168 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQB+m6xk7NpKAxAAZ6WfXDXxbPoVqYz+hIKW5g==", 2023-07-11T00:00:57.168 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.168 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-osd" 2023-07-11T00:00:57.169 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.169 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.169 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.169 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-rbd", 2023-07-11T00:00:57.169 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQB+m6xkbuNKAxAATQG5VDKLN+TpJeN/dHoFZQ==", 2023-07-11T00:00:57.169 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.169 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-11T00:00:57.170 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.170 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.170 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-11T00:00:57.170 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQB+m6xkVuxKAxAAb9hJeJGr4Hf2lFnPjwZ7aA==", 2023-07-11T00:00:57.170 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.170 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-11T00:00:57.170 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.171 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.171 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-rgw", 2023-07-11T00:00:57.171 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQB+m6xkRvVKAxAADwD1/WW7BzUDoyb5Qsm1yw==", 2023-07-11T00:00:57.171 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.171 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-11T00:00:57.171 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.172 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.172 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2023-07-11T00:00:57.172 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBWm6xkP0BeJhAAIC3BuVWuqfhP42wHBPXdjw==", 2023-07-11T00:00:57.172 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.172 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-07-11T00:00:57.172 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-07-11T00:00:57.172 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.173 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:00:57.173 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:00:57.173 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2023-07-11T00:00:57.173 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBWm6xk5dYbIhAAQUtVeI5z3hKzqjyrdkKBGg==", 2023-07-11T00:00:57.173 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-07-11T00:00:57.173 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-07-11T00:00:57.173 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-07-11T00:00:57.174 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-07-11T00:00:57.174 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.174 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:00:57.174 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-07-11T00:00:57.174 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-07-11T00:00:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 -- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8c8006ace0 msgr2=0x7f8c8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8c8006ace0 0x7f8c8006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8c900011e0 tx=0x7f8c90009040 comp rx=0 tx=0).stop 2023-07-11T00:00:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 -- 172.21.15.38:0/4288989065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ca006f340 msgr2=0x7f8ca0143b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ca006f340 0x7f8ca0143b20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c6e0 tx=0x7f8c8800c9f0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 -- 172.21.15.38:0/4288989065 shutdown_connections 2023-07-11T00:00:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8c8006ace0 0x7f8c8006d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8ca0071ab0 0x7f8ca0142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ca006b120 0x7f8ca00b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 --2- 172.21.15.38:0/4288989065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ca006f340 0x7f8ca0143b20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 -- 172.21.15.38:0/4288989065 >> 172.21.15.38:0/4288989065 conn(0x7f8ca00bd980 msgr2=0x7f8ca013f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:57.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 -- 172.21.15.38:0/4288989065 shutdown_connections 2023-07-11T00:00:57.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.146+0000 7f8ca6093700 1 -- 172.21.15.38:0/4288989065 wait complete. 2023-07-11T00:00:57.177 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-11T00:00:57.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.302+0000 7f5429b12700 1 Processor -- start 2023-07-11T00:00:57.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.302+0000 7f5429b12700 1 -- start start 2023-07-11T00:00:57.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5429b12700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54240bc810 0x7f54240ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5429b12700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f54240b8d90 0x7f542406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5429b12700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54240b8620 con 0x7f54241449d0 2023-07-11T00:00:57.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5429b12700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54240b97a0 con 0x7f54240b8d90 2023-07-11T00:00:57.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5429b12700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5424144da0 con 0x7f54240bc810 2023-07-11T00:00:57.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5423fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f54240b8d90 0x7f542406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5423fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f54240b8d90 0x7f542406ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50164/0 (socket says 172.21.15.38:50164) 2023-07-11T00:00:57.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5423fff700 1 -- 172.21.15.38:0/3496282028 learned_addr learned my addr 172.21.15.38:0/3496282028 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:57.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5422ffd700 1 --2- 172.21.15.38:0/3496282028 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54240bc810 0x7f54240ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5423fff700 1 -- 172.21.15.38:0/3496282028 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54240bc810 msgr2=0x7f54240ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:57.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5423fff700 1 --2- 172.21.15.38:0/3496282028 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54240bc810 0x7f54240ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5423fff700 1 -- 172.21.15.38:0/3496282028 >> v1:172.21.15.70:6789/0 conn(0x7f54241449d0 legacy=0x7f542414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:57.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5423fff700 1 -- 172.21.15.38:0/3496282028 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54240b8900 con 0x7f54240b8d90 2023-07-11T00:00:57.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.303+0000 7f5423fff700 1 --2- 172.21.15.38:0/3496282028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240b8d90 0x7f542406ade0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f541c009e50 tx=0x7f541c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c632368ffc72d16a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:57.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.304+0000 7f54227fc700 1 -- 172.21.15.38:0/3496282028 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00e070 con 0x7f54240b8d90 2023-07-11T00:00:57.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.304+0000 7f54227fc700 1 -- 172.21.15.38:0/3496282028 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00b910 con 0x7f54240b8d90 2023-07-11T00:00:57.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.304+0000 7f54227fc700 1 -- 172.21.15.38:0/3496282028 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00bcc0 con 0x7f54240b8d90 2023-07-11T00:00:57.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.304+0000 7f5429b12700 1 -- 172.21.15.38:0/3496282028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240b8d90 msgr2=0x7f542406ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:57.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.304+0000 7f5429b12700 1 --2- 172.21.15.38:0/3496282028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240b8d90 0x7f542406ade0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f541c009e50 tx=0x7f541c00b330 comp rx=0 tx=0).stop 2023-07-11T00:00:57.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.304+0000 7f5429b12700 1 -- 172.21.15.38:0/3496282028 shutdown_connections 2023-07-11T00:00:57.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.304+0000 7f5429b12700 1 --2- 172.21.15.38:0/3496282028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240b8d90 0x7f542406ade0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.304+0000 7f5429b12700 1 --2- 172.21.15.38:0/3496282028 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54240bc810 0x7f54240ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.304+0000 7f5429b12700 1 -- 172.21.15.38:0/3496282028 >> 172.21.15.38:0/3496282028 conn(0x7f54240c0860 msgr2=0x7f54240c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:57.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.304+0000 7f5429b12700 1 -- 172.21.15.38:0/3496282028 shutdown_connections 2023-07-11T00:00:57.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.304+0000 7f5429b12700 1 -- 172.21.15.38:0/3496282028 wait complete. 2023-07-11T00:00:57.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.306+0000 7f5429b12700 1 Processor -- start 2023-07-11T00:00:57.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.306+0000 7f5429b12700 1 -- start start 2023-07-11T00:00:57.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5429b12700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54240b8d90 0x7f54241e3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5429b12700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54240bc810 0x7f54241d3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5429b12700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54241449d0 0x7f54240b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5429b12700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542414a5c0 con 0x7f54241449d0 2023-07-11T00:00:57.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5429b12700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5424142f80 con 0x7f54240bc810 2023-07-11T00:00:57.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5429b12700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54241d5980 con 0x7f54240b8d90 2023-07-11T00:00:57.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5423fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54241449d0 0x7f54240b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5423fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54241449d0 0x7f54240b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50174/0 (socket says 172.21.15.38:50174) 2023-07-11T00:00:57.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5423fff700 1 -- 172.21.15.38:0/4214236793 learned_addr learned my addr 172.21.15.38:0/4214236793 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:57.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5422ffd700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54240bc810 0x7f54241d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5423fff700 1 -- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54240b8d90 msgr2=0x7f54241e3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:57.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f54237fe700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54240b8d90 0x7f54241e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5423fff700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54240b8d90 0x7f54241e3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5423fff700 1 -- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54240bc810 msgr2=0x7f54241d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:57.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5423fff700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54240bc810 0x7f54241d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5423fff700 1 -- 172.21.15.38:0/4214236793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c009b30 con 0x7f54241449d0 2023-07-11T00:00:57.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5422ffd700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54240bc810 0x7f54241d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:57.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f54237fe700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54240b8d90 0x7f54241e3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:00:57.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5423fff700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54241449d0 0x7f54240b36a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f542406d000 tx=0x7f541c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:57.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f541bfff700 1 -- 172.21.15.38:0/4214236793 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c0099b0 con 0x7f54241449d0 2023-07-11T00:00:57.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f541bfff700 1 -- 172.21.15.38:0/4214236793 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c0092e0 con 0x7f54241449d0 2023-07-11T00:00:57.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f5429b12700 1 -- 172.21.15.38:0/4214236793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54241d5c60 con 0x7f54241449d0 2023-07-11T00:00:57.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.307+0000 7f541bfff700 1 -- 172.21.15.38:0/4214236793 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c01c640 con 0x7f54241449d0 2023-07-11T00:00:57.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.308+0000 7f5429b12700 1 -- 172.21.15.38:0/4214236793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54241d51a0 con 0x7f54241449d0 2023-07-11T00:00:57.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.309+0000 7f5429b12700 1 -- 172.21.15.38:0/4214236793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542414a3b0 con 0x7f54241449d0 2023-07-11T00:00:57.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.309+0000 7f541bfff700 1 -- 172.21.15.38:0/4214236793 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f541c01c7a0 con 0x7f54241449d0 2023-07-11T00:00:57.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.309+0000 7f541bfff700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f540406ace0 0x7f540406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.309+0000 7f541bfff700 1 -- 172.21.15.38:0/4214236793 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f541c08af10 con 0x7f54241449d0 2023-07-11T00:00:57.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.309+0000 7f54237fe700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f540406ace0 0x7f540406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.310+0000 7f54237fe700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f540406ace0 0x7f540406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5414000f60 tx=0x7f5414009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:57.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.314+0000 7f541bfff700 1 -- 172.21.15.38:0/4214236793 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f542414a3b0 con 0x7f54241449d0 2023-07-11T00:00:57.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.592+0000 7f5429b12700 1 -- 172.21.15.38:0/4214236793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f542414a3b0 con 0x7f54241449d0 2023-07-11T00:00:57.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.596+0000 7f541bfff700 1 -- 172.21.15.38:0/4214236793 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f542414a3b0 con 0x7f54241449d0 2023-07-11T00:00:57.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 -- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f540406ace0 msgr2=0x7f540406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:57.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f540406ace0 0x7f540406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5414000f60 tx=0x7f5414009040 comp rx=0 tx=0).stop 2023-07-11T00:00:57.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 -- 172.21.15.38:0/4214236793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54241449d0 msgr2=0x7f54240b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:57.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54241449d0 0x7f54240b36a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f542406d000 tx=0x7f541c004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 -- 172.21.15.38:0/4214236793 shutdown_connections 2023-07-11T00:00:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f540406ace0 0x7f540406d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54241449d0 0x7f54240b36a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54240b8d90 0x7f54241e3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 --2- 172.21.15.38:0/4214236793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54240bc810 0x7f54241d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 -- 172.21.15.38:0/4214236793 >> 172.21.15.38:0/4214236793 conn(0x7f54240c0860 msgr2=0x7f54240bf240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 -- 172.21.15.38:0/4214236793 shutdown_connections 2023-07-11T00:00:57.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.598+0000 7f5429b12700 1 -- 172.21.15.38:0/4214236793 wait complete. 2023-07-11T00:00:57.612 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-11T00:00:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.737+0000 7f24a6bf1700 1 Processor -- start 2023-07-11T00:00:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.737+0000 7f24a6bf1700 1 -- start start 2023-07-11T00:00:57.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a6bf1700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f24a01449d0 0x7f24a014db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a6bf1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f24a00b8d90 0x7f24a006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a6bf1700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a00b8620 con 0x7f24a00bc810 2023-07-11T00:00:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a6bf1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a00b97a0 con 0x7f24a00b8d90 2023-07-11T00:00:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a6bf1700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a0144da0 con 0x7f24a01449d0 2023-07-11T00:00:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a518e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f24a00b8d90 0x7f24a006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a518e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f24a00b8d90 0x7f24a006ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50188/0 (socket says 172.21.15.38:50188) 2023-07-11T00:00:57.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a518e700 1 -- 172.21.15.38:0/3887868972 learned_addr learned my addr 172.21.15.38:0/3887868972 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a498d700 1 --2- 172.21.15.38:0/3887868972 >> v2:172.21.15.70:3300/0 conn(0x7f24a01449d0 0x7f24a014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a518e700 1 -- 172.21.15.38:0/3887868972 >> v2:172.21.15.70:3300/0 conn(0x7f24a01449d0 msgr2=0x7f24a014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a518e700 1 --2- 172.21.15.38:0/3887868972 >> v2:172.21.15.70:3300/0 conn(0x7f24a01449d0 0x7f24a014db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.738+0000 7f24a518e700 1 -- 172.21.15.38:0/3887868972 >> v1:172.21.15.70:6789/0 conn(0x7f24a00bc810 legacy=0x7f24a00ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f24a518e700 1 -- 172.21.15.38:0/3887868972 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a00b8900 con 0x7f24a00b8d90 2023-07-11T00:00:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f24a518e700 1 --2- 172.21.15.38:0/3887868972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a00b8d90 0x7f24a006ade0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f24a006cbe0 tx=0x7f249800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e54d2c7ac63b3c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f249f7fe700 1 -- 172.21.15.38:0/3887868972 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800e070 con 0x7f24a00b8d90 2023-07-11T00:00:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f249f7fe700 1 -- 172.21.15.38:0/3887868972 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249800b9c0 con 0x7f24a00b8d90 2023-07-11T00:00:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f249f7fe700 1 -- 172.21.15.38:0/3887868972 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800bd70 con 0x7f24a00b8d90 2023-07-11T00:00:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3887868972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a00b8d90 msgr2=0x7f24a006ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:57.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f24a6bf1700 1 --2- 172.21.15.38:0/3887868972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a00b8d90 0x7f24a006ade0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f24a006cbe0 tx=0x7f249800b330 comp rx=0 tx=0).stop 2023-07-11T00:00:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3887868972 shutdown_connections 2023-07-11T00:00:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f24a6bf1700 1 --2- 172.21.15.38:0/3887868972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a00b8d90 0x7f24a006ade0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f24a6bf1700 1 --2- 172.21.15.38:0/3887868972 >> v2:172.21.15.70:3300/0 conn(0x7f24a01449d0 0x7f24a014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3887868972 >> 172.21.15.38:0/3887868972 conn(0x7f24a00c0860 msgr2=0x7f24a00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3887868972 shutdown_connections 2023-07-11T00:00:57.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.739+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3887868972 wait complete. 2023-07-11T00:00:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.740+0000 7f24a6bf1700 1 Processor -- start 2023-07-11T00:00:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.741+0000 7f24a6bf1700 1 -- start start 2023-07-11T00:00:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.741+0000 7f24a6bf1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a00b8d90 0x7f24a0145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.741+0000 7f24a6bf1700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24a00bc810 0x7f24a01477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.741+0000 7f24a6bf1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a01449d0 0x7f24a01e3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.741+0000 7f24a6bf1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a0143ed0 con 0x7f24a01449d0 2023-07-11T00:00:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.741+0000 7f24a6bf1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a01e3190 con 0x7f24a00b8d90 2023-07-11T00:00:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.741+0000 7f24a6bf1700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a01456a0 con 0x7f24a00bc810 2023-07-11T00:00:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.741+0000 7f24a518e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a01449d0 0x7f24a01e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.741+0000 7f24a518e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a01449d0 0x7f24a01e3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50200/0 (socket says 172.21.15.38:50200) 2023-07-11T00:00:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.741+0000 7f24a518e700 1 -- 172.21.15.38:0/3664682322 learned_addr learned my addr 172.21.15.38:0/3664682322 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f24a498d700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a00b8d90 0x7f24a0145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f249ffff700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24a00bc810 0x7f24a01477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f24a518e700 1 -- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24a00bc810 msgr2=0x7f24a01477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f24a518e700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24a00bc810 0x7f24a01477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f24a518e700 1 -- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a00b8d90 msgr2=0x7f24a0145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f24a518e700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a00b8d90 0x7f24a0145160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f24a518e700 1 -- 172.21.15.38:0/3664682322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2498009b30 con 0x7f24a01449d0 2023-07-11T00:00:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f249ffff700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24a00bc810 0x7f24a01477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f24a518e700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a01449d0 0x7f24a01e3620 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f24a006d000 tx=0x7f2498004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f249d7fa700 1 -- 172.21.15.38:0/3664682322 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498004930 con 0x7f24a01449d0 2023-07-11T00:00:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f249d7fa700 1 -- 172.21.15.38:0/3664682322 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24980099b0 con 0x7f24a01449d0 2023-07-11T00:00:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3664682322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a0145910 con 0x7f24a01449d0 2023-07-11T00:00:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f249d7fa700 1 -- 172.21.15.38:0/3664682322 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249801c680 con 0x7f24a01449d0 2023-07-11T00:00:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.742+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3664682322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a0147cf0 con 0x7f24a01449d0 2023-07-11T00:00:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.743+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3664682322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a01e3300 con 0x7f24a01449d0 2023-07-11T00:00:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.744+0000 7f249d7fa700 1 -- 172.21.15.38:0/3664682322 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f249801c7e0 con 0x7f24a01449d0 2023-07-11T00:00:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.744+0000 7f249d7fa700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f248406ace0 0x7f248406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.744+0000 7f249d7fa700 1 -- 172.21.15.38:0/3664682322 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f249808a6e0 con 0x7f24a01449d0 2023-07-11T00:00:57.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.744+0000 7f24a498d700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f248406ace0 0x7f248406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:57.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.745+0000 7f24a498d700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f248406ace0 0x7f248406d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2494007a30 tx=0x7f2494008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:57.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:57.748+0000 7f249d7fa700 1 -- 172.21.15.38:0/3664682322 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2498055ae0 con 0x7f24a01449d0 2023-07-11T00:00:58.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.027+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3664682322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f24a00bc330 con 0x7f24a01449d0 2023-07-11T00:00:58.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.030+0000 7f249d7fa700 1 -- 172.21.15.38:0/3664682322 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2498059100 con 0x7f24a01449d0 2023-07-11T00:00:58.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f248406ace0 msgr2=0x7f248406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f248406ace0 0x7f248406d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2494007a30 tx=0x7f2494008040 comp rx=0 tx=0).stop 2023-07-11T00:00:58.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3664682322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a01449d0 msgr2=0x7f24a01e3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a01449d0 0x7f24a01e3620 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f24a006d000 tx=0x7f2498004ad0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3664682322 shutdown_connections 2023-07-11T00:00:58.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f248406ace0 0x7f248406d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a01449d0 0x7f24a01e3620 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a00b8d90 0x7f24a0145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 --2- 172.21.15.38:0/3664682322 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24a00bc810 0x7f24a01477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3664682322 >> 172.21.15.38:0/3664682322 conn(0x7f24a00c0860 msgr2=0x7f24a00be6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:58.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3664682322 shutdown_connections 2023-07-11T00:00:58.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.032+0000 7f24a6bf1700 1 -- 172.21.15.38:0/3664682322 wait complete. 2023-07-11T00:00:58.046 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-11T00:00:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.172+0000 7fb083965700 1 Processor -- start 2023-07-11T00:00:58.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.172+0000 7fb083965700 1 -- start start 2023-07-11T00:00:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb083965700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb07c071ab0 0x7fb07c06edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb083965700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c0b93e0 con 0x7fb07c06b120 2023-07-11T00:00:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb083965700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c141200 con 0x7fb07c06f340 2023-07-11T00:00:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb083965700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c071690 con 0x7fb07c071ab0 2023-07-11T00:00:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb081701700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb07c06b120 0x7fb07c140af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54474/0 (socket says 172.21.15.38:54474) 2023-07-11T00:00:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb081701700 1 -- 172.21.15.38:0/977610961 learned_addr learned my addr 172.21.15.38:0/977610961 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb080f00700 1 --2- 172.21.15.38:0/977610961 >> v2:172.21.15.38:3300/0 conn(0x7fb07c071ab0 0x7fb07c06edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb073fff700 1 -- 172.21.15.38:0/977610961 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189893061 0 0) 0x7fb07c0b93e0 con 0x7fb07c06b120 2023-07-11T00:00:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb073fff700 1 -- 172.21.15.38:0/977610961 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0680035b0 con 0x7fb07c06b120 2023-07-11T00:00:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb080f00700 1 -- 172.21.15.38:0/977610961 >> v1:172.21.15.70:6789/0 conn(0x7fb07c06f340 legacy=0x7fb07c151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb080f00700 1 -- 172.21.15.38:0/977610961 >> v1:172.21.15.38:6789/0 conn(0x7fb07c06b120 legacy=0x7fb07c140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb080f00700 1 -- 172.21.15.38:0/977610961 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c06f8d0 con 0x7fb07c071ab0 2023-07-11T00:00:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.173+0000 7fb080f00700 1 --2- 172.21.15.38:0/977610961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c071ab0 0x7fb07c06edc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009840 tx=0x7fb06c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0495bb45f54c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.174+0000 7fb073fff700 1 -- 172.21.15.38:0/977610961 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c011830 con 0x7fb07c071ab0 2023-07-11T00:00:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.174+0000 7fb073fff700 1 -- 172.21.15.38:0/977610961 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c011990 con 0x7fb07c071ab0 2023-07-11T00:00:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.174+0000 7fb073fff700 1 -- 172.21.15.38:0/977610961 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c011d20 con 0x7fb07c071ab0 2023-07-11T00:00:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.174+0000 7fb083965700 1 -- 172.21.15.38:0/977610961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c071ab0 msgr2=0x7fb07c06edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.174+0000 7fb083965700 1 --2- 172.21.15.38:0/977610961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c071ab0 0x7fb07c06edc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009840 tx=0x7fb06c009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.174+0000 7fb083965700 1 -- 172.21.15.38:0/977610961 shutdown_connections 2023-07-11T00:00:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.174+0000 7fb083965700 1 --2- 172.21.15.38:0/977610961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c071ab0 0x7fb07c06edc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.174+0000 7fb083965700 1 -- 172.21.15.38:0/977610961 >> 172.21.15.38:0/977610961 conn(0x7fb07c0bd980 msgr2=0x7fb07c0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.174+0000 7fb083965700 1 -- 172.21.15.38:0/977610961 shutdown_connections 2023-07-11T00:00:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.174+0000 7fb083965700 1 -- 172.21.15.38:0/977610961 wait complete. 2023-07-11T00:00:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.175+0000 7fb083965700 1 Processor -- start 2023-07-11T00:00:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.175+0000 7fb083965700 1 -- start start 2023-07-11T00:00:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb083965700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb07c06b120 0x7fb07c12f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb083965700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c06f340 0x7fb07c130860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb083965700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb07c071ab0 0x7fb07c130da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb083965700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c12fc70 con 0x7fb07c06f340 2023-07-11T00:00:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb083965700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c12ff10 con 0x7fb07c06b120 2023-07-11T00:00:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb083965700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c143940 con 0x7fb07c071ab0 2023-07-11T00:00:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb080f00700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c06f340 0x7fb07c130860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb080f00700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c06f340 0x7fb07c130860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50222/0 (socket says 172.21.15.38:50222) 2023-07-11T00:00:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb080f00700 1 -- 172.21.15.38:0/3461202141 learned_addr learned my addr 172.21.15.38:0/3461202141 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb081701700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb07c06b120 0x7fb07c12f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb081f02700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb07c071ab0 0x7fb07c130da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb080f00700 1 -- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb07c071ab0 msgr2=0x7fb07c130da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb080f00700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb07c071ab0 0x7fb07c130da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb080f00700 1 -- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb07c06b120 msgr2=0x7fb07c12f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb080f00700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb07c06b120 0x7fb07c12f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb080f00700 1 -- 172.21.15.38:0/3461202141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0094a0 con 0x7fb07c06f340 2023-07-11T00:00:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.176+0000 7fb081701700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb07c06b120 0x7fb07c12f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.177+0000 7fb080f00700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c06f340 0x7fb07c130860 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009fd0 tx=0x7fb06c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.177+0000 7fb071ffb700 1 -- 172.21.15.38:0/3461202141 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0036a0 con 0x7fb07c06f340 2023-07-11T00:00:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.177+0000 7fb071ffb700 1 -- 172.21.15.38:0/3461202141 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c01f070 con 0x7fb07c06f340 2023-07-11T00:00:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.177+0000 7fb083965700 1 -- 172.21.15.38:0/3461202141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c13a810 con 0x7fb07c06f340 2023-07-11T00:00:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.177+0000 7fb071ffb700 1 -- 172.21.15.38:0/3461202141 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c003a20 con 0x7fb07c06f340 2023-07-11T00:00:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.177+0000 7fb083965700 1 -- 172.21.15.38:0/3461202141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c0b61b0 con 0x7fb07c06f340 2023-07-11T00:00:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.178+0000 7fb083965700 1 -- 172.21.15.38:0/3461202141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c1300d0 con 0x7fb07c06f340 2023-07-11T00:00:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.178+0000 7fb071ffb700 1 -- 172.21.15.38:0/3461202141 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb06c003b80 con 0x7fb07c06f340 2023-07-11T00:00:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.179+0000 7fb071ffb700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb06006ace0 0x7fb06006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.179+0000 7fb071ffb700 1 -- 172.21.15.38:0/3461202141 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb06c021070 con 0x7fb07c06f340 2023-07-11T00:00:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.179+0000 7fb081701700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb06006ace0 0x7fb06006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.180+0000 7fb081701700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb06006ace0 0x7fb06006d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb0780011e0 tx=0x7fb078009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.183+0000 7fb071ffb700 1 -- 172.21.15.38:0/3461202141 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb06c055da0 con 0x7fb07c06f340 2023-07-11T00:00:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.462+0000 7fb083965700 1 -- 172.21.15.38:0/3461202141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fb07c0b63a0 con 0x7fb07c06f340 2023-07-11T00:00:58.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.466+0000 7fb071ffb700 1 -- 172.21.15.38:0/3461202141 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb07c0b63a0 con 0x7fb07c06f340 2023-07-11T00:00:58.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 -- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb06006ace0 msgr2=0x7fb06006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb06006ace0 0x7fb06006d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb0780011e0 tx=0x7fb078009040 comp rx=0 tx=0).stop 2023-07-11T00:00:58.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 -- 172.21.15.38:0/3461202141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c06f340 msgr2=0x7fb07c130860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c06f340 0x7fb07c130860 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009fd0 tx=0x7fb06c004750 comp rx=0 tx=0).stop 2023-07-11T00:00:58.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 -- 172.21.15.38:0/3461202141 shutdown_connections 2023-07-11T00:00:58.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb06006ace0 0x7fb06006d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb07c071ab0 0x7fb07c130da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb07c06b120 0x7fb07c12f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 --2- 172.21.15.38:0/3461202141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c06f340 0x7fb07c130860 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 -- 172.21.15.38:0/3461202141 >> 172.21.15.38:0/3461202141 conn(0x7fb07c0bd980 msgr2=0x7fb07c145100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:58.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 -- 172.21.15.38:0/3461202141 shutdown_connections 2023-07-11T00:00:58.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.468+0000 7fb083965700 1 -- 172.21.15.38:0/3461202141 wait complete. 2023-07-11T00:00:58.482 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-11T00:00:58.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.607+0000 7f018da69700 1 Processor -- start 2023-07-11T00:00:58.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.607+0000 7f018da69700 1 -- start start 2023-07-11T00:00:58.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f018da69700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f01881449d0 0x7f018814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f018da69700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01880b8620 con 0x7f01880bc810 2023-07-11T00:00:58.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f018da69700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01880b8900 con 0x7f01880b8d90 2023-07-11T00:00:58.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f018da69700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01880b97a0 con 0x7f01881449d0 2023-07-11T00:00:58.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f0186ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f01880bc810 0x7f01880ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54480/0 (socket says 172.21.15.38:54480) 2023-07-11T00:00:58.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f0186ffd700 1 -- 172.21.15.38:0/3506849650 learned_addr learned my addr 172.21.15.38:0/3506849650 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:58.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01877fe700 1 --2- 172.21.15.38:0/3506849650 >> v2:172.21.15.70:3300/0 conn(0x7f01881449d0 0x7f018814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936454385 0 0) 0x7f01880b8620 con 0x7f01880bc810 2023-07-11T00:00:58.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01740035b0 con 0x7f01880bc810 2023-07-11T00:00:58.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483796393 0 0) 0x7f01880b8900 con 0x7f01880b8d90 2023-07-11T00:00:58.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01880b8620 con 0x7f01880b8d90 2023-07-11T00:00:58.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1248560806 0 0) 0x7f01740035b0 con 0x7f01880bc810 2023-07-11T00:00:58.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 >> v2:172.21.15.70:3300/0 conn(0x7f01881449d0 msgr2=0x7f018814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:58.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 --2- 172.21.15.38:0/3506849650 >> v2:172.21.15.70:3300/0 conn(0x7f01881449d0 0x7f018814db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 >> v1:172.21.15.70:6789/0 conn(0x7f01880b8d90 legacy=0x7f018806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880bac40 con 0x7f01880bc810 2023-07-11T00:00:58.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f0170001670 con 0x7f01880bc810 2023-07-11T00:00:58.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 >> v1:172.21.15.38:6789/0 conn(0x7f01880bc810 legacy=0x7f01880ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 0x7f0174003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0174004850 0x7f0174004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.608+0000 7f01867fc700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0174005200 0x7f017400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880b97a0 con 0x7f0174003be0 2023-07-11T00:00:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017400c030 con 0x7f0174004850 2023-07-11T00:00:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017400c1f0 con 0x7f0174005200 2023-07-11T00:00:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01877fe700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 0x7f0174003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f0186ffd700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0174004850 0x7f0174004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f0187fff700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0174005200 0x7f017400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01877fe700 1 -- 172.21.15.38:0/3506849650 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0174005200 msgr2=0x7f017400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:58.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01877fe700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0174005200 0x7f017400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01877fe700 1 -- 172.21.15.38:0/3506849650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0174004850 msgr2=0x7f0174004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01877fe700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0174004850 0x7f0174004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01877fe700 1 -- 172.21.15.38:0/3506849650 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01740035b0 con 0x7f0174003be0 2023-07-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f0187fff700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0174005200 0x7f017400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f0187fff700 1 -- 172.21.15.38:0/3506849650 reap_dead start 2023-07-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01877fe700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 0x7f0174003fd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0178009b60 tx=0x7f0174005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb23c81d47c272b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:58.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017800e6c0 con 0x7f0174003be0 2023-07-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017800e820 con 0x7f0174003be0 2023-07-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.609+0000 7f01867fc700 1 -- 172.21.15.38:0/3506849650 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017800eb90 con 0x7f0174003be0 2023-07-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.610+0000 7f018da69700 1 -- 172.21.15.38:0/3506849650 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 msgr2=0x7f0174003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.610+0000 7f018da69700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 0x7f0174003fd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0178009b60 tx=0x7f0174005880 comp rx=0 tx=0).stop 2023-07-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.610+0000 7f018da69700 1 -- 172.21.15.38:0/3506849650 shutdown_connections 2023-07-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.610+0000 7f018da69700 1 --2- 172.21.15.38:0/3506849650 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 0x7f0174003fd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.610+0000 7f018da69700 1 -- 172.21.15.38:0/3506849650 >> 172.21.15.38:0/3506849650 conn(0x7f01880c0860 msgr2=0x7f01880c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:58.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.610+0000 7f018da69700 1 -- 172.21.15.38:0/3506849650 shutdown_connections 2023-07-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.610+0000 7f018da69700 1 -- 172.21.15.38:0/3506849650 wait complete. 2023-07-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.611+0000 7f018da69700 1 Processor -- start 2023-07-11T00:00:58.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.611+0000 7f018da69700 1 -- start start 2023-07-11T00:00:58.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f018da69700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 0x7f01881483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f018da69700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01880b16e0 0x7f01880b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f018da69700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01880b3960 0x7f01880a5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f018da69700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880b3100 con 0x7f0174003be0 2023-07-11T00:00:58.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f018da69700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0188147cb0 con 0x7f01880b3960 2023-07-11T00:00:58.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f018da69700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01880b2730 con 0x7f01880b16e0 2023-07-11T00:00:58.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f01877fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 0x7f01881483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f01877fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 0x7f01881483f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50232/0 (socket says 172.21.15.38:50232) 2023-07-11T00:00:58.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f01877fe700 1 -- 172.21.15.38:0/3118212458 learned_addr learned my addr 172.21.15.38:0/3118212458 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:58.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f0186ffd700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01880b16e0 0x7f01880b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f0187fff700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01880b3960 0x7f01880a5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f01877fe700 1 -- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01880b16e0 msgr2=0x7f01880b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f01877fe700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01880b16e0 0x7f01880b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f01877fe700 1 -- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01880b3960 msgr2=0x7f01880a5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f01877fe700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01880b3960 0x7f01880a5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f01877fe700 1 -- 172.21.15.38:0/3118212458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880b2430 con 0x7f0174003be0 2023-07-11T00:00:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f01877fe700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 0x7f01881483f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f017800a010 tx=0x7f01780047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f017ffff700 1 -- 172.21.15.38:0/3118212458 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017800e6c0 con 0x7f0174003be0 2023-07-11T00:00:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f017ffff700 1 -- 172.21.15.38:0/3118212458 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01780038c0 con 0x7f0174003be0 2023-07-11T00:00:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f018da69700 1 -- 172.21.15.38:0/3118212458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018814a0b0 con 0x7f0174003be0 2023-07-11T00:00:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.612+0000 7f017ffff700 1 -- 172.21.15.38:0/3118212458 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178003c70 con 0x7f0174003be0 2023-07-11T00:00:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.613+0000 7f018da69700 1 -- 172.21.15.38:0/3118212458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01880b40e0 con 0x7f0174003be0 2023-07-11T00:00:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.613+0000 7f018da69700 1 -- 172.21.15.38:0/3118212458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0188074360 con 0x7f0174003be0 2023-07-11T00:00:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.614+0000 7f017ffff700 1 -- 172.21.15.38:0/3118212458 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0178013470 con 0x7f0174003be0 2023-07-11T00:00:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.614+0000 7f017ffff700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f016806ace0 0x7f016806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.615+0000 7f017ffff700 1 -- 172.21.15.38:0/3118212458 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f017808a7e0 con 0x7f0174003be0 2023-07-11T00:00:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.615+0000 7f0186ffd700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f016806ace0 0x7f016806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:58.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.615+0000 7f0186ffd700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f016806ace0 0x7f016806d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01880bbc60 tx=0x7f0170001ae0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:58.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.619+0000 7f017ffff700 1 -- 172.21.15.38:0/3118212458 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0178055d90 con 0x7f0174003be0 2023-07-11T00:00:58.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.899+0000 7f018da69700 1 -- 172.21.15.38:0/3118212458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f01880a6af0 con 0x7f0174003be0 2023-07-11T00:00:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.902+0000 7f017ffff700 1 -- 172.21.15.38:0/3118212458 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f01780593b0 con 0x7f0174003be0 2023-07-11T00:00:58.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 -- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f016806ace0 msgr2=0x7f016806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f016806ace0 0x7f016806d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01880bbc60 tx=0x7f0170001ae0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 -- 172.21.15.38:0/3118212458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 msgr2=0x7f01881483f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 0x7f01881483f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f017800a010 tx=0x7f01780047c0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 -- 172.21.15.38:0/3118212458 shutdown_connections 2023-07-11T00:00:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f016806ace0 0x7f016806d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01880b3960 0x7f01880a5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0174003be0 0x7f01881483f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 --2- 172.21.15.38:0/3118212458 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01880b16e0 0x7f01880b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:58.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 -- 172.21.15.38:0/3118212458 >> 172.21.15.38:0/3118212458 conn(0x7f01880c0860 msgr2=0x7f0188143cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:58.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 -- 172.21.15.38:0/3118212458 shutdown_connections 2023-07-11T00:00:58.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:58.904+0000 7f018da69700 1 -- 172.21.15.38:0/3118212458 wait complete. 2023-07-11T00:00:58.918 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-11T00:00:59.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.043+0000 7fee31a79700 1 Processor -- start 2023-07-11T00:00:59.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.043+0000 7fee31a79700 1 -- start start 2023-07-11T00:00:59.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee31a79700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee2c06b120 0x7fee2c0b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee31a79700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fee2c14aa40 0x7fee2c14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee31a79700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c070410 con 0x7fee2c1444c0 2023-07-11T00:00:59.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee31a79700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2c0b9590 con 0x7fee2c14aa40 2023-07-11T00:00:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee31a79700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c14b3d0 con 0x7fee2c06b120 2023-07-11T00:00:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee23fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fee2c14aa40 0x7fee2c14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee2bfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fee2c1444c0 0x7fee2c144920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54488/0 (socket says 172.21.15.38:54488) 2023-07-11T00:00:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee2bfff700 1 -- 172.21.15.38:0/26265525 learned_addr learned my addr 172.21.15.38:0/26265525 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee2b7fe700 1 --2- 172.21.15.38:0/26265525 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee2c06b120 0x7fee2c0b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee2affd700 1 -- 172.21.15.38:0/26265525 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730754267 0 0) 0x7fee2c070410 con 0x7fee2c1444c0 2023-07-11T00:00:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee2affd700 1 -- 172.21.15.38:0/26265525 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee180035b0 con 0x7fee2c1444c0 2023-07-11T00:00:59.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee23fff700 1 -- 172.21.15.38:0/26265525 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee2c06b120 msgr2=0x7fee2c0b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:59.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee23fff700 1 --2- 172.21.15.38:0/26265525 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee2c06b120 0x7fee2c0b8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee23fff700 1 -- 172.21.15.38:0/26265525 >> v1:172.21.15.38:6789/0 conn(0x7fee2c1444c0 legacy=0x7fee2c144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.044+0000 7fee23fff700 1 -- 172.21.15.38:0/26265525 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c06ef60 con 0x7fee2c14aa40 2023-07-11T00:00:59.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee23fff700 1 --2- 172.21.15.38:0/26265525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c14aa40 0x7fee2c14ae90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee14009840 tx=0x7fee14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1f95e39ed811d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:59.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee2affd700 1 -- 172.21.15.38:0/26265525 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14011830 con 0x7fee2c14aa40 2023-07-11T00:00:59.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee2affd700 1 -- 172.21.15.38:0/26265525 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee14011990 con 0x7fee2c14aa40 2023-07-11T00:00:59.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee2affd700 1 -- 172.21.15.38:0/26265525 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14011d20 con 0x7fee2c14aa40 2023-07-11T00:00:59.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee31a79700 1 -- 172.21.15.38:0/26265525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c14aa40 msgr2=0x7fee2c14ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee31a79700 1 --2- 172.21.15.38:0/26265525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c14aa40 0x7fee2c14ae90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee14009840 tx=0x7fee14009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:59.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee31a79700 1 -- 172.21.15.38:0/26265525 shutdown_connections 2023-07-11T00:00:59.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee31a79700 1 --2- 172.21.15.38:0/26265525 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee2c06b120 0x7fee2c0b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee31a79700 1 --2- 172.21.15.38:0/26265525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c14aa40 0x7fee2c14ae90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee31a79700 1 -- 172.21.15.38:0/26265525 >> 172.21.15.38:0/26265525 conn(0x7fee2c0bd980 msgr2=0x7fee2c0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:59.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee31a79700 1 -- 172.21.15.38:0/26265525 shutdown_connections 2023-07-11T00:00:59.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.045+0000 7fee31a79700 1 -- 172.21.15.38:0/26265525 wait complete. 2023-07-11T00:00:59.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.046+0000 7fee31a79700 1 Processor -- start 2023-07-11T00:00:59.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee31a79700 1 -- start start 2023-07-11T00:00:59.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee31a79700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c06b120 0x7fee2c1e2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee31a79700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee2c1444c0 0x7fee2c14c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee31a79700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee2c14aa40 0x7fee2c14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee31a79700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c14c6c0 con 0x7fee2c06b120 2023-07-11T00:00:59.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee31a79700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c14e690 con 0x7fee2c14aa40 2023-07-11T00:00:59.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee31a79700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c1e3b60 con 0x7fee2c1444c0 2023-07-11T00:00:59.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee2b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c06b120 0x7fee2c1e2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee2b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c06b120 0x7fee2c1e2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50258/0 (socket says 172.21.15.38:50258) 2023-07-11T00:00:59.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee2b7fe700 1 -- 172.21.15.38:0/1508006160 learned_addr learned my addr 172.21.15.38:0/1508006160 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:59.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee23fff700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee2c1444c0 0x7fee2c14c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.047+0000 7fee2bfff700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee2c14aa40 0x7fee2c14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee2b7fe700 1 -- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee2c1444c0 msgr2=0x7fee2c14c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee2b7fe700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee2c1444c0 0x7fee2c14c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee2b7fe700 1 -- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee2c14aa40 msgr2=0x7fee2c14d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee2b7fe700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee2c14aa40 0x7fee2c14d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee2b7fe700 1 -- 172.21.15.38:0/1508006160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140094a0 con 0x7fee2c06b120 2023-07-11T00:00:59.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee2bfff700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee2c14aa40 0x7fee2c14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:00:59.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee2b7fe700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c06b120 0x7fee2c1e2c10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00e870 tx=0x7fee1c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:59.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee28ff9700 1 -- 172.21.15.38:0/1508006160 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c009590 con 0x7fee2c06b120 2023-07-11T00:00:59.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee28ff9700 1 -- 172.21.15.38:0/1508006160 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c013680 con 0x7fee2c06b120 2023-07-11T00:00:59.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee31a79700 1 -- 172.21.15.38:0/1508006160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c1e32c0 con 0x7fee2c06b120 2023-07-11T00:00:59.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee28ff9700 1 -- 172.21.15.38:0/1508006160 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0139f0 con 0x7fee2c06b120 2023-07-11T00:00:59.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.048+0000 7fee31a79700 1 -- 172.21.15.38:0/1508006160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c1e3880 con 0x7fee2c06b120 2023-07-11T00:00:59.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.049+0000 7fee31a79700 1 -- 172.21.15.38:0/1508006160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c14cf50 con 0x7fee2c06b120 2023-07-11T00:00:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.050+0000 7fee28ff9700 1 -- 172.21.15.38:0/1508006160 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee1c013b50 con 0x7fee2c06b120 2023-07-11T00:00:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.050+0000 7fee28ff9700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fee0c06ad10 0x7fee0c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.050+0000 7fee28ff9700 1 -- 172.21.15.38:0/1508006160 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fee1c089510 con 0x7fee2c06b120 2023-07-11T00:00:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.050+0000 7fee23fff700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fee0c06ad10 0x7fee0c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.051+0000 7fee23fff700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fee0c06ad10 0x7fee0c06d1c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee14000c00 tx=0x7fee14008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:59.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.054+0000 7fee28ff9700 1 -- 172.21.15.38:0/1508006160 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fee1c054a80 con 0x7fee2c06b120 2023-07-11T00:00:59.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.330+0000 7fee31a79700 1 -- 172.21.15.38:0/1508006160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fee2c074360 con 0x7fee2c06b120 2023-07-11T00:00:59.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.338+0000 7fee28ff9700 1 -- 172.21.15.38:0/1508006160 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fee1c0580a0 con 0x7fee2c06b120 2023-07-11T00:00:59.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 -- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fee0c06ad10 msgr2=0x7fee0c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fee0c06ad10 0x7fee0c06d1c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee14000c00 tx=0x7fee14008030 comp rx=0 tx=0).stop 2023-07-11T00:00:59.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 -- 172.21.15.38:0/1508006160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c06b120 msgr2=0x7fee2c1e2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c06b120 0x7fee2c1e2c10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00e870 tx=0x7fee1c00eb80 comp rx=0 tx=0).stop 2023-07-11T00:00:59.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 -- 172.21.15.38:0/1508006160 shutdown_connections 2023-07-11T00:00:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fee0c06ad10 0x7fee0c06d1c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee2c14aa40 0x7fee2c14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c06b120 0x7fee2c1e2c10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 --2- 172.21.15.38:0/1508006160 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee2c1444c0 0x7fee2c14c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 -- 172.21.15.38:0/1508006160 >> 172.21.15.38:0/1508006160 conn(0x7fee2c0bd980 msgr2=0x7fee2c0b7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 -- 172.21.15.38:0/1508006160 shutdown_connections 2023-07-11T00:00:59.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.340+0000 7fee31a79700 1 -- 172.21.15.38:0/1508006160 wait complete. 2023-07-11T00:00:59.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-11T00:00:59.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.482+0000 7ff0f4240700 1 Processor -- start 2023-07-11T00:00:59.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.482+0000 7ff0f4240700 1 -- start start 2023-07-11T00:00:59.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f4240700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff0ec1449d0 0x7ff0ec14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f4240700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff0ec0bc810 0x7ff0ec0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f4240700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec0b8620 con 0x7ff0ec0b8d90 2023-07-11T00:00:59.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f4240700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec0b97a0 con 0x7ff0ec1449d0 2023-07-11T00:00:59.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f4240700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec144da0 con 0x7ff0ec0bc810 2023-07-11T00:00:59.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f17db700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff0ec0bc810 0x7ff0ec0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f1fdc700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff0ec1449d0 0x7ff0ec14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f27dd700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ff0ec0b8d90 0x7ff0ec06ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:37434/0 (socket says 172.21.15.38:37434) 2023-07-11T00:00:59.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f27dd700 1 -- 172.21.15.38:0/353093633 learned_addr learned my addr 172.21.15.38:0/353093633 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f0fda700 1 -- 172.21.15.38:0/353093633 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456312628 0 0) 0x7ff0ec0b8620 con 0x7ff0ec0b8d90 2023-07-11T00:00:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f0fda700 1 -- 172.21.15.38:0/353093633 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d80035b0 con 0x7ff0ec0b8d90 2023-07-11T00:00:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.483+0000 7ff0f17db700 1 -- 172.21.15.38:0/353093633 >> v2:172.21.15.70:3300/0 conn(0x7ff0ec1449d0 msgr2=0x7ff0ec14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:00:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f17db700 1 --2- 172.21.15.38:0/353093633 >> v2:172.21.15.70:3300/0 conn(0x7ff0ec1449d0 0x7ff0ec14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f17db700 1 -- 172.21.15.38:0/353093633 >> v1:172.21.15.70:6789/0 conn(0x7ff0ec0b8d90 legacy=0x7ff0ec06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f17db700 1 -- 172.21.15.38:0/353093633 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0b8900 con 0x7ff0ec0bc810 2023-07-11T00:00:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f1fdc700 1 --2- 172.21.15.38:0/353093633 >> v2:172.21.15.70:3300/0 conn(0x7ff0ec1449d0 0x7ff0ec14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-11T00:00:59.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f17db700 1 --2- 172.21.15.38:0/353093633 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff0ec0bc810 0x7ff0ec0ba530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009840 tx=0x7ff0e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43bebbd82f432086 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:59.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f0fda700 1 -- 172.21.15.38:0/353093633 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8011830 con 0x7ff0ec0bc810 2023-07-11T00:00:59.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f0fda700 1 -- 172.21.15.38:0/353093633 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e8011990 con 0x7ff0ec0bc810 2023-07-11T00:00:59.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f0fda700 1 -- 172.21.15.38:0/353093633 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8011d20 con 0x7ff0ec0bc810 2023-07-11T00:00:59.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f4240700 1 -- 172.21.15.38:0/353093633 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff0ec0bc810 msgr2=0x7ff0ec0ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f4240700 1 --2- 172.21.15.38:0/353093633 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff0ec0bc810 0x7ff0ec0ba530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009840 tx=0x7ff0e8009b50 comp rx=0 tx=0).stop 2023-07-11T00:00:59.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f4240700 1 -- 172.21.15.38:0/353093633 shutdown_connections 2023-07-11T00:00:59.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.484+0000 7ff0f4240700 1 --2- 172.21.15.38:0/353093633 >> v2:172.21.15.70:3300/0 conn(0x7ff0ec1449d0 0x7ff0ec14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.485+0000 7ff0f4240700 1 --2- 172.21.15.38:0/353093633 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff0ec0bc810 0x7ff0ec0ba530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.485+0000 7ff0f4240700 1 -- 172.21.15.38:0/353093633 >> 172.21.15.38:0/353093633 conn(0x7ff0ec0c0860 msgr2=0x7ff0ec0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:59.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.485+0000 7ff0f4240700 1 -- 172.21.15.38:0/353093633 shutdown_connections 2023-07-11T00:00:59.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.485+0000 7ff0f4240700 1 -- 172.21.15.38:0/353093633 wait complete. 2023-07-11T00:00:59.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.486+0000 7ff0f4240700 1 Processor -- start 2023-07-11T00:00:59.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.486+0000 7ff0f4240700 1 -- start start 2023-07-11T00:00:59.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.486+0000 7ff0f4240700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff0ec0b8d90 0x7ff0ec1473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.486+0000 7ff0f4240700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0ec0bc810 0x7ff0ec145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.486+0000 7ff0f4240700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0ec1449d0 0x7ff0ec1465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.486+0000 7ff0f4240700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec1456a0 con 0x7ff0ec0bc810 2023-07-11T00:00:59.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.486+0000 7ff0f4240700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec143f00 con 0x7ff0ec1449d0 2023-07-11T00:00:59.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.486+0000 7ff0f4240700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec146120 con 0x7ff0ec0b8d90 2023-07-11T00:00:59.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.486+0000 7ff0f17db700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0ec0bc810 0x7ff0ec145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.486+0000 7ff0f17db700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0ec0bc810 0x7ff0ec145160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50272/0 (socket says 172.21.15.38:50272) 2023-07-11T00:00:59.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.486+0000 7ff0f17db700 1 -- 172.21.15.38:0/1020617950 learned_addr learned my addr 172.21.15.38:0/1020617950 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:59.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0f27dd700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0ec1449d0 0x7ff0ec1465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0f1fdc700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff0ec0b8d90 0x7ff0ec1473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0f17db700 1 -- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff0ec0b8d90 msgr2=0x7ff0ec1473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0f17db700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff0ec0b8d90 0x7ff0ec1473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0f17db700 1 -- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0ec1449d0 msgr2=0x7ff0ec1465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0f17db700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0ec1449d0 0x7ff0ec1465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0f17db700 1 -- 172.21.15.38:0/1020617950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0094a0 con 0x7ff0ec0bc810 2023-07-11T00:00:59.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0f17db700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0ec0bc810 0x7ff0ec145160 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80090b0 tx=0x7ff0e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:59.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0e27fc700 1 -- 172.21.15.38:0/1020617950 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e80036a0 con 0x7ff0ec0bc810 2023-07-11T00:00:59.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0e27fc700 1 -- 172.21.15.38:0/1020617950 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e801f070 con 0x7ff0ec0bc810 2023-07-11T00:00:59.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0e27fc700 1 -- 172.21.15.38:0/1020617950 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8003a40 con 0x7ff0ec0bc810 2023-07-11T00:00:59.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0f4240700 1 -- 172.21.15.38:0/1020617950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e80094a0 con 0x7ff0ec0bc810 2023-07-11T00:00:59.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.487+0000 7ff0f4240700 1 -- 172.21.15.38:0/1020617950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec145880 con 0x7ff0ec0bc810 2023-07-11T00:00:59.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.488+0000 7ff0f4240700 1 -- 172.21.15.38:0/1020617950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec074360 con 0x7ff0ec0bc810 2023-07-11T00:00:59.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.489+0000 7ff0e27fc700 1 -- 172.21.15.38:0/1020617950 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0e8003ba0 con 0x7ff0ec0bc810 2023-07-11T00:00:59.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.489+0000 7ff0e27fc700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff0d006ace0 0x7ff0d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.489+0000 7ff0e27fc700 1 -- 172.21.15.38:0/1020617950 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff0e8021070 con 0x7ff0ec0bc810 2023-07-11T00:00:59.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.489+0000 7ff0f1fdc700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff0d006ace0 0x7ff0d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.490+0000 7ff0f1fdc700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff0d006ace0 0x7ff0d006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009cd0 tx=0x7ff0dc009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:59.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.493+0000 7ff0e27fc700 1 -- 172.21.15.38:0/1020617950 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff0e8055cc0 con 0x7ff0ec0bc810 2023-07-11T00:00:59.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.772+0000 7ff0f4240700 1 -- 172.21.15.38:0/1020617950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7ff0ec0bc330 con 0x7ff0ec0bc810 2023-07-11T00:00:59.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.775+0000 7ff0e27fc700 1 -- 172.21.15.38:0/1020617950 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff0e80592e0 con 0x7ff0ec0bc810 2023-07-11T00:00:59.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 -- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff0d006ace0 msgr2=0x7ff0d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff0d006ace0 0x7ff0d006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009cd0 tx=0x7ff0dc009210 comp rx=0 tx=0).stop 2023-07-11T00:00:59.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 -- 172.21.15.38:0/1020617950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0ec0bc810 msgr2=0x7ff0ec145160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0ec0bc810 0x7ff0ec145160 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80090b0 tx=0x7ff0e8004750 comp rx=0 tx=0).stop 2023-07-11T00:00:59.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 -- 172.21.15.38:0/1020617950 shutdown_connections 2023-07-11T00:00:59.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff0d006ace0 0x7ff0d006d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0ec1449d0 0x7ff0ec1465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff0ec0b8d90 0x7ff0ec1473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 --2- 172.21.15.38:0/1020617950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0ec0bc810 0x7ff0ec145160 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 -- 172.21.15.38:0/1020617950 >> 172.21.15.38:0/1020617950 conn(0x7ff0ec0c0860 msgr2=0x7ff0ec0baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 -- 172.21.15.38:0/1020617950 shutdown_connections 2023-07-11T00:00:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.777+0000 7ff0f4240700 1 -- 172.21.15.38:0/1020617950 wait complete. 2023-07-11T00:00:59.792 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:00:59.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.917+0000 7f155801d700 1 Processor -- start 2023-07-11T00:00:59.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.917+0000 7f155801d700 1 -- start start 2023-07-11T00:00:59.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f155801d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f15500bc810 0x7f15500ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f155801d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15500b8620 con 0x7f15500b8d90 2023-07-11T00:00:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f155801d700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15500b8900 con 0x7f15501449d0 2023-07-11T00:00:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f155801d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15500b97a0 con 0x7f15500bc810 2023-07-11T00:00:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f15565ba700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f15500b8d90 0x7f155006ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54502/0 (socket says 172.21.15.38:54502) 2023-07-11T00:00:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f15565ba700 1 -- 172.21.15.38:0/1613626955 learned_addr learned my addr 172.21.15.38:0/1613626955 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:00:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f15555b8700 1 --2- 172.21.15.38:0/1613626955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f15500bc810 0x7f15500ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f1554db7700 1 -- 172.21.15.38:0/1613626955 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204157463 0 0) 0x7f15500b8620 con 0x7f15500b8d90 2023-07-11T00:00:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f1554db7700 1 -- 172.21.15.38:0/1613626955 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f153c0035b0 con 0x7f15500b8d90 2023-07-11T00:00:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f1554db7700 1 -- 172.21.15.38:0/1613626955 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132906813 0 0) 0x7f15500b8900 con 0x7f15501449d0 2023-07-11T00:00:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f1554db7700 1 -- 172.21.15.38:0/1613626955 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15500b8620 con 0x7f15501449d0 2023-07-11T00:00:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f15555b8700 1 -- 172.21.15.38:0/1613626955 >> v1:172.21.15.70:6789/0 conn(0x7f15501449d0 legacy=0x7f155014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f15555b8700 1 -- 172.21.15.38:0/1613626955 >> v1:172.21.15.38:6789/0 conn(0x7f15500b8d90 legacy=0x7f155006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.918+0000 7f15555b8700 1 -- 172.21.15.38:0/1613626955 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155006b4f0 con 0x7f15500bc810 2023-07-11T00:00:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.919+0000 7f15555b8700 1 --2- 172.21.15.38:0/1613626955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f15500bc810 0x7f15500ba530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f154c009870 tx=0x7f154c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce96b959586dc4c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.919+0000 7f1554db7700 1 -- 172.21.15.38:0/1613626955 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c011830 con 0x7f15500bc810 2023-07-11T00:00:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.919+0000 7f1554db7700 1 -- 172.21.15.38:0/1613626955 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c011990 con 0x7f15500bc810 2023-07-11T00:00:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.919+0000 7f1554db7700 1 -- 172.21.15.38:0/1613626955 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c011d20 con 0x7f15500bc810 2023-07-11T00:00:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.919+0000 7f155801d700 1 -- 172.21.15.38:0/1613626955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f15500bc810 msgr2=0x7f15500ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.919+0000 7f155801d700 1 --2- 172.21.15.38:0/1613626955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f15500bc810 0x7f15500ba530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f154c009870 tx=0x7f154c009b80 comp rx=0 tx=0).stop 2023-07-11T00:00:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.919+0000 7f155801d700 1 -- 172.21.15.38:0/1613626955 shutdown_connections 2023-07-11T00:00:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.919+0000 7f155801d700 1 --2- 172.21.15.38:0/1613626955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f15500bc810 0x7f15500ba530 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.919+0000 7f155801d700 1 -- 172.21.15.38:0/1613626955 >> 172.21.15.38:0/1613626955 conn(0x7f15500c0860 msgr2=0x7f15500c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:00:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.920+0000 7f155801d700 1 -- 172.21.15.38:0/1613626955 shutdown_connections 2023-07-11T00:00:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.920+0000 7f155801d700 1 -- 172.21.15.38:0/1613626955 wait complete. 2023-07-11T00:00:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f155801d700 1 Processor -- start 2023-07-11T00:00:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f155801d700 1 -- start start 2023-07-11T00:00:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f155801d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f15500b8d90 0x7f1550148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f155801d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15500bc810 0x7f1550147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f155801d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15501449d0 0x7f1550145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f155801d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1550147940 con 0x7f15500bc810 2023-07-11T00:00:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f155801d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1550148bb0 con 0x7f15501449d0 2023-07-11T00:00:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f155801d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15500bf220 con 0x7f15500b8d90 2023-07-11T00:00:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f15555b8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15500bc810 0x7f1550147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f15555b8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15500bc810 0x7f1550147400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50286/0 (socket says 172.21.15.38:50286) 2023-07-11T00:00:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f15555b8700 1 -- 172.21.15.38:0/3687735470 learned_addr learned my addr 172.21.15.38:0/3687735470 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:00:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f15565ba700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15501449d0 0x7f1550145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.921+0000 7f1555db9700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f15500b8d90 0x7f1550148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.922+0000 7f15555b8700 1 -- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f15500b8d90 msgr2=0x7f1550148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.922+0000 7f15555b8700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f15500b8d90 0x7f1550148520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.922+0000 7f15555b8700 1 -- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15501449d0 msgr2=0x7f1550145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:00:59.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.922+0000 7f15555b8700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15501449d0 0x7f1550145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:00:59.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.922+0000 7f15555b8700 1 -- 172.21.15.38:0/3687735470 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c0094a0 con 0x7f15500bc810 2023-07-11T00:00:59.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.922+0000 7f15555b8700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15500bc810 0x7f1550147400 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f154c0090b0 tx=0x7f154c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:59.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.922+0000 7f15467fc700 1 -- 172.21.15.38:0/3687735470 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c01a860 con 0x7f15500bc810 2023-07-11T00:00:59.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.922+0000 7f15467fc700 1 -- 172.21.15.38:0/3687735470 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c01a9c0 con 0x7f15500bc810 2023-07-11T00:00:59.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.922+0000 7f155801d700 1 -- 172.21.15.38:0/3687735470 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15501467e0 con 0x7f15500bc810 2023-07-11T00:00:59.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.922+0000 7f15467fc700 1 -- 172.21.15.38:0/3687735470 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c01ad30 con 0x7f15500bc810 2023-07-11T00:00:59.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.922+0000 7f155801d700 1 -- 172.21.15.38:0/3687735470 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1550146da0 con 0x7f15500bc810 2023-07-11T00:00:59.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.923+0000 7f155801d700 1 -- 172.21.15.38:0/3687735470 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15500be140 con 0x7f15500bc810 2023-07-11T00:00:59.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.923+0000 7f15467fc700 1 -- 172.21.15.38:0/3687735470 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f154c022070 con 0x7f15500bc810 2023-07-11T00:00:59.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.924+0000 7f15467fc700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f153406ace0 0x7f153406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:00:59.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.924+0000 7f15467fc700 1 -- 172.21.15.38:0/3687735470 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f154c089fa0 con 0x7f15500bc810 2023-07-11T00:00:59.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.924+0000 7f1555db9700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f153406ace0 0x7f153406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:00:59.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.924+0000 7f1555db9700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f153406ace0 0x7f153406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1540001220 tx=0x7f1540009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:00:59.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:00:59.928+0000 7f15467fc700 1 -- 172.21.15.38:0/3687735470 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f154c0bc380 con 0x7f15500bc810 2023-07-11T00:01:00.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.126+0000 7f155801d700 1 -- 172.21.15.38:0/3687735470 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15500baa40 con 0x7f15500bc810 2023-07-11T00:01:00.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.127+0000 7f15467fc700 1 -- 172.21.15.38:0/3687735470 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+14521 (secure 0 0 0) 0x7f154c029020 con 0x7f15500bc810 2023-07-11T00:01:00.129 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:01:00.129 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":27,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:00:56.702196+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:01:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 -- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f153406ace0 msgr2=0x7f153406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f153406ace0 0x7f153406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1540001220 tx=0x7f1540009040 comp rx=0 tx=0).stop 2023-07-11T00:01:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 -- 172.21.15.38:0/3687735470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15500bc810 msgr2=0x7f1550147400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15500bc810 0x7f1550147400 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f154c0090b0 tx=0x7f154c004750 comp rx=0 tx=0).stop 2023-07-11T00:01:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 -- 172.21.15.38:0/3687735470 shutdown_connections 2023-07-11T00:01:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f153406ace0 0x7f153406d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15501449d0 0x7f1550145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f15500b8d90 0x7f1550148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 --2- 172.21.15.38:0/3687735470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15500bc810 0x7f1550147400 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 -- 172.21.15.38:0/3687735470 >> 172.21.15.38:0/3687735470 conn(0x7f15500c0860 msgr2=0x7f15500bda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 -- 172.21.15.38:0/3687735470 shutdown_connections 2023-07-11T00:01:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.129+0000 7f155801d700 1 -- 172.21.15.38:0/3687735470 wait complete. 2023-07-11T00:01:00.143 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:01:00.144 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:01:00.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.271+0000 7f2418109700 1 Processor -- start 2023-07-11T00:01:00.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.271+0000 7f2418109700 1 -- start start 2023-07-11T00:01:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f2418109700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24100717f0 0x7f24100b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f2418109700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2410071bc0 0x7f24100ba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f2418109700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24100ba010 con 0x7f24100b8e60 2023-07-11T00:01:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f2418109700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24100b85a0 con 0x7f2410071bc0 2023-07-11T00:01:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f2418109700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24100b7470 con 0x7f24100717f0 2023-07-11T00:01:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f24156a4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2410071bc0 0x7f24100ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f24156a4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2410071bc0 0x7f24100ba3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58976/0 (socket says 172.21.15.38:58976) 2023-07-11T00:01:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f24156a4700 1 -- 172.21.15.38:0/1123107032 learned_addr learned my addr 172.21.15.38:0/1123107032 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f2415ea5700 1 --2- 172.21.15.38:0/1123107032 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24100717f0 0x7f24100b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f24156a4700 1 -- 172.21.15.38:0/1123107032 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24100717f0 msgr2=0x7f24100b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f24156a4700 1 --2- 172.21.15.38:0/1123107032 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24100717f0 0x7f24100b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f24156a4700 1 -- 172.21.15.38:0/1123107032 >> v1:172.21.15.70:6789/0 conn(0x7f24100b8e60 legacy=0x7f2410142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.272+0000 7f24156a4700 1 -- 172.21.15.38:0/1123107032 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24100b7750 con 0x7f2410071bc0 2023-07-11T00:01:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f24156a4700 1 --2- 172.21.15.38:0/1123107032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2410071bc0 0x7f24100ba3e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2400009920 tx=0x7f2400009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db8f164fafd38ce server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f2414ea3700 1 -- 172.21.15.38:0/1123107032 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240000ba20 con 0x7f2410071bc0 2023-07-11T00:01:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f2414ea3700 1 -- 172.21.15.38:0/1123107032 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240000bb80 con 0x7f2410071bc0 2023-07-11T00:01:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f2414ea3700 1 -- 172.21.15.38:0/1123107032 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400009e70 con 0x7f2410071bc0 2023-07-11T00:01:00.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f2418109700 1 -- 172.21.15.38:0/1123107032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2410071bc0 msgr2=0x7f24100ba3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f2418109700 1 --2- 172.21.15.38:0/1123107032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2410071bc0 0x7f24100ba3e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2400009920 tx=0x7f2400009c30 comp rx=0 tx=0).stop 2023-07-11T00:01:00.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f2418109700 1 -- 172.21.15.38:0/1123107032 shutdown_connections 2023-07-11T00:01:00.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f2418109700 1 --2- 172.21.15.38:0/1123107032 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24100717f0 0x7f24100b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f2418109700 1 --2- 172.21.15.38:0/1123107032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2410071bc0 0x7f24100ba3e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f2418109700 1 -- 172.21.15.38:0/1123107032 >> 172.21.15.38:0/1123107032 conn(0x7f241006d0e0 msgr2=0x7f241006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f2418109700 1 -- 172.21.15.38:0/1123107032 shutdown_connections 2023-07-11T00:01:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.273+0000 7f2418109700 1 -- 172.21.15.38:0/1123107032 wait complete. 2023-07-11T00:01:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.274+0000 7f2418109700 1 Processor -- start 2023-07-11T00:01:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.274+0000 7f2418109700 1 -- start start 2023-07-11T00:01:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f2418109700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24100717f0 0x7f24101403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f2418109700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2410071bc0 0x7f24101dd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f2418109700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24100b8e60 0x7f24101ddc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f2418109700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410140920 con 0x7f2410071bc0 2023-07-11T00:01:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f2418109700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410146700 con 0x7f24100717f0 2023-07-11T00:01:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f2418109700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24101cf460 con 0x7f24100b8e60 2023-07-11T00:01:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f24156a4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2410071bc0 0x7f24101dd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f24156a4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2410071bc0 0x7f24101dd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58992/0 (socket says 172.21.15.38:58992) 2023-07-11T00:01:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f24156a4700 1 -- 172.21.15.38:0/2711534945 learned_addr learned my addr 172.21.15.38:0/2711534945 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f2415ea5700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24100717f0 0x7f24101403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f24166a6700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24100b8e60 0x7f24101ddc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f24156a4700 1 -- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24100b8e60 msgr2=0x7f24101ddc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f24156a4700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24100b8e60 0x7f24101ddc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f24156a4700 1 -- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24100717f0 msgr2=0x7f24101403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.275+0000 7f24156a4700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24100717f0 0x7f24101403e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.276+0000 7f24156a4700 1 -- 172.21.15.38:0/2711534945 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400009550 con 0x7f2410071bc0 2023-07-11T00:01:00.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.276+0000 7f24156a4700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2410071bc0 0x7f24101dd710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f240000c010 tx=0x7f2400004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:00.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.276+0000 7f24067fc700 1 -- 172.21.15.38:0/2711534945 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400004300 con 0x7f2410071bc0 2023-07-11T00:01:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.276+0000 7f24067fc700 1 -- 172.21.15.38:0/2711534945 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240001f070 con 0x7f2410071bc0 2023-07-11T00:01:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.276+0000 7f2418109700 1 -- 172.21.15.38:0/2711534945 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24101cefd0 con 0x7f2410071bc0 2023-07-11T00:01:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.276+0000 7f24067fc700 1 -- 172.21.15.38:0/2711534945 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000036a0 con 0x7f2410071bc0 2023-07-11T00:01:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.276+0000 7f2418109700 1 -- 172.21.15.38:0/2711534945 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24101ce980 con 0x7f2410071bc0 2023-07-11T00:01:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.277+0000 7f2418109700 1 -- 172.21.15.38:0/2711534945 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2410074360 con 0x7f2410071bc0 2023-07-11T00:01:00.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.277+0000 7f24067fc700 1 -- 172.21.15.38:0/2711534945 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2400021030 con 0x7f2410071bc0 2023-07-11T00:01:00.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.278+0000 7f24067fc700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f23f406ace0 0x7f23f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.278+0000 7f24067fc700 1 -- 172.21.15.38:0/2711534945 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f240008a570 con 0x7f2410071bc0 2023-07-11T00:01:00.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.278+0000 7f2415ea5700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f23f406ace0 0x7f23f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.279+0000 7f2415ea5700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f23f406ace0 0x7f23f406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f240c0099d0 tx=0x7f240c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:00.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.283+0000 7f24067fc700 1 -- 172.21.15.38:0/2711534945 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f24000559f0 con 0x7f2410071bc0 2023-07-11T00:01:00.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.483+0000 7f2418109700 1 -- 172.21.15.38:0/2711534945 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f24100b7e80 con 0x7f2410071bc0 2023-07-11T00:01:00.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.484+0000 7f24067fc700 1 -- 172.21.15.38:0/2711534945 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2400059010 con 0x7f2410071bc0 2023-07-11T00:01:00.486 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:01:00.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 -- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f23f406ace0 msgr2=0x7f23f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f23f406ace0 0x7f23f406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f240c0099d0 tx=0x7f240c008040 comp rx=0 tx=0).stop 2023-07-11T00:01:00.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 -- 172.21.15.38:0/2711534945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2410071bc0 msgr2=0x7f24101dd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2410071bc0 0x7f24101dd710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f240000c010 tx=0x7f2400004750 comp rx=0 tx=0).stop 2023-07-11T00:01:00.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 -- 172.21.15.38:0/2711534945 shutdown_connections 2023-07-11T00:01:00.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f23f406ace0 0x7f23f406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f24100b8e60 0x7f24101ddc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24100717f0 0x7f24101403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 --2- 172.21.15.38:0/2711534945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2410071bc0 0x7f24101dd710 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 -- 172.21.15.38:0/2711534945 >> 172.21.15.38:0/2711534945 conn(0x7f241006d0e0 msgr2=0x7f241006d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:00.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 -- 172.21.15.38:0/2711534945 shutdown_connections 2023-07-11T00:01:00.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.486+0000 7f2418109700 1 -- 172.21.15.38:0/2711534945 wait complete. 2023-07-11T00:01:00.500 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:01:00.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.627+0000 7f9e88aa3700 1 Processor -- start 2023-07-11T00:01:00.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.627+0000 7f9e88aa3700 1 -- start start 2023-07-11T00:01:00.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.628+0000 7f9e88aa3700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e84071d20 0x7f9e841458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.628+0000 7f9e88aa3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e84070130 con 0x7f9e840709c0 2023-07-11T00:01:00.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.628+0000 7f9e88aa3700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e84070f80 con 0x7f9e8414bf30 2023-07-11T00:01:00.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.628+0000 7f9e88aa3700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e84071260 con 0x7f9e84071d20 2023-07-11T00:01:00.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.628+0000 7f9e82d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9e840709c0 0x7f9e84153080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33578/0 (socket says 172.21.15.38:33578) 2023-07-11T00:01:00.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.628+0000 7f9e82d9d700 1 -- 172.21.15.38:0/1072289636 learned_addr learned my addr 172.21.15.38:0/1072289636 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:01:00.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.628+0000 7f9e81d9b700 1 --2- 172.21.15.38:0/1072289636 >> v2:172.21.15.70:3300/0 conn(0x7f9e84071d20 0x7f9e841458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.628+0000 7f9e8159a700 1 -- 172.21.15.38:0/1072289636 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662515160 0 0) 0x7f9e84070130 con 0x7f9e840709c0 2023-07-11T00:01:00.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.628+0000 7f9e8159a700 1 -- 172.21.15.38:0/1072289636 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e6c0035b0 con 0x7f9e840709c0 2023-07-11T00:01:00.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.629+0000 7f9e8159a700 1 -- 172.21.15.38:0/1072289636 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022748892 0 0) 0x7f9e84070f80 con 0x7f9e8414bf30 2023-07-11T00:01:00.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.629+0000 7f9e8159a700 1 -- 172.21.15.38:0/1072289636 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e84070130 con 0x7f9e8414bf30 2023-07-11T00:01:00.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.629+0000 7f9e81d9b700 1 -- 172.21.15.38:0/1072289636 >> v1:172.21.15.70:6789/0 conn(0x7f9e8414bf30 legacy=0x7f9e840b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.629+0000 7f9e81d9b700 1 -- 172.21.15.38:0/1072289636 >> v1:172.21.15.38:6789/0 conn(0x7f9e840709c0 legacy=0x7f9e84153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.629+0000 7f9e81d9b700 1 -- 172.21.15.38:0/1072289636 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e84071540 con 0x7f9e84071d20 2023-07-11T00:01:00.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.629+0000 7f9e81d9b700 1 --2- 172.21.15.38:0/1072289636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e84071d20 0x7f9e841458b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009840 tx=0x7f9e78009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6eebc3feb59e2ec server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:00.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.629+0000 7f9e8159a700 1 -- 172.21.15.38:0/1072289636 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e78011830 con 0x7f9e84071d20 2023-07-11T00:01:00.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.629+0000 7f9e8159a700 1 -- 172.21.15.38:0/1072289636 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e78011990 con 0x7f9e84071d20 2023-07-11T00:01:00.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.629+0000 7f9e8159a700 1 -- 172.21.15.38:0/1072289636 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e78011d20 con 0x7f9e84071d20 2023-07-11T00:01:00.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.630+0000 7f9e88aa3700 1 -- 172.21.15.38:0/1072289636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e84071d20 msgr2=0x7f9e841458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.630+0000 7f9e88aa3700 1 --2- 172.21.15.38:0/1072289636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e84071d20 0x7f9e841458b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009840 tx=0x7f9e78009b50 comp rx=0 tx=0).stop 2023-07-11T00:01:00.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.630+0000 7f9e88aa3700 1 -- 172.21.15.38:0/1072289636 shutdown_connections 2023-07-11T00:01:00.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.630+0000 7f9e88aa3700 1 --2- 172.21.15.38:0/1072289636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e84071d20 0x7f9e841458b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.630+0000 7f9e88aa3700 1 -- 172.21.15.38:0/1072289636 >> 172.21.15.38:0/1072289636 conn(0x7f9e840be670 msgr2=0x7f9e840bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:00.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.630+0000 7f9e88aa3700 1 -- 172.21.15.38:0/1072289636 shutdown_connections 2023-07-11T00:01:00.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.630+0000 7f9e88aa3700 1 -- 172.21.15.38:0/1072289636 wait complete. 2023-07-11T00:01:00.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.631+0000 7f9e88aa3700 1 Processor -- start 2023-07-11T00:01:00.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.631+0000 7f9e88aa3700 1 -- start start 2023-07-11T00:01:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e88aa3700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9e840709c0 0x7f9e840b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e88aa3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e84071d20 0x7f9e840b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e88aa3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e8414bf30 0x7f9e841de2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e88aa3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840b80a0 con 0x7f9e8414bf30 2023-07-11T00:01:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e88aa3700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840b4e70 con 0x7f9e84071d20 2023-07-11T00:01:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e88aa3700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840b45b0 con 0x7f9e840709c0 2023-07-11T00:01:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e82d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e8414bf30 0x7f9e841de2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e82d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e8414bf30 0x7f9e841de2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59004/0 (socket says 172.21.15.38:59004) 2023-07-11T00:01:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e82d9d700 1 -- 172.21.15.38:0/2926038742 learned_addr learned my addr 172.21.15.38:0/2926038742 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e8259c700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9e840709c0 0x7f9e840b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e81d9b700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e84071d20 0x7f9e840b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e82d9d700 1 -- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9e840709c0 msgr2=0x7f9e840b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e82d9d700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9e840709c0 0x7f9e840b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e82d9d700 1 -- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e84071d20 msgr2=0x7f9e840b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e82d9d700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e84071d20 0x7f9e840b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e82d9d700 1 -- 172.21.15.38:0/2926038742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e780094a0 con 0x7f9e8414bf30 2023-07-11T00:01:00.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e82d9d700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e8414bf30 0x7f9e841de2a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00cbd0 tx=0x7f9e7c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:00.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e72ffd700 1 -- 172.21.15.38:0/2926038742 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c00ab10 con 0x7f9e8414bf30 2023-07-11T00:01:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e72ffd700 1 -- 172.21.15.38:0/2926038742 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c00ac70 con 0x7f9e8414bf30 2023-07-11T00:01:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e72ffd700 1 -- 172.21.15.38:0/2926038742 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c012400 con 0x7f9e8414bf30 2023-07-11T00:01:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e88aa3700 1 -- 172.21.15.38:0/2926038742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e840b4820 con 0x7f9e8414bf30 2023-07-11T00:01:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.632+0000 7f9e88aa3700 1 -- 172.21.15.38:0/2926038742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e840b2f20 con 0x7f9e8414bf30 2023-07-11T00:01:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.633+0000 7f9e88aa3700 1 -- 172.21.15.38:0/2926038742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e840b5020 con 0x7f9e8414bf30 2023-07-11T00:01:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.634+0000 7f9e72ffd700 1 -- 172.21.15.38:0/2926038742 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9e7c01b3b0 con 0x7f9e8414bf30 2023-07-11T00:01:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.634+0000 7f9e72ffd700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9e6406ace0 0x7f9e6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.634+0000 7f9e72ffd700 1 -- 172.21.15.38:0/2926038742 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9e7c088ef0 con 0x7f9e8414bf30 2023-07-11T00:01:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.635+0000 7f9e8259c700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9e6406ace0 0x7f9e6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.635+0000 7f9e8259c700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9e6406ace0 0x7f9e6406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9e74007fd0 tx=0x7f9e74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.639+0000 7f9e72ffd700 1 -- 172.21.15.38:0/2926038742 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9e7c057e10 con 0x7f9e8414bf30 2023-07-11T00:01:00.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.834+0000 7f9e88aa3700 1 -- 172.21.15.38:0/2926038742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e84074360 con 0x7f9e8414bf30 2023-07-11T00:01:00.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.835+0000 7f9e72ffd700 1 -- 172.21.15.38:0/2926038742 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e7c0170a0 con 0x7f9e8414bf30 2023-07-11T00:01:00.837 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:01:00.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 -- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9e6406ace0 msgr2=0x7f9e6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9e6406ace0 0x7f9e6406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9e74007fd0 tx=0x7f9e74009040 comp rx=0 tx=0).stop 2023-07-11T00:01:00.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 -- 172.21.15.38:0/2926038742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e8414bf30 msgr2=0x7f9e841de2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e8414bf30 0x7f9e841de2a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00cbd0 tx=0x7f9e7c00cf90 comp rx=0 tx=0).stop 2023-07-11T00:01:00.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 -- 172.21.15.38:0/2926038742 shutdown_connections 2023-07-11T00:01:00.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f9e6406ace0 0x7f9e6406d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e8414bf30 0x7f9e841de2a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9e840709c0 0x7f9e840b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 --2- 172.21.15.38:0/2926038742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e84071d20 0x7f9e840b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 -- 172.21.15.38:0/2926038742 >> 172.21.15.38:0/2926038742 conn(0x7f9e840be670 msgr2=0x7f9e840bb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:00.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 -- 172.21.15.38:0/2926038742 shutdown_connections 2023-07-11T00:01:00.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.837+0000 7f9e88aa3700 1 -- 172.21.15.38:0/2926038742 wait complete. 2023-07-11T00:01:00.851 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-11T00:01:00.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.976+0000 7f5adb937700 1 Processor -- start 2023-07-11T00:01:00.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.976+0000 7f5adb937700 1 -- start start 2023-07-11T00:01:00.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5adb937700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40b8d90 0x7f5ad406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5adb937700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad40b8620 con 0x7f5ad41449d0 2023-07-11T00:01:00.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5adb937700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad40b8900 con 0x7f5ad40bc810 2023-07-11T00:01:00.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5adb937700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40b97a0 con 0x7f5ad40b8d90 2023-07-11T00:01:00.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5ad96d3700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5ad41449d0 0x7f5ad414db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33584/0 (socket says 172.21.15.38:33584) 2023-07-11T00:01:00.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5ad96d3700 1 -- 172.21.15.38:0/2193409435 learned_addr learned my addr 172.21.15.38:0/2193409435 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:01:00.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5ad9ed4700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40b8d90 0x7f5ad406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475133956 0 0) 0x7f5ad40b8620 con 0x7f5ad41449d0 2023-07-11T00:01:00.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac00035b0 con 0x7f5ad41449d0 2023-07-11T00:01:00.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1277589508 0 0) 0x7f5ac00035b0 con 0x7f5ad41449d0 2023-07-11T00:01:00.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40b8d90 msgr2=0x7f5ad406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:00.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40b8d90 0x7f5ad406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 >> v1:172.21.15.70:6789/0 conn(0x7f5ad40bc810 legacy=0x7f5ad40ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40bac40 con 0x7f5ad41449d0 2023-07-11T00:01:00.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f5ad0001670 con 0x7f5ad41449d0 2023-07-11T00:01:00.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 >> v1:172.21.15.38:6789/0 conn(0x7f5ad41449d0 legacy=0x7f5ad414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac0003a30 0x7f5ac0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40b8d90 0x7f5ac0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac0004d90 0x7f5ac0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40b97a0 con 0x7f5ac0004d90 2023-07-11T00:01:00.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac000bb50 con 0x7f5ac0003a30 2023-07-11T00:01:00.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac000bce0 con 0x7f5ad40b8d90 2023-07-11T00:01:00.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.977+0000 7f5ad9ed4700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac0004d90 0x7f5ac0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5ad96d3700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac0003a30 0x7f5ac0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5ad8ed2700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40b8d90 0x7f5ac0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5ad9ed4700 1 -- 172.21.15.38:0/2193409435 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40b8d90 msgr2=0x7f5ac0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:00.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5ad9ed4700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40b8d90 0x7f5ac0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5ad9ed4700 1 -- 172.21.15.38:0/2193409435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac0003a30 msgr2=0x7f5ac0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:00.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5ad9ed4700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac0003a30 0x7f5ac0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5ad9ed4700 1 -- 172.21.15.38:0/2193409435 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac00035b0 con 0x7f5ac0004d90 2023-07-11T00:01:00.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5ad9ed4700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac0004d90 0x7f5ac0005200 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009fc0 tx=0x7f5ac0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af685fd09d3624e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:00.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00ec30 con 0x7f5ac0004d90 2023-07-11T00:01:00.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc00f040 con 0x7f5ac0004d90 2023-07-11T00:01:00.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5acbfff700 1 -- 172.21.15.38:0/2193409435 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc014480 con 0x7f5ac0004d90 2023-07-11T00:01:00.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5adb937700 1 -- 172.21.15.38:0/2193409435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac0004d90 msgr2=0x7f5ac0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5adb937700 1 --2- 172.21.15.38:0/2193409435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac0004d90 0x7f5ac0005200 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009fc0 tx=0x7f5ac0005880 comp rx=0 tx=0).stop 2023-07-11T00:01:00.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.978+0000 7f5ad9ed4700 1 -- 172.21.15.38:0/2193409435 reap_dead start 2023-07-11T00:01:00.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.979+0000 7f5adb937700 1 -- 172.21.15.38:0/2193409435 shutdown_connections 2023-07-11T00:01:00.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.979+0000 7f5adb937700 1 -- 172.21.15.38:0/2193409435 >> 172.21.15.38:0/2193409435 conn(0x7f5ad40c0860 msgr2=0x7f5ad40c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:00.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.979+0000 7f5adb937700 1 -- 172.21.15.38:0/2193409435 shutdown_connections 2023-07-11T00:01:00.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.979+0000 7f5adb937700 1 -- 172.21.15.38:0/2193409435 wait complete. 2023-07-11T00:01:00.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.980+0000 7f5adb937700 1 Processor -- start 2023-07-11T00:01:00.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.980+0000 7f5adb937700 1 -- start start 2023-07-11T00:01:00.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.980+0000 7f5adb937700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ad40a2b70 0x7f5ad41e01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.980+0000 7f5adb937700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40a2f40 0x7f5ad41e0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.980+0000 7f5adb937700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ad40b3400 0x7f5ad40b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.980+0000 7f5adb937700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40a18c0 con 0x7f5ad40b3400 2023-07-11T00:01:00.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.980+0000 7f5adb937700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40a3ff0 con 0x7f5ad40a2b70 2023-07-11T00:01:00.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.980+0000 7f5adb937700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad41453e0 con 0x7f5ad40a2f40 2023-07-11T00:01:00.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.980+0000 7f5ad9ed4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ad40b3400 0x7f5ad40b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.980+0000 7f5ad9ed4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ad40b3400 0x7f5ad40b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59022/0 (socket says 172.21.15.38:59022) 2023-07-11T00:01:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.980+0000 7f5ad9ed4700 1 -- 172.21.15.38:0/607195794 learned_addr learned my addr 172.21.15.38:0/607195794 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ad8ed2700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40a2f40 0x7f5ad41e0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ad96d3700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ad40a2b70 0x7f5ad41e01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ad9ed4700 1 -- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40a2f40 msgr2=0x7f5ad41e0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ad9ed4700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40a2f40 0x7f5ad41e0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ad9ed4700 1 -- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ad40a2b70 msgr2=0x7f5ad41e01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:00.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ad9ed4700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ad40a2b70 0x7f5ad41e01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:00.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ad9ed4700 1 -- 172.21.15.38:0/607195794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40a3400 con 0x7f5ad40b3400 2023-07-11T00:01:00.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ad96d3700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ad40a2b70 0x7f5ad41e01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:01:00.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ad9ed4700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ad40b3400 0x7f5ad40b38a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5acc016000 tx=0x7f5acc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:00.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ac9ffb700 1 -- 172.21.15.38:0/607195794 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc007000 con 0x7f5ad40b3400 2023-07-11T00:01:00.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ac9ffb700 1 -- 172.21.15.38:0/607195794 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc022070 con 0x7f5ad40b3400 2023-07-11T00:01:00.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5ac9ffb700 1 -- 172.21.15.38:0/607195794 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc029480 con 0x7f5ad40b3400 2023-07-11T00:01:00.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5adb937700 1 -- 172.21.15.38:0/607195794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad40a1550 con 0x7f5ad40b3400 2023-07-11T00:01:00.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.981+0000 7f5adb937700 1 -- 172.21.15.38:0/607195794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad40b3de0 con 0x7f5ad40b3400 2023-07-11T00:01:00.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.982+0000 7f5adb937700 1 -- 172.21.15.38:0/607195794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad4074360 con 0x7f5ad40b3400 2023-07-11T00:01:00.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.983+0000 7f5ac9ffb700 1 -- 172.21.15.38:0/607195794 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5acc01e430 con 0x7f5ad40b3400 2023-07-11T00:01:00.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.983+0000 7f5ac9ffb700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5ab806ace0 0x7f5ab806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:00.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.983+0000 7f5ac9ffb700 1 -- 172.21.15.38:0/607195794 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5acc024070 con 0x7f5ad40b3400 2023-07-11T00:01:00.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.983+0000 7f5ad96d3700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5ab806ace0 0x7f5ab806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:00.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.984+0000 7f5ad96d3700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5ab806ace0 0x7f5ab806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0000c00 tx=0x7f5ad0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:00.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:00.988+0000 7f5ac9ffb700 1 -- 172.21.15.38:0/607195794 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5acc055e60 con 0x7f5ad40b3400 2023-07-11T00:01:01.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.187+0000 7f5adb937700 1 -- 172.21.15.38:0/607195794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5ad40bc330 con 0x7f5ad40b3400 2023-07-11T00:01:01.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.187+0000 7f5ac9ffb700 1 -- 172.21.15.38:0/607195794 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5acc018090 con 0x7f5ad40b3400 2023-07-11T00:01:01.190 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:01:01.190 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-07-11T00:01:01.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:01:01.190 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-07-11T00:01:01.190 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": "rbd" 2023-07-11T00:01:01.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-07-11T00:01:01.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-07-11T00:01:01.191 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 2, 2023-07-11T00:01:01.191 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-07-11T00:01:01.191 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-07-11T00:01:01.191 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-07-11T00:01:01.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.189+0000 7f5adb937700 1 -- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5ab806ace0 msgr2=0x7f5ab806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:01.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.189+0000 7f5adb937700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5ab806ace0 0x7f5ab806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0000c00 tx=0x7f5ad0009040 comp rx=0 tx=0).stop 2023-07-11T00:01:01.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.189+0000 7f5adb937700 1 -- 172.21.15.38:0/607195794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ad40b3400 msgr2=0x7f5ad40b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:01.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.189+0000 7f5adb937700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ad40b3400 0x7f5ad40b38a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5acc016000 tx=0x7f5acc009750 comp rx=0 tx=0).stop 2023-07-11T00:01:01.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.190+0000 7f5adb937700 1 -- 172.21.15.38:0/607195794 shutdown_connections 2023-07-11T00:01:01.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.190+0000 7f5adb937700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f5ab806ace0 0x7f5ab806d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.190+0000 7f5adb937700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ad40b3400 0x7f5ad40b38a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.190+0000 7f5adb937700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ad40a2b70 0x7f5ad41e01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.190+0000 7f5adb937700 1 --2- 172.21.15.38:0/607195794 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5ad40a2f40 0x7f5ad41e0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.190+0000 7f5adb937700 1 -- 172.21.15.38:0/607195794 >> 172.21.15.38:0/607195794 conn(0x7f5ad40c0860 msgr2=0x7f5ad4143910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:01.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.190+0000 7f5adb937700 1 -- 172.21.15.38:0/607195794 shutdown_connections 2023-07-11T00:01:01.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.190+0000 7f5adb937700 1 -- 172.21.15.38:0/607195794 wait complete. 2023-07-11T00:01:01.203 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-11T00:01:01.204 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-11T00:01:01.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.332+0000 7fb16b380700 1 Processor -- start 2023-07-11T00:01:01.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.332+0000 7fb16b380700 1 -- start start 2023-07-11T00:01:01.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.333+0000 7fb16b380700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1640b6980 0x7fb16414a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:01.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.333+0000 7fb16b380700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb1640bb880 0x7fb1640bbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:01.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.333+0000 7fb16b380700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1640bb380 con 0x7fb16414aae0 2023-07-11T00:01:01.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.333+0000 7fb16b380700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1640b7dd0 con 0x7fb1640bb880 2023-07-11T00:01:01.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.333+0000 7fb16b380700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640bc4c0 con 0x7fb1640b6980 2023-07-11T00:01:01.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.333+0000 7fb16991d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb1640bb880 0x7fb1640bbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:01.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.333+0000 7fb16991d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb1640bb880 0x7fb1640bbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59036/0 (socket says 172.21.15.38:59036) 2023-07-11T00:01:01.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.333+0000 7fb16991d700 1 -- 172.21.15.38:0/2777008784 learned_addr learned my addr 172.21.15.38:0/2777008784 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:01.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.333+0000 7fb16911c700 1 --2- 172.21.15.38:0/2777008784 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1640b6980 0x7fb16414a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:01.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb16991d700 1 -- 172.21.15.38:0/2777008784 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1640b6980 msgr2=0x7fb16414a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:01.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb16991d700 1 --2- 172.21.15.38:0/2777008784 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1640b6980 0x7fb16414a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb16991d700 1 -- 172.21.15.38:0/2777008784 >> v1:172.21.15.70:6789/0 conn(0x7fb16414aae0 legacy=0x7fb1641443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:01.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb16991d700 1 -- 172.21.15.38:0/2777008784 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16414aff0 con 0x7fb1640bb880 2023-07-11T00:01:01.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb16991d700 1 --2- 172.21.15.38:0/2777008784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1640bb880 0x7fb1640bbd00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009e50 tx=0x7fb15c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f6cf63f37be836 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:01.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb15bfff700 1 -- 172.21.15.38:0/2777008784 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00e070 con 0x7fb1640bb880 2023-07-11T00:01:01.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb15bfff700 1 -- 172.21.15.38:0/2777008784 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c003a20 con 0x7fb1640bb880 2023-07-11T00:01:01.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb15bfff700 1 -- 172.21.15.38:0/2777008784 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c003dd0 con 0x7fb1640bb880 2023-07-11T00:01:01.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb16b380700 1 -- 172.21.15.38:0/2777008784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1640bb880 msgr2=0x7fb1640bbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:01.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb16b380700 1 --2- 172.21.15.38:0/2777008784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1640bb880 0x7fb1640bbd00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009e50 tx=0x7fb15c00b330 comp rx=0 tx=0).stop 2023-07-11T00:01:01.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb16b380700 1 -- 172.21.15.38:0/2777008784 shutdown_connections 2023-07-11T00:01:01.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb16b380700 1 --2- 172.21.15.38:0/2777008784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1640bb880 0x7fb1640bbd00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb16b380700 1 --2- 172.21.15.38:0/2777008784 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1640b6980 0x7fb16414a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.334+0000 7fb16b380700 1 -- 172.21.15.38:0/2777008784 >> 172.21.15.38:0/2777008784 conn(0x7fb164071660 msgr2=0x7fb164071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.335+0000 7fb16b380700 1 -- 172.21.15.38:0/2777008784 shutdown_connections 2023-07-11T00:01:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.335+0000 7fb16b380700 1 -- 172.21.15.38:0/2777008784 wait complete. 2023-07-11T00:01:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16b380700 1 Processor -- start 2023-07-11T00:01:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16b380700 1 -- start start 2023-07-11T00:01:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16b380700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1640b6980 0x7fb1641494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:01.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16b380700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1640bb880 0x7fb164148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:01.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16b380700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16414aae0 0x7fb1641e3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:01.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16b380700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164148e80 con 0x7fb16414aae0 2023-07-11T00:01:01.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16b380700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164143660 con 0x7fb1640bb880 2023-07-11T00:01:01.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16b380700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb164143940 con 0x7fb1640b6980 2023-07-11T00:01:01.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16991d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16414aae0 0x7fb1641e3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16991d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16414aae0 0x7fb1641e3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59042/0 (socket says 172.21.15.38:59042) 2023-07-11T00:01:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16991d700 1 -- 172.21.15.38:0/3519033364 learned_addr learned my addr 172.21.15.38:0/3519033364 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16891b700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1640bb880 0x7fb164148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.336+0000 7fb16911c700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1640b6980 0x7fb1641494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.337+0000 7fb16991d700 1 -- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1640b6980 msgr2=0x7fb1641494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.337+0000 7fb16991d700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1640b6980 0x7fb1641494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.337+0000 7fb16991d700 1 -- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1640bb880 msgr2=0x7fb164148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.337+0000 7fb16991d700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1640bb880 0x7fb164148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.337+0000 7fb16991d700 1 -- 172.21.15.38:0/3519033364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c009b30 con 0x7fb16414aae0 2023-07-11T00:01:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.337+0000 7fb16991d700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16414aae0 0x7fb1641e3120 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb164067390 tx=0x7fb15c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.337+0000 7fb159ffb700 1 -- 172.21.15.38:0/3519033364 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0092e0 con 0x7fb16414aae0 2023-07-11T00:01:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.337+0000 7fb159ffb700 1 -- 172.21.15.38:0/3519033364 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c0094d0 con 0x7fb16414aae0 2023-07-11T00:01:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.337+0000 7fb16b380700 1 -- 172.21.15.38:0/3519033364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb164143c20 con 0x7fb16414aae0 2023-07-11T00:01:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.337+0000 7fb159ffb700 1 -- 172.21.15.38:0/3519033364 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0044a0 con 0x7fb16414aae0 2023-07-11T00:01:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.337+0000 7fb16b380700 1 -- 172.21.15.38:0/3519033364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1641433b0 con 0x7fb16414aae0 2023-07-11T00:01:01.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.338+0000 7fb16b380700 1 -- 172.21.15.38:0/3519033364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb164074360 con 0x7fb16414aae0 2023-07-11T00:01:01.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.339+0000 7fb159ffb700 1 -- 172.21.15.38:0/3519033364 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb15c019070 con 0x7fb16414aae0 2023-07-11T00:01:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.339+0000 7fb159ffb700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb14806ad10 0x7fb14806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.339+0000 7fb159ffb700 1 -- 172.21.15.38:0/3519033364 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb15c089ec0 con 0x7fb16414aae0 2023-07-11T00:01:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.340+0000 7fb16911c700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb14806ad10 0x7fb14806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.340+0000 7fb16911c700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb14806ad10 0x7fb14806d1c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb154006b20 tx=0x7fb154008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.344+0000 7fb159ffb700 1 -- 172.21.15.38:0/3519033364 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb15c058de0 con 0x7fb16414aae0 2023-07-11T00:01:01.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.540+0000 7fb16b380700 1 -- 172.21.15.38:0/3519033364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb16414b2a0 con 0x7fb16414aae0 2023-07-11T00:01:01.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.840+0000 7fb159ffb700 1 -- 172.21.15.38:0/3519033364 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb15c0170b0 con 0x7fb16414aae0 2023-07-11T00:01:01.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 -- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb14806ad10 msgr2=0x7fb14806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:01.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb14806ad10 0x7fb14806d1c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb154006b20 tx=0x7fb154008040 comp rx=0 tx=0).stop 2023-07-11T00:01:01.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 -- 172.21.15.38:0/3519033364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16414aae0 msgr2=0x7fb1641e3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:01.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16414aae0 0x7fb1641e3120 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb164067390 tx=0x7fb15c004ad0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 -- 172.21.15.38:0/3519033364 shutdown_connections 2023-07-11T00:01:01.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fb14806ad10 0x7fb14806d1c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16414aae0 0x7fb1641e3120 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1640b6980 0x7fb1641494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 --2- 172.21.15.38:0/3519033364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1640bb880 0x7fb164148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 -- 172.21.15.38:0/3519033364 >> 172.21.15.38:0/3519033364 conn(0x7fb164071660 msgr2=0x7fb16413d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:01.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 -- 172.21.15.38:0/3519033364 shutdown_connections 2023-07-11T00:01:01.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.844+0000 7fb16b380700 1 -- 172.21.15.38:0/3519033364 wait complete. 2023-07-11T00:01:01.847 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-07-11T00:01:01.861 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-11T00:01:01.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.993+0000 7fa773e3b700 1 Processor -- start 2023-07-11T00:01:01.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.994+0000 7fa773e3b700 1 -- start start 2023-07-11T00:01:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa773e3b700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa76c141780 0x7fa76c0ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa773e3b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa76c071a30 0x7fa76c14ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa773e3b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c070e70 con 0x7fa76c0b96b0 2023-07-11T00:01:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa773e3b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c071ea0 con 0x7fa76c071a30 2023-07-11T00:01:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa773e3b700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c0b9b40 con 0x7fa76c141780 2023-07-11T00:01:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa7713d6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa76c071a30 0x7fa76c14ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa7723d8700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa76c0b96b0 0x7fa76c0b7f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33586/0 (socket says 172.21.15.38:33586) 2023-07-11T00:01:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa7723d8700 1 -- 172.21.15.38:0/1846356334 learned_addr learned my addr 172.21.15.38:0/1846356334 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:01:01.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa771bd7700 1 --2- 172.21.15.38:0/1846356334 >> v2:172.21.15.70:3300/0 conn(0x7fa76c141780 0x7fa76c0ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:01.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa7713d6700 1 -- 172.21.15.38:0/1846356334 >> v2:172.21.15.70:3300/0 conn(0x7fa76c141780 msgr2=0x7fa76c0ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:01.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa7713d6700 1 --2- 172.21.15.38:0/1846356334 >> v2:172.21.15.70:3300/0 conn(0x7fa76c141780 0x7fa76c0ba010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:01.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa7713d6700 1 -- 172.21.15.38:0/1846356334 >> v1:172.21.15.38:6789/0 conn(0x7fa76c0b96b0 legacy=0x7fa76c0b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:01.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa7713d6700 1 -- 172.21.15.38:0/1846356334 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c070670 con 0x7fa76c071a30 2023-07-11T00:01:01.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa770bd5700 1 -- 172.21.15.38:0/1846356334 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320224962 0 0) 0x7fa76c070e70 con 0x7fa76c0b96b0 2023-07-11T00:01:01.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.995+0000 7fa7713d6700 1 --2- 172.21.15.38:0/1846356334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa76c071a30 0x7fa76c14ab20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0b9400 tx=0x7fa75c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce72346c1dd9cf78 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:02.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.996+0000 7fa770bd5700 1 -- 172.21.15.38:0/1846356334 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c011830 con 0x7fa76c071a30 2023-07-11T00:01:02.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.996+0000 7fa770bd5700 1 -- 172.21.15.38:0/1846356334 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c011990 con 0x7fa76c071a30 2023-07-11T00:01:02.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.996+0000 7fa770bd5700 1 -- 172.21.15.38:0/1846356334 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c011d20 con 0x7fa76c071a30 2023-07-11T00:01:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.996+0000 7fa773e3b700 1 -- 172.21.15.38:0/1846356334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa76c071a30 msgr2=0x7fa76c14ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.996+0000 7fa773e3b700 1 --2- 172.21.15.38:0/1846356334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa76c071a30 0x7fa76c14ab20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0b9400 tx=0x7fa75c009b20 comp rx=0 tx=0).stop 2023-07-11T00:01:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.996+0000 7fa773e3b700 1 -- 172.21.15.38:0/1846356334 shutdown_connections 2023-07-11T00:01:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.996+0000 7fa773e3b700 1 --2- 172.21.15.38:0/1846356334 >> v2:172.21.15.70:3300/0 conn(0x7fa76c141780 0x7fa76c0ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.996+0000 7fa773e3b700 1 --2- 172.21.15.38:0/1846356334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa76c071a30 0x7fa76c14ab20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.996+0000 7fa773e3b700 1 -- 172.21.15.38:0/1846356334 >> 172.21.15.38:0/1846356334 conn(0x7fa76c06d0e0 msgr2=0x7fa76c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.996+0000 7fa773e3b700 1 -- 172.21.15.38:0/1846356334 shutdown_connections 2023-07-11T00:01:02.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.996+0000 7fa773e3b700 1 -- 172.21.15.38:0/1846356334 wait complete. 2023-07-11T00:01:02.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.997+0000 7fa773e3b700 1 Processor -- start 2023-07-11T00:01:02.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.997+0000 7fa773e3b700 1 -- start start 2023-07-11T00:01:02.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa773e3b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa76c071a30 0x7fa76c13d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa773e3b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa76c0b96b0 0x7fa76c0b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa773e3b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa76c141780 0x7fa76c136810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa773e3b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c13da30 con 0x7fa76c071a30 2023-07-11T00:01:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa773e3b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0b7160 con 0x7fa76c141780 2023-07-11T00:01:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa773e3b700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0b6790 con 0x7fa76c0b96b0 2023-07-11T00:01:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa771bd7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa76c071a30 0x7fa76c13d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa771bd7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa76c071a30 0x7fa76c13d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59070/0 (socket says 172.21.15.38:59070) 2023-07-11T00:01:02.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa771bd7700 1 -- 172.21.15.38:0/654618634 learned_addr learned my addr 172.21.15.38:0/654618634 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:02.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa7723d8700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa76c141780 0x7fa76c136810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:02.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa7713d6700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa76c0b96b0 0x7fa76c0b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:02.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa771bd7700 1 -- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa76c0b96b0 msgr2=0x7fa76c0b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:02.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa771bd7700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa76c0b96b0 0x7fa76c0b6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:02.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa771bd7700 1 -- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa76c141780 msgr2=0x7fa76c136810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:02.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa771bd7700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa76c141780 0x7fa76c136810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:02.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.998+0000 7fa771bd7700 1 -- 172.21.15.38:0/654618634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c0094a0 con 0x7fa76c071a30 2023-07-11T00:01:02.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.999+0000 7fa771bd7700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa76c071a30 0x7fa76c13d4f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa76800d800 tx=0x7fa76800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:02.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.999+0000 7fa7627fc700 1 -- 172.21.15.38:0/654618634 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680125f0 con 0x7fa76c071a30 2023-07-11T00:01:02.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.999+0000 7fa7627fc700 1 -- 172.21.15.38:0/654618634 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768012750 con 0x7fa76c071a30 2023-07-11T00:01:02.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.999+0000 7fa773e3b700 1 -- 172.21.15.38:0/654618634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c0b6480 con 0x7fa76c071a30 2023-07-11T00:01:02.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.999+0000 7fa7627fc700 1 -- 172.21.15.38:0/654618634 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768012b00 con 0x7fa76c071a30 2023-07-11T00:01:02.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:01.999+0000 7fa773e3b700 1 -- 172.21.15.38:0/654618634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c0b5a80 con 0x7fa76c071a30 2023-07-11T00:01:02.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.000+0000 7fa773e3b700 1 -- 172.21.15.38:0/654618634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c074360 con 0x7fa76c071a30 2023-07-11T00:01:02.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.000+0000 7fa7627fc700 1 -- 172.21.15.38:0/654618634 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa768012c60 con 0x7fa76c071a30 2023-07-11T00:01:02.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.001+0000 7fa7627fc700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa75006ace0 0x7fa75006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:02.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.001+0000 7fa7627fc700 1 -- 172.21.15.38:0/654618634 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fa768089d90 con 0x7fa76c071a30 2023-07-11T00:01:02.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.001+0000 7fa7713d6700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa75006ace0 0x7fa75006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:02.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.002+0000 7fa7713d6700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa75006ace0 0x7fa75006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa76c06f450 tx=0x7fa75c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:02.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.005+0000 7fa7627fc700 1 -- 172.21.15.38:0/654618634 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa768055100 con 0x7fa76c071a30 2023-07-11T00:01:02.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.202+0000 7fa773e3b700 1 -- 172.21.15.38:0/654618634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa76c0b79c0 con 0x7fa76c071a30 2023-07-11T00:01:02.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.846+0000 7fa7627fc700 1 -- 172.21.15.38:0/654618634 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa768058720 con 0x7fa76c071a30 2023-07-11T00:01:02.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.857+0000 7fa773e3b700 1 -- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa75006ace0 msgr2=0x7fa75006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:02.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.857+0000 7fa773e3b700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa75006ace0 0x7fa75006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa76c06f450 tx=0x7fa75c008030 comp rx=0 tx=0).stop 2023-07-11T00:01:02.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.857+0000 7fa773e3b700 1 -- 172.21.15.38:0/654618634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa76c071a30 msgr2=0x7fa76c13d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:02.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.857+0000 7fa773e3b700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa76c071a30 0x7fa76c13d4f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa76800d800 tx=0x7fa76800db10 comp rx=0 tx=0).stop 2023-07-11T00:01:02.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.857+0000 7fa773e3b700 1 -- 172.21.15.38:0/654618634 shutdown_connections 2023-07-11T00:01:02.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.857+0000 7fa773e3b700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa75006ace0 0x7fa75006d190 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa76c06f450 tx=0x7fa75c008030 comp rx=0 tx=0).stop 2023-07-11T00:01:02.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.857+0000 7fa773e3b700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa76c141780 0x7fa76c136810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:02.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.857+0000 7fa773e3b700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa76c071a30 0x7fa76c13d4f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:02.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.857+0000 7fa773e3b700 1 --2- 172.21.15.38:0/654618634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa76c0b96b0 0x7fa76c0b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:02.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.857+0000 7fa773e3b700 1 -- 172.21.15.38:0/654618634 >> 172.21.15.38:0/654618634 conn(0x7fa76c06d0e0 msgr2=0x7fa76c0b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:02.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.858+0000 7fa773e3b700 1 -- 172.21.15.38:0/654618634 shutdown_connections 2023-07-11T00:01:02.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:02.859+0000 7fa773e3b700 1 -- 172.21.15.38:0/654618634 wait complete. 2023-07-11T00:01:02.864 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-07-11T00:01:02.879 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-11T00:01:03.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.013+0000 7ffb81f84700 1 Processor -- start 2023-07-11T00:01:03.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.013+0000 7ffb81f84700 1 -- start start 2023-07-11T00:01:03.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.014+0000 7ffb81f84700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ffb7c144820 0x7ffb7c0b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:03.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.014+0000 7ffb81f84700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb7c0b5a10 0x7ffb7c0b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:03.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.014+0000 7ffb81f84700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c0b5f00 con 0x7ffb7c14a800 2023-07-11T00:01:03.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.014+0000 7ffb81f84700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c0b61e0 con 0x7ffb7c0b5a10 2023-07-11T00:01:03.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.014+0000 7ffb81f84700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c0c17d0 con 0x7ffb7c144820 2023-07-11T00:01:03.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.014+0000 7ffb7affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb7c0b5a10 0x7ffb7c0b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:03.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.014+0000 7ffb7bfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ffb7c14a800 0x7ffb7c14ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33600/0 (socket says 172.21.15.38:33600) 2023-07-11T00:01:03.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.014+0000 7ffb7bfff700 1 -- 172.21.15.38:0/3872262459 learned_addr learned my addr 172.21.15.38:0/3872262459 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:01:03.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.014+0000 7ffb7affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb7c0b5a10 0x7ffb7c0b6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59072/0 (socket says 172.21.15.38:59072) 2023-07-11T00:01:03.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.014+0000 7ffb7b7fe700 1 --2- 172.21.15.38:0/3872262459 >> v2:172.21.15.70:3300/0 conn(0x7ffb7c144820 0x7ffb7c0b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:03.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb7affd700 1 -- 172.21.15.38:0/3872262459 >> v2:172.21.15.70:3300/0 conn(0x7ffb7c144820 msgr2=0x7ffb7c0b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb7affd700 1 --2- 172.21.15.38:0/3872262459 >> v2:172.21.15.70:3300/0 conn(0x7ffb7c144820 0x7ffb7c0b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb7affd700 1 -- 172.21.15.38:0/3872262459 >> v1:172.21.15.38:6789/0 conn(0x7ffb7c14a800 legacy=0x7ffb7c14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb7affd700 1 -- 172.21.15.38:0/3872262459 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c0b7160 con 0x7ffb7c0b5a10 2023-07-11T00:01:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb7a7fc700 1 -- 172.21.15.38:0/3872262459 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964651155 0 0) 0x7ffb7c0b5f00 con 0x7ffb7c14a800 2023-07-11T00:01:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb7affd700 1 --2- 172.21.15.38:0/3872262459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c0b5a10 0x7ffb7c0b6b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c067500 tx=0x7ffb64009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afaff455d301092 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb7a7fc700 1 -- 172.21.15.38:0/3872262459 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64011830 con 0x7ffb7c0b5a10 2023-07-11T00:01:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb7a7fc700 1 -- 172.21.15.38:0/3872262459 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb64011990 con 0x7ffb7c0b5a10 2023-07-11T00:01:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb7a7fc700 1 -- 172.21.15.38:0/3872262459 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64011d20 con 0x7ffb7c0b5a10 2023-07-11T00:01:03.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb81f84700 1 -- 172.21.15.38:0/3872262459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c0b5a10 msgr2=0x7ffb7c0b6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:03.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb81f84700 1 --2- 172.21.15.38:0/3872262459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c0b5a10 0x7ffb7c0b6b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c067500 tx=0x7ffb64009b20 comp rx=0 tx=0).stop 2023-07-11T00:01:03.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb81f84700 1 -- 172.21.15.38:0/3872262459 shutdown_connections 2023-07-11T00:01:03.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb81f84700 1 --2- 172.21.15.38:0/3872262459 >> v2:172.21.15.70:3300/0 conn(0x7ffb7c144820 0x7ffb7c0b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:03.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb81f84700 1 --2- 172.21.15.38:0/3872262459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c0b5a10 0x7ffb7c0b6b10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:03.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb81f84700 1 -- 172.21.15.38:0/3872262459 >> 172.21.15.38:0/3872262459 conn(0x7ffb7c0c08f0 msgr2=0x7ffb7c0c0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:03.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb81f84700 1 -- 172.21.15.38:0/3872262459 shutdown_connections 2023-07-11T00:01:03.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.015+0000 7ffb81f84700 1 -- 172.21.15.38:0/3872262459 wait complete. 2023-07-11T00:01:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.016+0000 7ffb81f84700 1 Processor -- start 2023-07-11T00:01:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.017+0000 7ffb81f84700 1 -- start start 2023-07-11T00:01:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.017+0000 7ffb81f84700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb7c0b5a10 0x7ffb7c1e0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.017+0000 7ffb81f84700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffb7c144820 0x7ffb7c1e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.017+0000 7ffb81f84700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c14a800 0x7ffb7c1455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.017+0000 7ffb81f84700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c1d0bd0 con 0x7ffb7c14a800 2023-07-11T00:01:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.017+0000 7ffb81f84700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c1e00a0 con 0x7ffb7c0b5a10 2023-07-11T00:01:03.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.017+0000 7ffb81f84700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c1e0380 con 0x7ffb7c144820 2023-07-11T00:01:03.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.017+0000 7ffb7bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c14a800 0x7ffb7c1455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:03.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.017+0000 7ffb7bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c14a800 0x7ffb7c1455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59086/0 (socket says 172.21.15.38:59086) 2023-07-11T00:01:03.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.017+0000 7ffb7bfff700 1 -- 172.21.15.38:0/907944737 learned_addr learned my addr 172.21.15.38:0/907944737 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:03.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb7b7fe700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb7c0b5a10 0x7ffb7c1e0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:03.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb7affd700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffb7c144820 0x7ffb7c1e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:03.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb7bfff700 1 -- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffb7c144820 msgr2=0x7ffb7c1e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:03.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb7bfff700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffb7c144820 0x7ffb7c1e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:03.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb7bfff700 1 -- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb7c0b5a10 msgr2=0x7ffb7c1e0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:03.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb7bfff700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb7c0b5a10 0x7ffb7c1e0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:03.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb7bfff700 1 -- 172.21.15.38:0/907944737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb640094a0 con 0x7ffb7c14a800 2023-07-11T00:01:03.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb7bfff700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c14a800 0x7ffb7c1455e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400cb30 tx=0x7ffb7400ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:03.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb73fff700 1 -- 172.21.15.38:0/907944737 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7400a9e0 con 0x7ffb7c14a800 2023-07-11T00:01:03.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb73fff700 1 -- 172.21.15.38:0/907944737 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7400ab80 con 0x7ffb7c14a800 2023-07-11T00:01:03.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb81f84700 1 -- 172.21.15.38:0/907944737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c1e0660 con 0x7ffb7c14a800 2023-07-11T00:01:03.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb73fff700 1 -- 172.21.15.38:0/907944737 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740070d0 con 0x7ffb7c14a800 2023-07-11T00:01:03.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.018+0000 7ffb81f84700 1 -- 172.21.15.38:0/907944737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c1d43e0 con 0x7ffb7c14a800 2023-07-11T00:01:03.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.020+0000 7ffb81f84700 1 -- 172.21.15.38:0/907944737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c1e08a0 con 0x7ffb7c14a800 2023-07-11T00:01:03.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.020+0000 7ffb73fff700 1 -- 172.21.15.38:0/907944737 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb74007230 con 0x7ffb7c14a800 2023-07-11T00:01:03.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.020+0000 7ffb73fff700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffb5c06ace0 0x7ffb5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:03.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.020+0000 7ffb73fff700 1 -- 172.21.15.38:0/907944737 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5962+0+0 (secure 0 0 0) 0x7ffb74088fd0 con 0x7ffb7c14a800 2023-07-11T00:01:03.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.021+0000 7ffb7b7fe700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffb5c06ace0 0x7ffb5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:03.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.021+0000 7ffb7b7fe700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffb5c06ace0 0x7ffb5c06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0099d0 tx=0x7ffb6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:03.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.025+0000 7ffb73fff700 1 -- 172.21.15.38:0/907944737 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ffb7c1e08a0 con 0x7ffb7c14a800 2023-07-11T00:01:03.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.265+0000 7ffb81f84700 1 -- 172.21.15.38:0/907944737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ffb7c1e08a0 con 0x7ffb7c14a800 2023-07-11T00:01:03.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.852+0000 7ffb73fff700 1 -- 172.21.15.38:0/907944737 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7ffb7c1e08a0 con 0x7ffb7c14a800 2023-07-11T00:01:03.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.863+0000 7ffb81f84700 1 -- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffb5c06ace0 msgr2=0x7ffb5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:03.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.863+0000 7ffb81f84700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffb5c06ace0 0x7ffb5c06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0099d0 tx=0x7ffb6c008040 comp rx=0 tx=0).stop 2023-07-11T00:01:03.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.863+0000 7ffb81f84700 1 -- 172.21.15.38:0/907944737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c14a800 msgr2=0x7ffb7c1455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:03.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.863+0000 7ffb81f84700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c14a800 0x7ffb7c1455e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400cb30 tx=0x7ffb7400ce40 comp rx=0 tx=0).stop 2023-07-11T00:01:03.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.867+0000 7ffb81f84700 1 -- 172.21.15.38:0/907944737 shutdown_connections 2023-07-11T00:01:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.867+0000 7ffb81f84700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ffb5c06ace0 0x7ffb5c06d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.867+0000 7ffb81f84700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c14a800 0x7ffb7c1455e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.867+0000 7ffb81f84700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb7c0b5a10 0x7ffb7c1e0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.867+0000 7ffb81f84700 1 --2- 172.21.15.38:0/907944737 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffb7c144820 0x7ffb7c1e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.867+0000 7ffb81f84700 1 -- 172.21.15.38:0/907944737 >> 172.21.15.38:0/907944737 conn(0x7ffb7c0c08f0 msgr2=0x7ffb7c0bbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.868+0000 7ffb81f84700 1 -- 172.21.15.38:0/907944737 shutdown_connections 2023-07-11T00:01:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:03.868+0000 7ffb81f84700 1 -- 172.21.15.38:0/907944737 wait complete. 2023-07-11T00:01:03.879 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 5 and data pool 6 2023-07-11T00:01:03.892 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:01:04.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.021+0000 7f64a0e74700 1 Processor -- start 2023-07-11T00:01:04.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.021+0000 7f64a0e74700 1 -- start start 2023-07-11T00:01:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.021+0000 7f64a0e74700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f649c1449d0 0x7f649c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f64a0e74700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f649c0bc810 0x7f649c0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f64a0e74700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649c0b8620 con 0x7f649c0b8d90 2023-07-11T00:01:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f64a0e74700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c0b97a0 con 0x7f649c0bc810 2023-07-11T00:01:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f64a0e74700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c144da0 con 0x7f649c1449d0 2023-07-11T00:01:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f6499d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f649c0bc810 0x7f649c0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f6499d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f649c0bc810 0x7f649c0ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59088/0 (socket says 172.21.15.38:59088) 2023-07-11T00:01:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f6499d9b700 1 -- 172.21.15.38:0/65800213 learned_addr learned my addr 172.21.15.38:0/65800213 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f649a59c700 1 --2- 172.21.15.38:0/65800213 >> v2:172.21.15.70:3300/0 conn(0x7f649c1449d0 0x7f649c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f6499d9b700 1 -- 172.21.15.38:0/65800213 >> v2:172.21.15.70:3300/0 conn(0x7f649c1449d0 msgr2=0x7f649c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f6499d9b700 1 --2- 172.21.15.38:0/65800213 >> v2:172.21.15.70:3300/0 conn(0x7f649c1449d0 0x7f649c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f6499d9b700 1 -- 172.21.15.38:0/65800213 >> v1:172.21.15.70:6789/0 conn(0x7f649c0b8d90 legacy=0x7f649c06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f6499d9b700 1 -- 172.21.15.38:0/65800213 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c0b8900 con 0x7f649c0bc810 2023-07-11T00:01:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f649a59c700 1 --2- 172.21.15.38:0/65800213 >> v2:172.21.15.70:3300/0 conn(0x7f649c1449d0 0x7f649c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:01:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f6499d9b700 1 --2- 172.21.15.38:0/65800213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f649c0bc810 0x7f649c0ba530 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f649c06cbe0 tx=0x7f6490009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685fb5c8a5b1d8c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f649959a700 1 -- 172.21.15.38:0/65800213 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490004230 con 0x7f649c0bc810 2023-07-11T00:01:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f649959a700 1 -- 172.21.15.38:0/65800213 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6490004390 con 0x7f649c0bc810 2023-07-11T00:01:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.022+0000 7f649959a700 1 -- 172.21.15.38:0/65800213 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900036a0 con 0x7f649c0bc810 2023-07-11T00:01:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.023+0000 7f64a0e74700 1 -- 172.21.15.38:0/65800213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f649c0bc810 msgr2=0x7f649c0ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.023+0000 7f64a0e74700 1 --2- 172.21.15.38:0/65800213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f649c0bc810 0x7f649c0ba530 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f649c06cbe0 tx=0x7f6490009bd0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.023+0000 7f64a0e74700 1 -- 172.21.15.38:0/65800213 shutdown_connections 2023-07-11T00:01:04.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.023+0000 7f64a0e74700 1 --2- 172.21.15.38:0/65800213 >> v2:172.21.15.70:3300/0 conn(0x7f649c1449d0 0x7f649c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.023+0000 7f64a0e74700 1 --2- 172.21.15.38:0/65800213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f649c0bc810 0x7f649c0ba530 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.023+0000 7f64a0e74700 1 -- 172.21.15.38:0/65800213 >> 172.21.15.38:0/65800213 conn(0x7f649c0c0860 msgr2=0x7f649c0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:04.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.023+0000 7f64a0e74700 1 -- 172.21.15.38:0/65800213 shutdown_connections 2023-07-11T00:01:04.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.023+0000 7f64a0e74700 1 -- 172.21.15.38:0/65800213 wait complete. 2023-07-11T00:01:04.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.024+0000 7f64a0e74700 1 Processor -- start 2023-07-11T00:01:04.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.024+0000 7f64a0e74700 1 -- start start 2023-07-11T00:01:04.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f64a0e74700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f649c0b8d90 0x7f649c1d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f64a0e74700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f649c0bc810 0x7f649c0b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f64a0e74700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1449d0 0x7f649c0b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f64a0e74700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c1d7250 con 0x7f649c0b8d90 2023-07-11T00:01:04.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f64a0e74700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c1e11b0 con 0x7f649c1449d0 2023-07-11T00:01:04.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f64a0e74700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649c0b4110 con 0x7f649c0bc810 2023-07-11T00:01:04.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f649a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f649c0b8d90 0x7f649c1d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f649a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f649c0b8d90 0x7f649c1d6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59094/0 (socket says 172.21.15.38:59094) 2023-07-11T00:01:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f649a59c700 1 -- 172.21.15.38:0/1215244470 learned_addr learned my addr 172.21.15.38:0/1215244470 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f6499d9b700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f649c0bc810 0x7f649c0b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f649ad9d700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1449d0 0x7f649c0b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f649a59c700 1 -- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f649c0bc810 msgr2=0x7f649c0b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f649a59c700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f649c0bc810 0x7f649c0b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f649a59c700 1 -- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1449d0 msgr2=0x7f649c0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f649a59c700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1449d0 0x7f649c0b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f649a59c700 1 -- 172.21.15.38:0/1215244470 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490009550 con 0x7f649c0b8d90 2023-07-11T00:01:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f649a59c700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f649c0b8d90 0x7f649c1d6d10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c7f0 tx=0x7f648c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.025+0000 7f648affd700 1 -- 172.21.15.38:0/1215244470 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c011800 con 0x7f649c0b8d90 2023-07-11T00:01:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.026+0000 7f648affd700 1 -- 172.21.15.38:0/1215244470 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c011960 con 0x7f649c0b8d90 2023-07-11T00:01:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.026+0000 7f64a0e74700 1 -- 172.21.15.38:0/1215244470 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649c0bb760 con 0x7f649c0b8d90 2023-07-11T00:01:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.026+0000 7f648affd700 1 -- 172.21.15.38:0/1215244470 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c011cf0 con 0x7f649c0b8d90 2023-07-11T00:01:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.026+0000 7f64a0e74700 1 -- 172.21.15.38:0/1215244470 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649c0b4650 con 0x7f649c0b8d90 2023-07-11T00:01:04.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.027+0000 7f64a0e74700 1 -- 172.21.15.38:0/1215244470 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649c0b4480 con 0x7f649c0b8d90 2023-07-11T00:01:04.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.027+0000 7f648affd700 1 -- 172.21.15.38:0/1215244470 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f648c018360 con 0x7f649c0b8d90 2023-07-11T00:01:04.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.027+0000 7f648affd700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f647c06ace0 0x7f647c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.028+0000 7f648affd700 1 -- 172.21.15.38:0/1215244470 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f648c089290 con 0x7f649c0b8d90 2023-07-11T00:01:04.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.028+0000 7f6499d9b700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f647c06ace0 0x7f647c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.028+0000 7f6499d9b700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f647c06ace0 0x7f647c06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6490009130 tx=0x7f6490008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:04.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.032+0000 7f648affd700 1 -- 172.21.15.38:0/1215244470 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f648c0543d0 con 0x7f649c0b8d90 2023-07-11T00:01:04.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.232+0000 7f64a0e74700 1 -- 172.21.15.38:0/1215244470 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f649c074360 con 0x7f649c0b8d90 2023-07-11T00:01:04.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.233+0000 7f648affd700 1 -- 172.21.15.38:0/1215244470 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18246 (secure 0 0 0) 0x7f648c0579f0 con 0x7f649c0b8d90 2023-07-11T00:01:04.235 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:01:04.235 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:01:03.266388+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:01:01.571071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-11T00:01:02.232591+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:01:04.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 -- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f647c06ace0 msgr2=0x7f647c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f647c06ace0 0x7f647c06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6490009130 tx=0x7f6490008030 comp rx=0 tx=0).stop 2023-07-11T00:01:04.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 -- 172.21.15.38:0/1215244470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f649c0b8d90 msgr2=0x7f649c1d6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f649c0b8d90 0x7f649c1d6d10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c7f0 tx=0x7f648c00cb00 comp rx=0 tx=0).stop 2023-07-11T00:01:04.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 -- 172.21.15.38:0/1215244470 shutdown_connections 2023-07-11T00:01:04.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f647c06ace0 0x7f647c06d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1449d0 0x7f649c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f649c0b8d90 0x7f649c1d6d10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 --2- 172.21.15.38:0/1215244470 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f649c0bc810 0x7f649c0b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 -- 172.21.15.38:0/1215244470 >> 172.21.15.38:0/1215244470 conn(0x7f649c0c0860 msgr2=0x7f649c143980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:04.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 -- 172.21.15.38:0/1215244470 shutdown_connections 2023-07-11T00:01:04.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.235+0000 7f64a0e74700 1 -- 172.21.15.38:0/1215244470 wait complete. 2023-07-11T00:01:04.249 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:01:04.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.373+0000 7f428f7f2700 1 Processor -- start 2023-07-11T00:01:04.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.374+0000 7f428f7f2700 1 -- start start 2023-07-11T00:01:04.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428f7f2700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4288147dc0 0x7f42880721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428f7f2700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4288069f30 0x7f4288071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428f7f2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f428806a380 0x7f4288071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428f7f2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4288070950 con 0x7f428806a380 2023-07-11T00:01:04.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428f7f2700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428806f680 con 0x7f4288069f30 2023-07-11T00:01:04.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428f7f2700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428806f920 con 0x7f4288147dc0 2023-07-11T00:01:04.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428dd8f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f428806a380 0x7f4288071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428dd8f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f428806a380 0x7f4288071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59100/0 (socket says 172.21.15.38:59100) 2023-07-11T00:01:04.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428dd8f700 1 -- 172.21.15.38:0/786534557 learned_addr learned my addr 172.21.15.38:0/786534557 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:04.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428d58e700 1 --2- 172.21.15.38:0/786534557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4288147dc0 0x7f42880721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428cd8d700 1 --2- 172.21.15.38:0/786534557 >> v2:172.21.15.70:3300/0 conn(0x7f4288069f30 0x7f4288071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428dd8f700 1 -- 172.21.15.38:0/786534557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4288147dc0 msgr2=0x7f42880721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:04.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428dd8f700 1 --2- 172.21.15.38:0/786534557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4288147dc0 0x7f42880721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428dd8f700 1 -- 172.21.15.38:0/786534557 >> v2:172.21.15.70:3300/0 conn(0x7f4288069f30 msgr2=0x7f4288071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:04.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428dd8f700 1 --2- 172.21.15.38:0/786534557 >> v2:172.21.15.70:3300/0 conn(0x7f4288069f30 0x7f4288071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428dd8f700 1 -- 172.21.15.38:0/786534557 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880b9660 con 0x7f428806a380 2023-07-11T00:01:04.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428d58e700 1 --2- 172.21.15.38:0/786534557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4288147dc0 0x7f42880721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:01:04.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.375+0000 7f428dd8f700 1 --2- 172.21.15.38:0/786534557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f428806a380 0x7f4288071670 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f428806c7b0 tx=0x7f4280009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b945118be6a4f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:04.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f427ffff700 1 -- 172.21.15.38:0/786534557 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428000b870 con 0x7f428806a380 2023-07-11T00:01:04.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f427ffff700 1 -- 172.21.15.38:0/786534557 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428000b9d0 con 0x7f428806a380 2023-07-11T00:01:04.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f427ffff700 1 -- 172.21.15.38:0/786534557 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428000bd60 con 0x7f428806a380 2023-07-11T00:01:04.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f428f7f2700 1 -- 172.21.15.38:0/786534557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f428806a380 msgr2=0x7f4288071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f428f7f2700 1 --2- 172.21.15.38:0/786534557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f428806a380 0x7f4288071670 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f428806c7b0 tx=0x7f4280009bd0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f428f7f2700 1 -- 172.21.15.38:0/786534557 shutdown_connections 2023-07-11T00:01:04.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f428f7f2700 1 --2- 172.21.15.38:0/786534557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f428806a380 0x7f4288071670 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f428f7f2700 1 --2- 172.21.15.38:0/786534557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4288147dc0 0x7f42880721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f428f7f2700 1 --2- 172.21.15.38:0/786534557 >> v2:172.21.15.70:3300/0 conn(0x7f4288069f30 0x7f4288071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f428f7f2700 1 -- 172.21.15.38:0/786534557 >> 172.21.15.38:0/786534557 conn(0x7f428806d0e0 msgr2=0x7f428806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:04.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f428f7f2700 1 -- 172.21.15.38:0/786534557 shutdown_connections 2023-07-11T00:01:04.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.376+0000 7f428f7f2700 1 -- 172.21.15.38:0/786534557 wait complete. 2023-07-11T00:01:04.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.377+0000 7f428f7f2700 1 Processor -- start 2023-07-11T00:01:04.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.377+0000 7f428f7f2700 1 -- start start 2023-07-11T00:01:04.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428f7f2700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4288069f30 0x7f42881407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428f7f2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f428806a380 0x7f428813f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428f7f2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4288147dc0 0x7f428813f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428f7f2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42881e05b0 con 0x7f4288147dc0 2023-07-11T00:01:04.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428f7f2700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880b5600 con 0x7f428806a380 2023-07-11T00:01:04.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428f7f2700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42880b5870 con 0x7f4288069f30 2023-07-11T00:01:04.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428dd8f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4288147dc0 0x7f428813f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428dd8f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4288147dc0 0x7f428813f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59104/0 (socket says 172.21.15.38:59104) 2023-07-11T00:01:04.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428dd8f700 1 -- 172.21.15.38:0/1152433232 learned_addr learned my addr 172.21.15.38:0/1152433232 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:04.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428cd8d700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f428806a380 0x7f428813f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428d58e700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4288069f30 0x7f42881407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428dd8f700 1 -- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4288069f30 msgr2=0x7f42881407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428dd8f700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4288069f30 0x7f42881407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428dd8f700 1 -- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f428806a380 msgr2=0x7f428813f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428dd8f700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f428806a380 0x7f428813f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.378+0000 7f428dd8f700 1 -- 172.21.15.38:0/1152433232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280009550 con 0x7f4288147dc0 2023-07-11T00:01:04.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.379+0000 7f428dd8f700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4288147dc0 0x7f428813f880 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4280009c10 tx=0x7f4280004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:04.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.379+0000 7f427dffb700 1 -- 172.21.15.38:0/1152433232 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280004480 con 0x7f4288147dc0 2023-07-11T00:01:04.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.379+0000 7f427dffb700 1 -- 172.21.15.38:0/1152433232 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42800045e0 con 0x7f4288147dc0 2023-07-11T00:01:04.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.379+0000 7f427dffb700 1 -- 172.21.15.38:0/1152433232 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42800038a0 con 0x7f4288147dc0 2023-07-11T00:01:04.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.379+0000 7f428f7f2700 1 -- 172.21.15.38:0/1152433232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42881dfc80 con 0x7f4288147dc0 2023-07-11T00:01:04.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.379+0000 7f428f7f2700 1 -- 172.21.15.38:0/1152433232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42881e0240 con 0x7f4288147dc0 2023-07-11T00:01:04.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.380+0000 7f428f7f2700 1 -- 172.21.15.38:0/1152433232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42881e0760 con 0x7f4288147dc0 2023-07-11T00:01:04.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.381+0000 7f427dffb700 1 -- 172.21.15.38:0/1152433232 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4280021070 con 0x7f4288147dc0 2023-07-11T00:01:04.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.381+0000 7f427dffb700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426c06ace0 0x7f426c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.381+0000 7f427dffb700 1 -- 172.21.15.38:0/1152433232 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f428008a880 con 0x7f4288147dc0 2023-07-11T00:01:04.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.381+0000 7f428d58e700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426c06ace0 0x7f426c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.382+0000 7f428d58e700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426c06ace0 0x7f426c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4284009fd0 tx=0x7f42840097f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:04.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.385+0000 7f427dffb700 1 -- 172.21.15.38:0/1152433232 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f42800559a0 con 0x7f4288147dc0 2023-07-11T00:01:04.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.583+0000 7f428f7f2700 1 -- 172.21.15.38:0/1152433232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42881e0760 con 0x7f4288147dc0 2023-07-11T00:01:04.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.584+0000 7f427dffb700 1 -- 172.21.15.38:0/1152433232 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18246 (secure 0 0 0) 0x7f42881e0760 con 0x7f4288147dc0 2023-07-11T00:01:04.586 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:01:04.586 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:01:03.266388+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:01:01.571071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-11T00:01:02.232591+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:01:04.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 -- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426c06ace0 msgr2=0x7f426c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426c06ace0 0x7f426c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4284009fd0 tx=0x7f42840097f0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 -- 172.21.15.38:0/1152433232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4288147dc0 msgr2=0x7f428813f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4288147dc0 0x7f428813f880 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4280009c10 tx=0x7f4280004750 comp rx=0 tx=0).stop 2023-07-11T00:01:04.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 -- 172.21.15.38:0/1152433232 shutdown_connections 2023-07-11T00:01:04.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f426c06ace0 0x7f426c06d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4288147dc0 0x7f428813f880 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4288069f30 0x7f42881407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 --2- 172.21.15.38:0/1152433232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f428806a380 0x7f428813f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 -- 172.21.15.38:0/1152433232 >> 172.21.15.38:0/1152433232 conn(0x7f428806d0e0 msgr2=0x7f42880ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:04.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 -- 172.21.15.38:0/1152433232 shutdown_connections 2023-07-11T00:01:04.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.586+0000 7f428f7f2700 1 -- 172.21.15.38:0/1152433232 wait complete. 2023-07-11T00:01:04.600 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-11T00:01:04.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.727+0000 7f0837694700 1 Processor -- start 2023-07-11T00:01:04.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.727+0000 7f0837694700 1 -- start start 2023-07-11T00:01:04.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.728+0000 7f0837694700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f083006b120 0x7f08300b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.728+0000 7f0837694700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f083014f320 0x7f0830070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.728+0000 7f0837694700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0830071380 0x7f08301520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.728+0000 7f0837694700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083006ef40 con 0x7f083014f320 2023-07-11T00:01:04.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.728+0000 7f0837694700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083006f220 con 0x7f083006b120 2023-07-11T00:01:04.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.728+0000 7f0837694700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0830070300 con 0x7f0830071380 2023-07-11T00:01:04.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0834c2f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f083014f320 0x7f0830070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0834c2f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f083014f320 0x7f0830070e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59112/0 (socket says 172.21.15.38:59112) 2023-07-11T00:01:04.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0834c2f700 1 -- 172.21.15.38:0/2504605538 learned_addr learned my addr 172.21.15.38:0/2504605538 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:04.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0835c31700 1 --2- 172.21.15.38:0/2504605538 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0830071380 0x7f08301520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0835430700 1 --2- 172.21.15.38:0/2504605538 >> v2:172.21.15.70:3300/0 conn(0x7f083006b120 0x7f08300b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0834c2f700 1 -- 172.21.15.38:0/2504605538 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0830071380 msgr2=0x7f08301520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:04.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0834c2f700 1 --2- 172.21.15.38:0/2504605538 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0830071380 0x7f08301520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0834c2f700 1 -- 172.21.15.38:0/2504605538 >> v2:172.21.15.70:3300/0 conn(0x7f083006b120 msgr2=0x7f08300b9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:04.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0834c2f700 1 --2- 172.21.15.38:0/2504605538 >> v2:172.21.15.70:3300/0 conn(0x7f083006b120 0x7f08300b9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0834c2f700 1 -- 172.21.15.38:0/2504605538 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083014eb50 con 0x7f083014f320 2023-07-11T00:01:04.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0835c31700 1 --2- 172.21.15.38:0/2504605538 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0830071380 0x7f08301520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:01:04.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0834c2f700 1 --2- 172.21.15.38:0/2504605538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083014f320 0x7f0830070e40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f083006b860 tx=0x7f0820009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a26bed28302136 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:04.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0827fff700 1 -- 172.21.15.38:0/2504605538 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082000b870 con 0x7f083014f320 2023-07-11T00:01:04.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0827fff700 1 -- 172.21.15.38:0/2504605538 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082000b9d0 con 0x7f083014f320 2023-07-11T00:01:04.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.729+0000 7f0827fff700 1 -- 172.21.15.38:0/2504605538 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082000bd60 con 0x7f083014f320 2023-07-11T00:01:04.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.730+0000 7f0837694700 1 -- 172.21.15.38:0/2504605538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083014f320 msgr2=0x7f0830070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.730+0000 7f0837694700 1 --2- 172.21.15.38:0/2504605538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083014f320 0x7f0830070e40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f083006b860 tx=0x7f0820009bd0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.730+0000 7f0837694700 1 -- 172.21.15.38:0/2504605538 shutdown_connections 2023-07-11T00:01:04.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.730+0000 7f0837694700 1 --2- 172.21.15.38:0/2504605538 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0830071380 0x7f08301520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.730+0000 7f0837694700 1 --2- 172.21.15.38:0/2504605538 >> v2:172.21.15.70:3300/0 conn(0x7f083006b120 0x7f08300b9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.730+0000 7f0837694700 1 --2- 172.21.15.38:0/2504605538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083014f320 0x7f0830070e40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.730+0000 7f0837694700 1 -- 172.21.15.38:0/2504605538 >> 172.21.15.38:0/2504605538 conn(0x7f08300bd980 msgr2=0x7f08300b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:04.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.730+0000 7f0837694700 1 -- 172.21.15.38:0/2504605538 shutdown_connections 2023-07-11T00:01:04.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.730+0000 7f0837694700 1 -- 172.21.15.38:0/2504605538 wait complete. 2023-07-11T00:01:04.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.731+0000 7f0837694700 1 Processor -- start 2023-07-11T00:01:04.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.731+0000 7f0837694700 1 -- start start 2023-07-11T00:01:04.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0837694700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083006b120 0x7f08300b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0837694700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0830071380 0x7f0830148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0837694700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f083014f320 0x7f08301e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0837694700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08300b3420 con 0x7f083006b120 2023-07-11T00:01:04.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0837694700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083014b240 con 0x7f083014f320 2023-07-11T00:01:04.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0837694700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083014ceb0 con 0x7f0830071380 2023-07-11T00:01:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0835430700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083006b120 0x7f08300b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0835430700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083006b120 0x7f08300b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59116/0 (socket says 172.21.15.38:59116) 2023-07-11T00:01:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0835430700 1 -- 172.21.15.38:0/4152116742 learned_addr learned my addr 172.21.15.38:0/4152116742 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0834c2f700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0830071380 0x7f0830148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0835c31700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f083014f320 0x7f08301e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0835430700 1 -- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0830071380 msgr2=0x7f0830148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0835430700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0830071380 0x7f0830148520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0835430700 1 -- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f083014f320 msgr2=0x7f08301e41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:04.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0835430700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f083014f320 0x7f08301e41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:04.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0835430700 1 -- 172.21.15.38:0/4152116742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820009550 con 0x7f083006b120 2023-07-11T00:01:04.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0835430700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083006b120 0x7f08300b2ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f082c00e810 tx=0x7f082c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:04.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0825ffb700 1 -- 172.21.15.38:0/4152116742 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c00c070 con 0x7f083006b120 2023-07-11T00:01:04.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0825ffb700 1 -- 172.21.15.38:0/4152116742 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c013610 con 0x7f083006b120 2023-07-11T00:01:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0825ffb700 1 -- 172.21.15.38:0/4152116742 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c0139a0 con 0x7f083006b120 2023-07-11T00:01:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.732+0000 7f0837694700 1 -- 172.21.15.38:0/4152116742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083014b490 con 0x7f083006b120 2023-07-11T00:01:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.733+0000 7f0837694700 1 -- 172.21.15.38:0/4152116742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083014ba50 con 0x7f083006b120 2023-07-11T00:01:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.734+0000 7f0837694700 1 -- 172.21.15.38:0/4152116742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0830074360 con 0x7f083006b120 2023-07-11T00:01:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.734+0000 7f0825ffb700 1 -- 172.21.15.38:0/4152116742 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f082c013b00 con 0x7f083006b120 2023-07-11T00:01:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.734+0000 7f0825ffb700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f081406ace0 0x7f081406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.735+0000 7f0825ffb700 1 -- 172.21.15.38:0/4152116742 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f082c0890c0 con 0x7f083006b120 2023-07-11T00:01:04.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.735+0000 7f0834c2f700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f081406ace0 0x7f081406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:04.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.735+0000 7f0834c2f700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f081406ace0 0x7f081406d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0820014040 tx=0x7f0820008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:04.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.739+0000 7f0825ffb700 1 -- 172.21.15.38:0/4152116742 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f082c054200 con 0x7f083006b120 2023-07-11T00:01:04.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:04.983+0000 7f0837694700 1 -- 172.21.15.38:0/4152116742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f08300b9450 con 0x7f083006b120 2023-07-11T00:01:05.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.878+0000 7f0825ffb700 1 -- 172.21.15.38:0/4152116742 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f082c009440 con 0x7f083006b120 2023-07-11T00:01:05.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 -- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f081406ace0 msgr2=0x7f081406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:05.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f081406ace0 0x7f081406d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0820014040 tx=0x7f0820008030 comp rx=0 tx=0).stop 2023-07-11T00:01:05.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 -- 172.21.15.38:0/4152116742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083006b120 msgr2=0x7f08300b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:05.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083006b120 0x7f08300b2ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f082c00e810 tx=0x7f082c00eb20 comp rx=0 tx=0).stop 2023-07-11T00:01:05.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 -- 172.21.15.38:0/4152116742 shutdown_connections 2023-07-11T00:01:05.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f081406ace0 0x7f081406d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:05.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f083014f320 0x7f08301e41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:05.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083006b120 0x7f08300b2ee0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:05.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 --2- 172.21.15.38:0/4152116742 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0830071380 0x7f0830148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:05.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 -- 172.21.15.38:0/4152116742 >> 172.21.15.38:0/4152116742 conn(0x7f08300bd980 msgr2=0x7f08301d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:05.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 -- 172.21.15.38:0/4152116742 shutdown_connections 2023-07-11T00:01:05.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:05.881+0000 7f0837694700 1 -- 172.21.15.38:0/4152116742 wait complete. 2023-07-11T00:01:05.897 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-11T00:01:05.898 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-11T00:01:06.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.032+0000 7f8b96641700 1 Processor -- start 2023-07-11T00:01:06.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.032+0000 7f8b96641700 1 -- start start 2023-07-11T00:01:06.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.033+0000 7f8b96641700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8b9006abb0 0x7f8b9014a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:06.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.033+0000 7f8b96641700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b90141090 0x7f8b901414d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:06.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.033+0000 7f8b96641700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b90141a10 con 0x7f8b900b88b0 2023-07-11T00:01:06.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.033+0000 7f8b96641700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9014adf0 con 0x7f8b9006abb0 2023-07-11T00:01:06.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.033+0000 7f8b96641700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9006c160 con 0x7f8b90141090 2023-07-11T00:01:06.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.033+0000 7f8b8f7fe700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8b9006abb0 0x7f8b9014a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:06.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.033+0000 7f8b94bde700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b90141090 0x7f8b901414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:06.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.033+0000 7f8b8ffff700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f8b900b88b0 0x7f8b9006b8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:42214/0 (socket says 172.21.15.38:42214) 2023-07-11T00:01:06.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.033+0000 7f8b8ffff700 1 -- 172.21.15.38:0/4140372114 learned_addr learned my addr 172.21.15.38:0/4140372114 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:01:06.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.034+0000 7f8b94bde700 1 -- 172.21.15.38:0/4140372114 >> v2:172.21.15.70:3300/0 conn(0x7f8b9006abb0 msgr2=0x7f8b9014a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:06.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.034+0000 7f8b94bde700 1 --2- 172.21.15.38:0/4140372114 >> v2:172.21.15.70:3300/0 conn(0x7f8b9006abb0 0x7f8b9014a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:06.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.034+0000 7f8b94bde700 1 -- 172.21.15.38:0/4140372114 >> v1:172.21.15.70:6789/0 conn(0x7f8b900b88b0 legacy=0x7f8b9006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:06.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.034+0000 7f8b94bde700 1 -- 172.21.15.38:0/4140372114 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9006a0d0 con 0x7f8b90141090 2023-07-11T00:01:06.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.034+0000 7f8b94bde700 1 --2- 172.21.15.38:0/4140372114 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b90141090 0x7f8b901414d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009d90 tx=0x7f8b8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c41f9110d86629c server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:06.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.034+0000 7f8b8effd700 1 -- 172.21.15.38:0/4140372114 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800e070 con 0x7f8b90141090 2023-07-11T00:01:06.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.034+0000 7f8b8effd700 1 -- 172.21.15.38:0/4140372114 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8800bb20 con 0x7f8b90141090 2023-07-11T00:01:06.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.034+0000 7f8b8effd700 1 -- 172.21.15.38:0/4140372114 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88012430 con 0x7f8b90141090 2023-07-11T00:01:06.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.034+0000 7f8b96641700 1 -- 172.21.15.38:0/4140372114 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b90141090 msgr2=0x7f8b901414d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:06.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.035+0000 7f8b96641700 1 --2- 172.21.15.38:0/4140372114 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b90141090 0x7f8b901414d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009d90 tx=0x7f8b8800b330 comp rx=0 tx=0).stop 2023-07-11T00:01:06.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.035+0000 7f8b96641700 1 -- 172.21.15.38:0/4140372114 shutdown_connections 2023-07-11T00:01:06.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.035+0000 7f8b96641700 1 --2- 172.21.15.38:0/4140372114 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b90141090 0x7f8b901414d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:06.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.035+0000 7f8b96641700 1 --2- 172.21.15.38:0/4140372114 >> v2:172.21.15.70:3300/0 conn(0x7f8b9006abb0 0x7f8b9014a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:06.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.035+0000 7f8b96641700 1 -- 172.21.15.38:0/4140372114 >> 172.21.15.38:0/4140372114 conn(0x7f8b900b97c0 msgr2=0x7f8b900b9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:06.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.035+0000 7f8b96641700 1 -- 172.21.15.38:0/4140372114 shutdown_connections 2023-07-11T00:01:06.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.035+0000 7f8b96641700 1 -- 172.21.15.38:0/4140372114 wait complete. 2023-07-11T00:01:06.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.036+0000 7f8b96641700 1 Processor -- start 2023-07-11T00:01:06.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.036+0000 7f8b96641700 1 -- start start 2023-07-11T00:01:06.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.036+0000 7f8b96641700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b9006abb0 0x7f8b901d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:06.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.036+0000 7f8b96641700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b900b88b0 0x7f8b900b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:06.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.036+0000 7f8b96641700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b90141090 0x7f8b901e0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:06.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.036+0000 7f8b96641700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b901d0b20 con 0x7f8b9006abb0 2023-07-11T00:01:06.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.036+0000 7f8b96641700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900b6330 con 0x7f8b90141090 2023-07-11T00:01:06.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.036+0000 7f8b96641700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b90071510 con 0x7f8b900b88b0 2023-07-11T00:01:06.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b9006abb0 0x7f8b901d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:06.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b9006abb0 0x7f8b901d05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59132/0 (socket says 172.21.15.38:59132) 2023-07-11T00:01:06.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8ffff700 1 -- 172.21.15.38:0/2446063292 learned_addr learned my addr 172.21.15.38:0/2446063292 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:06.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8f7fe700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b900b88b0 0x7f8b900b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:06.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b94bde700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b90141090 0x7f8b901e0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:06.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8ffff700 1 -- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b900b88b0 msgr2=0x7f8b900b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:06.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8ffff700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b900b88b0 0x7f8b900b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:06.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8ffff700 1 -- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b90141090 msgr2=0x7f8b901e0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:06.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8ffff700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b90141090 0x7f8b901e0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:06.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8ffff700 1 -- 172.21.15.38:0/2446063292 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b88009a70 con 0x7f8b9006abb0 2023-07-11T00:01:06.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b94bde700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b90141090 0x7f8b901e0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:01:06.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8ffff700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b9006abb0 0x7f8b901d05e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c520 tx=0x7f8b8000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:06.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8cff9700 1 -- 172.21.15.38:0/2446063292 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80005d70 con 0x7f8b9006abb0 2023-07-11T00:01:06.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8cff9700 1 -- 172.21.15.38:0/2446063292 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b800070d0 con 0x7f8b9006abb0 2023-07-11T00:01:06.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b96641700 1 -- 172.21.15.38:0/2446063292 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b90070ec0 con 0x7f8b9006abb0 2023-07-11T00:01:06.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b8cff9700 1 -- 172.21.15.38:0/2446063292 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80007440 con 0x7f8b9006abb0 2023-07-11T00:01:06.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.037+0000 7f8b96641700 1 -- 172.21.15.38:0/2446063292 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b90147eb0 con 0x7f8b9006abb0 2023-07-11T00:01:06.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.038+0000 7f8b96641700 1 -- 172.21.15.38:0/2446063292 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b90148040 con 0x7f8b9006abb0 2023-07-11T00:01:06.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.039+0000 7f8b8cff9700 1 -- 172.21.15.38:0/2446063292 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b800075a0 con 0x7f8b9006abb0 2023-07-11T00:01:06.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.039+0000 7f8b8cff9700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8b7c06ace0 0x7f8b7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:06.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.039+0000 7f8b8cff9700 1 -- 172.21.15.38:0/2446063292 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b8008ade0 con 0x7f8b9006abb0 2023-07-11T00:01:06.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.039+0000 7f8b8f7fe700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8b7c06ace0 0x7f8b7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:06.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.040+0000 7f8b8f7fe700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8b7c06ace0 0x7f8b7c06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8b901ddd20 tx=0x7f8b84009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:06.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.044+0000 7f8b8cff9700 1 -- 172.21.15.38:0/2446063292 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8b80055e90 con 0x7f8b9006abb0 2023-07-11T00:01:06.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.288+0000 7f8b96641700 1 -- 172.21.15.38:0/2446063292 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8b90141a10 con 0x7f8b9006abb0 2023-07-11T00:01:06.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.887+0000 7f8b8cff9700 1 -- 172.21.15.38:0/2446063292 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8b90141a10 con 0x7f8b9006abb0 2023-07-11T00:01:06.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.889+0000 7f8b96641700 1 -- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8b7c06ace0 msgr2=0x7f8b7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:06.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.889+0000 7f8b96641700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8b7c06ace0 0x7f8b7c06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8b901ddd20 tx=0x7f8b84009210 comp rx=0 tx=0).stop 2023-07-11T00:01:06.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.889+0000 7f8b96641700 1 -- 172.21.15.38:0/2446063292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b9006abb0 msgr2=0x7f8b901d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:06.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.889+0000 7f8b96641700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b9006abb0 0x7f8b901d05e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c520 tx=0x7f8b8000c830 comp rx=0 tx=0).stop 2023-07-11T00:01:06.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.889+0000 7f8b96641700 1 -- 172.21.15.38:0/2446063292 shutdown_connections 2023-07-11T00:01:06.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.889+0000 7f8b96641700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f8b7c06ace0 0x7f8b7c06d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:06.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.889+0000 7f8b96641700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b90141090 0x7f8b901e0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:06.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.889+0000 7f8b96641700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b9006abb0 0x7f8b901d05e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:06.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.889+0000 7f8b96641700 1 --2- 172.21.15.38:0/2446063292 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b900b88b0 0x7f8b900b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:06.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.889+0000 7f8b96641700 1 -- 172.21.15.38:0/2446063292 >> 172.21.15.38:0/2446063292 conn(0x7f8b900b97c0 msgr2=0x7f8b900bab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:06.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.890+0000 7f8b96641700 1 -- 172.21.15.38:0/2446063292 shutdown_connections 2023-07-11T00:01:06.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:06.890+0000 7f8b96641700 1 -- 172.21.15.38:0/2446063292 wait complete. 2023-07-11T00:01:06.905 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-11T00:01:06.905 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:01:07.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.033+0000 7fc6b5760700 1 Processor -- start 2023-07-11T00:01:07.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.033+0000 7fc6b5760700 1 -- start start 2023-07-11T00:01:07.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6b5760700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc6b0144820 0x7fc6b00b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6b5760700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6b00b5a10 0x7fc6b00b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6b5760700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc6b014a800 0x7fc6b014ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6b5760700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b014b1c0 con 0x7fc6b014a800 2023-07-11T00:01:07.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6b5760700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b00b5f00 con 0x7fc6b0144820 2023-07-11T00:01:07.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6b5760700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00b61e0 con 0x7fc6b00b5a10 2023-07-11T00:01:07.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6af7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc6b014a800 0x7fc6b014ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6af7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc6b014a800 0x7fc6b014ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59138/0 (socket says 172.21.15.38:59138) 2023-07-11T00:01:07.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6af7fe700 1 -- 172.21.15.38:0/2861110907 learned_addr learned my addr 172.21.15.38:0/2861110907 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:07.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6ae7fc700 1 --2- 172.21.15.38:0/2861110907 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6b00b5a10 0x7fc6b00b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6aeffd700 1 --2- 172.21.15.38:0/2861110907 >> v2:172.21.15.70:3300/0 conn(0x7fc6b0144820 0x7fc6b00b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6af7fe700 1 -- 172.21.15.38:0/2861110907 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6b00b5a10 msgr2=0x7fc6b00b6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:07.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6af7fe700 1 --2- 172.21.15.38:0/2861110907 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6b00b5a10 0x7fc6b00b6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6af7fe700 1 -- 172.21.15.38:0/2861110907 >> v2:172.21.15.70:3300/0 conn(0x7fc6b0144820 msgr2=0x7fc6b00b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:07.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6af7fe700 1 --2- 172.21.15.38:0/2861110907 >> v2:172.21.15.70:3300/0 conn(0x7fc6b0144820 0x7fc6b00b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6af7fe700 1 -- 172.21.15.38:0/2861110907 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b00c17d0 con 0x7fc6b014a800 2023-07-11T00:01:07.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.034+0000 7fc6aeffd700 1 --2- 172.21.15.38:0/2861110907 >> v2:172.21.15.70:3300/0 conn(0x7fc6b0144820 0x7fc6b00b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:01:07.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6af7fe700 1 --2- 172.21.15.38:0/2861110907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6b014a800 0x7fc6b014ac80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0067500 tx=0x7fc6a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213b0ae751a60128 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:07.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6adffb700 1 -- 172.21.15.38:0/2861110907 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800e070 con 0x7fc6b014a800 2023-07-11T00:01:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6adffb700 1 -- 172.21.15.38:0/2861110907 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a800b910 con 0x7fc6b014a800 2023-07-11T00:01:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6adffb700 1 -- 172.21.15.38:0/2861110907 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800bcc0 con 0x7fc6b014a800 2023-07-11T00:01:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6b5760700 1 -- 172.21.15.38:0/2861110907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6b014a800 msgr2=0x7fc6b014ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6b5760700 1 --2- 172.21.15.38:0/2861110907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6b014a800 0x7fc6b014ac80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0067500 tx=0x7fc6a800b330 comp rx=0 tx=0).stop 2023-07-11T00:01:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6b5760700 1 -- 172.21.15.38:0/2861110907 shutdown_connections 2023-07-11T00:01:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6b5760700 1 --2- 172.21.15.38:0/2861110907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6b014a800 0x7fc6b014ac80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6b5760700 1 --2- 172.21.15.38:0/2861110907 >> v2:172.21.15.70:3300/0 conn(0x7fc6b0144820 0x7fc6b00b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6b5760700 1 --2- 172.21.15.38:0/2861110907 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6b00b5a10 0x7fc6b00b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6b5760700 1 -- 172.21.15.38:0/2861110907 >> 172.21.15.38:0/2861110907 conn(0x7fc6b00c08f0 msgr2=0x7fc6b00c0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:07.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6b5760700 1 -- 172.21.15.38:0/2861110907 shutdown_connections 2023-07-11T00:01:07.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.035+0000 7fc6b5760700 1 -- 172.21.15.38:0/2861110907 wait complete. 2023-07-11T00:01:07.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.036+0000 7fc6b5760700 1 Processor -- start 2023-07-11T00:01:07.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6b5760700 1 -- start start 2023-07-11T00:01:07.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6b5760700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6b00b5a10 0x7fc6b01d64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6b5760700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6b0144820 0x7fc6b0148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6b5760700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6b014a800 0x7fc6b00b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6b5760700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0148410 con 0x7fc6b014a800 2023-07-11T00:01:07.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6b5760700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0149f70 con 0x7fc6b0144820 2023-07-11T00:01:07.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6b5760700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b014a250 con 0x7fc6b00b5a10 2023-07-11T00:01:07.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6af7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6b014a800 0x7fc6b00b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6af7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6b014a800 0x7fc6b00b9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59148/0 (socket says 172.21.15.38:59148) 2023-07-11T00:01:07.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6af7fe700 1 -- 172.21.15.38:0/447209397 learned_addr learned my addr 172.21.15.38:0/447209397 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:07.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6aeffd700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6b00b5a10 0x7fc6b01d64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.037+0000 7fc6ae7fc700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6b0144820 0x7fc6b0148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6af7fe700 1 -- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6b00b5a10 msgr2=0x7fc6b01d64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6af7fe700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6b00b5a10 0x7fc6b01d64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6af7fe700 1 -- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6b0144820 msgr2=0x7fc6b0148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6af7fe700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6b0144820 0x7fc6b0148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6af7fe700 1 -- 172.21.15.38:0/447209397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8009b30 con 0x7fc6b014a800 2023-07-11T00:01:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6ae7fc700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6b0144820 0x7fc6b0148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:01:07.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6af7fe700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6b014a800 0x7fc6b00b9c70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0073f10 tx=0x7fc6a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:07.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6977fe700 1 -- 172.21.15.38:0/447209397 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80099b0 con 0x7fc6b014a800 2023-07-11T00:01:07.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6977fe700 1 -- 172.21.15.38:0/447209397 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a80092e0 con 0x7fc6b014a800 2023-07-11T00:01:07.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6977fe700 1 -- 172.21.15.38:0/447209397 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8004470 con 0x7fc6b014a800 2023-07-11T00:01:07.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6b5760700 1 -- 172.21.15.38:0/447209397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b0148660 con 0x7fc6b014a800 2023-07-11T00:01:07.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.038+0000 7fc6b5760700 1 -- 172.21.15.38:0/447209397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b01d6a10 con 0x7fc6b014a800 2023-07-11T00:01:07.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.039+0000 7fc6b5760700 1 -- 172.21.15.38:0/447209397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b01488a0 con 0x7fc6b014a800 2023-07-11T00:01:07.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.039+0000 7fc6977fe700 1 -- 172.21.15.38:0/447209397 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6a80045d0 con 0x7fc6b014a800 2023-07-11T00:01:07.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.040+0000 7fc6977fe700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc69c06ace0 0x7fc69c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.040+0000 7fc6977fe700 1 -- 172.21.15.38:0/447209397 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6a808a850 con 0x7fc6b014a800 2023-07-11T00:01:07.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.040+0000 7fc6aeffd700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc69c06ace0 0x7fc69c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.041+0000 7fc6aeffd700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc69c06ace0 0x7fc69c06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00099d0 tx=0x7fc6a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:07.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.044+0000 7fc6977fe700 1 -- 172.21.15.38:0/447209397 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc6a80593a0 con 0x7fc6b014a800 2023-07-11T00:01:07.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.285+0000 7fc6b5760700 1 -- 172.21.15.38:0/447209397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6b00b8090 con 0x7fc6b014a800 2023-07-11T00:01:07.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.286+0000 7fc6977fe700 1 -- 172.21.15.38:0/447209397 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3914 (secure 0 0 0) 0x7fc6a8058f30 con 0x7fc6b014a800 2023-07-11T00:01:07.288 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:01:07.288 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3230958485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3230958485},{"type":"v1","addr":"172.21.15.70:6835","nonce":3230958485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2068482801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2068482801},{"type":"v1","addr":"172.21.15.38:6835","nonce":2068482801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:01:03.266349+0000","modified":"2023-07-11T00:01:06.289683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.38:6834/2519374117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2519374117},{"type":"v1","addr":"172.21.15.38:6834","nonce":2519374117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-11T00:01:07.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 -- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc69c06ace0 msgr2=0x7fc69c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc69c06ace0 0x7fc69c06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00099d0 tx=0x7fc6a0008040 comp rx=0 tx=0).stop 2023-07-11T00:01:07.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 -- 172.21.15.38:0/447209397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6b014a800 msgr2=0x7fc6b00b9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6b014a800 0x7fc6b00b9c70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0073f10 tx=0x7fc6a8004ad0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 -- 172.21.15.38:0/447209397 shutdown_connections 2023-07-11T00:01:07.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc69c06ace0 0x7fc69c06d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6b014a800 0x7fc6b00b9c70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6b00b5a10 0x7fc6b01d64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 --2- 172.21.15.38:0/447209397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6b0144820 0x7fc6b0148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 -- 172.21.15.38:0/447209397 >> 172.21.15.38:0/447209397 conn(0x7fc6b00c08f0 msgr2=0x7fc6b00bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:07.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 -- 172.21.15.38:0/447209397 shutdown_connections 2023-07-11T00:01:07.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.288+0000 7fc6b5760700 1 -- 172.21.15.38:0/447209397 wait complete. 2023-07-11T00:01:07.292 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 16 2023-07-11T00:01:07.302 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:01:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.426+0000 7f0c01d07700 1 Processor -- start 2023-07-11T00:01:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.426+0000 7f0c01d07700 1 -- start start 2023-07-11T00:01:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.427+0000 7f0c01d07700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0bfc147c00 0x7f0bfc0b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.427+0000 7f0c01d07700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bfc071b60 0x7f0bfc0b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.427+0000 7f0c01d07700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bfc0b3bd0 con 0x7f0bfc06b120 2023-07-11T00:01:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.427+0000 7f0c01d07700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc070800 con 0x7f0bfc147c00 2023-07-11T00:01:07.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.427+0000 7f0c01d07700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc141c90 con 0x7f0bfc071b60 2023-07-11T00:01:07.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bf3fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0bfc147c00 0x7f0bfc0b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bf3fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0bfc147c00 0x7f0bfc0b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59150/0 (socket says 172.21.15.38:59150) 2023-07-11T00:01:07.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bf3fff700 1 -- 172.21.15.38:0/3744525257 learned_addr learned my addr 172.21.15.38:0/3744525257 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:07.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bfbfff700 1 --2- 172.21.15.38:0/3744525257 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bfc071b60 0x7f0bfc0b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bf3fff700 1 -- 172.21.15.38:0/3744525257 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bfc071b60 msgr2=0x7f0bfc0b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:07.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bf3fff700 1 --2- 172.21.15.38:0/3744525257 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bfc071b60 0x7f0bfc0b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bf3fff700 1 -- 172.21.15.38:0/3744525257 >> v1:172.21.15.70:6789/0 conn(0x7f0bfc06b120 legacy=0x7f0bfc1474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bf3fff700 1 -- 172.21.15.38:0/3744525257 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc0714d0 con 0x7f0bfc147c00 2023-07-11T00:01:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bf3fff700 1 --2- 172.21.15.38:0/3744525257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0bfc147c00 0x7f0bfc0b6430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0be40098f0 tx=0x7f0be4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d17866cb2a8d4a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bfaffd700 1 -- 172.21.15.38:0/3744525257 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4011830 con 0x7f0bfc147c00 2023-07-11T00:01:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bfaffd700 1 -- 172.21.15.38:0/3744525257 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4011990 con 0x7f0bfc147c00 2023-07-11T00:01:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.428+0000 7f0bfaffd700 1 -- 172.21.15.38:0/3744525257 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4011d20 con 0x7f0bfc147c00 2023-07-11T00:01:07.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.429+0000 7f0c01d07700 1 -- 172.21.15.38:0/3744525257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0bfc147c00 msgr2=0x7f0bfc0b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.429+0000 7f0c01d07700 1 --2- 172.21.15.38:0/3744525257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0bfc147c00 0x7f0bfc0b6430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0be40098f0 tx=0x7f0be4009c00 comp rx=0 tx=0).stop 2023-07-11T00:01:07.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.429+0000 7f0c01d07700 1 -- 172.21.15.38:0/3744525257 shutdown_connections 2023-07-11T00:01:07.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.429+0000 7f0c01d07700 1 --2- 172.21.15.38:0/3744525257 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bfc071b60 0x7f0bfc0b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.429+0000 7f0c01d07700 1 --2- 172.21.15.38:0/3744525257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0bfc147c00 0x7f0bfc0b6430 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.429+0000 7f0c01d07700 1 -- 172.21.15.38:0/3744525257 >> 172.21.15.38:0/3744525257 conn(0x7f0bfc0bd980 msgr2=0x7f0bfc0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:07.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.429+0000 7f0c01d07700 1 -- 172.21.15.38:0/3744525257 shutdown_connections 2023-07-11T00:01:07.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.429+0000 7f0c01d07700 1 -- 172.21.15.38:0/3744525257 wait complete. 2023-07-11T00:01:07.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.430+0000 7f0c01d07700 1 Processor -- start 2023-07-11T00:01:07.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.430+0000 7f0c01d07700 1 -- start start 2023-07-11T00:01:07.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0c01d07700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0bfc06b120 0x7f0bfc143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0c01d07700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bfc071b60 0x7f0bfc0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0c01d07700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bfc147c00 0x7f0bfc0b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0c01d07700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc1e37f0 con 0x7f0bfc06b120 2023-07-11T00:01:07.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0c01d07700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc148a90 con 0x7f0bfc071b60 2023-07-11T00:01:07.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0c01d07700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc1e2e50 con 0x7f0bfc147c00 2023-07-11T00:01:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bfb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0bfc06b120 0x7f0bfc143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bfb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0bfc06b120 0x7f0bfc143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59154/0 (socket says 172.21.15.38:59154) 2023-07-11T00:01:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bfb7fe700 1 -- 172.21.15.38:0/145400040 learned_addr learned my addr 172.21.15.38:0/145400040 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bfbfff700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bfc147c00 0x7f0bfc0b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bf3fff700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bfc071b60 0x7f0bfc0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bfb7fe700 1 -- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bfc147c00 msgr2=0x7f0bfc0b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bfb7fe700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bfc147c00 0x7f0bfc0b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bfb7fe700 1 -- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bfc071b60 msgr2=0x7f0bfc0b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bfb7fe700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bfc071b60 0x7f0bfc0b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bfb7fe700 1 -- 172.21.15.38:0/145400040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4009550 con 0x7f0bfc06b120 2023-07-11T00:01:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bf3fff700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bfc071b60 0x7f0bfc0b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:01:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bfb7fe700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0bfc06b120 0x7f0bfc143d40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c510 tx=0x7f0bec00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bf8ff9700 1 -- 172.21.15.38:0/145400040 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec0052d0 con 0x7f0bfc06b120 2023-07-11T00:01:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bf8ff9700 1 -- 172.21.15.38:0/145400040 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec005430 con 0x7f0bfc06b120 2023-07-11T00:01:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0c01d07700 1 -- 172.21.15.38:0/145400040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc1e3130 con 0x7f0bfc06b120 2023-07-11T00:01:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0bf8ff9700 1 -- 172.21.15.38:0/145400040 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec0038c0 con 0x7f0bfc06b120 2023-07-11T00:01:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.431+0000 7f0c01d07700 1 -- 172.21.15.38:0/145400040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc14b4a0 con 0x7f0bfc06b120 2023-07-11T00:01:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.432+0000 7f0c01d07700 1 -- 172.21.15.38:0/145400040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bfc1e3930 con 0x7f0bfc06b120 2023-07-11T00:01:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.433+0000 7f0bf8ff9700 1 -- 172.21.15.38:0/145400040 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0bec003a20 con 0x7f0bfc06b120 2023-07-11T00:01:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.433+0000 7f0bf8ff9700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bdc06ace0 0x7f0bdc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.433+0000 7f0bf8ff9700 1 -- 172.21.15.38:0/145400040 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bec0889a0 con 0x7f0bfc06b120 2023-07-11T00:01:07.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.433+0000 7f0bf3fff700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bdc06ace0 0x7f0bdc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.434+0000 7f0bf3fff700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bdc06ace0 0x7f0bdc06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0be4014040 tx=0x7f0be4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:07.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.438+0000 7f0bf8ff9700 1 -- 172.21.15.38:0/145400040 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0bfc1e3930 con 0x7f0bfc06b120 2023-07-11T00:01:07.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.633+0000 7f0c01d07700 1 -- 172.21.15.38:0/145400040 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bfc1e3930 con 0x7f0bfc06b120 2023-07-11T00:01:07.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.634+0000 7f0bf8ff9700 1 -- 172.21.15.38:0/145400040 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18233 (secure 0 0 0) 0x7f0bfc1e3930 con 0x7f0bfc06b120 2023-07-11T00:01:07.636 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:01:07.637 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:01:04.846047+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:01:01.571071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-11T00:01:02.232591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:01:07.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 -- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bdc06ace0 msgr2=0x7f0bdc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bdc06ace0 0x7f0bdc06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0be4014040 tx=0x7f0be4008030 comp rx=0 tx=0).stop 2023-07-11T00:01:07.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 -- 172.21.15.38:0/145400040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0bfc06b120 msgr2=0x7f0bfc143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0bfc06b120 0x7f0bfc143d40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c510 tx=0x7f0bec00c820 comp rx=0 tx=0).stop 2023-07-11T00:01:07.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 -- 172.21.15.38:0/145400040 shutdown_connections 2023-07-11T00:01:07.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bdc06ace0 0x7f0bdc06d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bfc147c00 0x7f0bfc0b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0bfc06b120 0x7f0bfc143d40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 --2- 172.21.15.38:0/145400040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bfc071b60 0x7f0bfc0b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 -- 172.21.15.38:0/145400040 >> 172.21.15.38:0/145400040 conn(0x7f0bfc0bd980 msgr2=0x7f0bfc0bbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:07.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 -- 172.21.15.38:0/145400040 shutdown_connections 2023-07-11T00:01:07.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.636+0000 7f0c01d07700 1 -- 172.21.15.38:0/145400040 wait complete. 2023-07-11T00:01:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-11T00:01:07.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:01:07.697 INFO:tasks.ceph.mds.c.smithi038.stderr:2023-07-11T00:01:07.696+0000 7fbc40956700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-11T00:01:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.775+0000 7f906f80b700 1 Processor -- start 2023-07-11T00:01:07.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.775+0000 7f906f80b700 1 -- start start 2023-07-11T00:01:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906f80b700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f90681449d0 0x7f906814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906f80b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f90680bc810 0x7f90680ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906f80b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f90680b8d90 0x7f906806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906f80b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90680b97a0 con 0x7f90680bc810 2023-07-11T00:01:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906f80b700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9068144da0 con 0x7f90681449d0 2023-07-11T00:01:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906f80b700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90680b8620 con 0x7f90680b8d90 2023-07-11T00:01:07.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906cda6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f90680bc810 0x7f90680ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906cda6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f90680bc810 0x7f90680ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59156/0 (socket says 172.21.15.38:59156) 2023-07-11T00:01:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906cda6700 1 -- 172.21.15.38:0/3454183237 learned_addr learned my addr 172.21.15.38:0/3454183237 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906dda8700 1 --2- 172.21.15.38:0/3454183237 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f90680b8d90 0x7f906806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906cda6700 1 -- 172.21.15.38:0/3454183237 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f90680b8d90 msgr2=0x7f906806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:07.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906cda6700 1 --2- 172.21.15.38:0/3454183237 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f90680b8d90 0x7f906806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906cda6700 1 -- 172.21.15.38:0/3454183237 >> v2:172.21.15.70:3300/0 conn(0x7f90681449d0 msgr2=0x7f906814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:07.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906d5a7700 1 --2- 172.21.15.38:0/3454183237 >> v2:172.21.15.70:3300/0 conn(0x7f90681449d0 0x7f906814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906cda6700 1 --2- 172.21.15.38:0/3454183237 >> v2:172.21.15.70:3300/0 conn(0x7f90681449d0 0x7f906814db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906cda6700 1 -- 172.21.15.38:0/3454183237 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680b8900 con 0x7f90680bc810 2023-07-11T00:01:07.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f906cda6700 1 --2- 172.21.15.38:0/3454183237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90680bc810 0x7f90680ba530 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f906806cbe0 tx=0x7f9064009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913c916bf9eeef7 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:07.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f905ffff700 1 -- 172.21.15.38:0/3454183237 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906400b870 con 0x7f90680bc810 2023-07-11T00:01:07.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f905ffff700 1 -- 172.21.15.38:0/3454183237 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906400b9d0 con 0x7f90680bc810 2023-07-11T00:01:07.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.776+0000 7f905ffff700 1 -- 172.21.15.38:0/3454183237 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906400bd60 con 0x7f90680bc810 2023-07-11T00:01:07.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.777+0000 7f906f80b700 1 -- 172.21.15.38:0/3454183237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90680bc810 msgr2=0x7f90680ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.777+0000 7f906f80b700 1 --2- 172.21.15.38:0/3454183237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90680bc810 0x7f90680ba530 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f906806cbe0 tx=0x7f9064009bd0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.777+0000 7f906f80b700 1 -- 172.21.15.38:0/3454183237 shutdown_connections 2023-07-11T00:01:07.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.777+0000 7f906f80b700 1 --2- 172.21.15.38:0/3454183237 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f90680b8d90 0x7f906806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.777+0000 7f906f80b700 1 --2- 172.21.15.38:0/3454183237 >> v2:172.21.15.70:3300/0 conn(0x7f90681449d0 0x7f906814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.777+0000 7f906f80b700 1 --2- 172.21.15.38:0/3454183237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90680bc810 0x7f90680ba530 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.777+0000 7f906f80b700 1 -- 172.21.15.38:0/3454183237 >> 172.21.15.38:0/3454183237 conn(0x7f90680c0860 msgr2=0x7f90680c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:07.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.777+0000 7f906f80b700 1 -- 172.21.15.38:0/3454183237 shutdown_connections 2023-07-11T00:01:07.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.777+0000 7f906f80b700 1 -- 172.21.15.38:0/3454183237 wait complete. 2023-07-11T00:01:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.778+0000 7f906f80b700 1 Processor -- start 2023-07-11T00:01:07.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.778+0000 7f906f80b700 1 -- start start 2023-07-11T00:01:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906f80b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90680b8d90 0x7f906814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906f80b700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f90680bc810 0x7f90681e7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906f80b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90681449d0 0x7f90681e42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906f80b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906814db40 con 0x7f90681449d0 2023-07-11T00:01:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906f80b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680b3420 con 0x7f90680b8d90 2023-07-11T00:01:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906f80b700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90681e7150 con 0x7f90680bc810 2023-07-11T00:01:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906dda8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90681449d0 0x7f90681e42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906dda8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90681449d0 0x7f90681e42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59160/0 (socket says 172.21.15.38:59160) 2023-07-11T00:01:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906dda8700 1 -- 172.21.15.38:0/435632473 learned_addr learned my addr 172.21.15.38:0/435632473 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906cda6700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f90680bc810 0x7f90681e7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906dda8700 1 -- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f90680bc810 msgr2=0x7f90681e7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906dda8700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f90680bc810 0x7f90681e7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906dda8700 1 -- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90680b8d90 msgr2=0x7f906814d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906dda8700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90680b8d90 0x7f906814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906dda8700 1 -- 172.21.15.38:0/435632473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9064009550 con 0x7f90681449d0 2023-07-11T00:01:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906cda6700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f90680bc810 0x7f90681e7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:01:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906dda8700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90681449d0 0x7f90681e42e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9060007e90 tx=0x7f906000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f905dffb700 1 -- 172.21.15.38:0/435632473 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906000eea0 con 0x7f90681449d0 2023-07-11T00:01:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f905dffb700 1 -- 172.21.15.38:0/435632473 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060014420 con 0x7f90681449d0 2023-07-11T00:01:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f905dffb700 1 -- 172.21.15.38:0/435632473 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600147f0 con 0x7f90681449d0 2023-07-11T00:01:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.779+0000 7f906f80b700 1 -- 172.21.15.38:0/435632473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90681e76d0 con 0x7f90681449d0 2023-07-11T00:01:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.780+0000 7f906f80b700 1 -- 172.21.15.38:0/435632473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90681e7360 con 0x7f90681449d0 2023-07-11T00:01:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.780+0000 7f906f80b700 1 -- 172.21.15.38:0/435632473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90681e7520 con 0x7f90681449d0 2023-07-11T00:01:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.781+0000 7f905dffb700 1 -- 172.21.15.38:0/435632473 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9060014950 con 0x7f90681449d0 2023-07-11T00:01:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.781+0000 7f905dffb700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f904c06ace0 0x7f904c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.781+0000 7f905dffb700 1 -- 172.21.15.38:0/435632473 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9060089bc0 con 0x7f90681449d0 2023-07-11T00:01:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.781+0000 7f906d5a7700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f904c06ace0 0x7f904c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.782+0000 7f906d5a7700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f904c06ace0 0x7f904c06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f905800a890 tx=0x7f9058008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.786+0000 7f905dffb700 1 -- 172.21.15.38:0/435632473 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9060054c70 con 0x7f90681449d0 2023-07-11T00:01:07.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.980+0000 7f906f80b700 1 -- 172.21.15.38:0/435632473 --> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90681e80a0 con 0x7f904c06ace0 2023-07-11T00:01:07.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.989+0000 7f905dffb700 1 -- 172.21.15.38:0/435632473 <== mgr.4105 v2:172.21.15.70:6832/2073477499 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286928 (secure 0 0 0) 0x7f90580113d0 con 0x7f904c06ace0 2023-07-11T00:01:07.994 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:01:07.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 -- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f904c06ace0 msgr2=0x7f904c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f904c06ace0 0x7f904c06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f905800a890 tx=0x7f9058008040 comp rx=0 tx=0).stop 2023-07-11T00:01:07.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 -- 172.21.15.38:0/435632473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90681449d0 msgr2=0x7f90681e42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:07.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90681449d0 0x7f90681e42e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9060007e90 tx=0x7f906000e3c0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 -- 172.21.15.38:0/435632473 shutdown_connections 2023-07-11T00:01:07.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f904c06ace0 0x7f904c06d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90681449d0 0x7f90681e42e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90680b8d90 0x7f906814d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 --2- 172.21.15.38:0/435632473 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f90680bc810 0x7f90681e7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:07.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 -- 172.21.15.38:0/435632473 >> 172.21.15.38:0/435632473 conn(0x7f90680c0860 msgr2=0x7f90680bae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:07.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 -- 172.21.15.38:0/435632473 shutdown_connections 2023-07-11T00:01:07.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:07.992+0000 7f906f80b700 1 -- 172.21.15.38:0/435632473 wait complete. 2023-07-11T00:01:07.997 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-07-11T00:01:08.006 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-07-11T00:01:07.961854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219912,"kb_used_data":3716,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754808,"statfs":{"total":773094113280,"available":772868923392,"internally_reserved":0,"allocated":3805184,"data_stored":2205390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001503"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.879930+0000","last_change":"2023-07-11T00:01:03.874198+0000","last_active":"2023-07-11T00:01:03.879930+0000","last_peered":"2023-07-11T00:01:03.879930+0000","last_clean":"2023-07-11T00:01:03.879930+0000","last_became_active":"2023-07-11T00:01:03.873880+0000","last_became_peered":"2023-07-11T00:01:03.873880+0000","last_unstale":"2023-07-11T00:01:03.879930+0000","last_undegraded":"2023-07-11T00:01:03.879930+0000","last_fullsized":"2023-07-11T00:01:03.879930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:01:09.577811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877482+0000","last_change":"2023-07-11T00:01:03.870700+0000","last_active":"2023-07-11T00:01:03.877482+0000","last_peered":"2023-07-11T00:01:03.877482+0000","last_clean":"2023-07-11T00:01:03.877482+0000","last_became_active":"2023-07-11T00:01:03.870419+0000","last_became_peered":"2023-07-11T00:01:03.870419+0000","last_unstale":"2023-07-11T00:01:03.877482+0000","last_undegraded":"2023-07-11T00:01:03.877482+0000","last_fullsized":"2023-07-11T00:01:03.877482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:51:04.426268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874106+0000","last_change":"2023-07-11T00:01:03.867383+0000","last_active":"2023-07-11T00:01:03.874106+0000","last_peered":"2023-07-11T00:01:03.874106+0000","last_clean":"2023-07-11T00:01:03.874106+0000","last_became_active":"2023-07-11T00:01:03.867069+0000","last_became_peered":"2023-07-11T00:01:03.867069+0000","last_unstale":"2023-07-11T00:01:03.874106+0000","last_undegraded":"2023-07-11T00:01:03.874106+0000","last_fullsized":"2023-07-11T00:01:03.874106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:40:45.434809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877131+0000","last_change":"2023-07-11T00:01:03.869075+0000","last_active":"2023-07-11T00:01:03.877131+0000","last_peered":"2023-07-11T00:01:03.877131+0000","last_clean":"2023-07-11T00:01:03.877131+0000","last_became_active":"2023-07-11T00:01:03.868752+0000","last_became_peered":"2023-07-11T00:01:03.868752+0000","last_unstale":"2023-07-11T00:01:03.877131+0000","last_undegraded":"2023-07-11T00:01:03.877131+0000","last_fullsized":"2023-07-11T00:01:03.877131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:10:25.054581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.872709+0000","last_change":"2023-07-11T00:01:03.861295+0000","last_active":"2023-07-11T00:01:03.872709+0000","last_peered":"2023-07-11T00:01:03.872709+0000","last_clean":"2023-07-11T00:01:03.872709+0000","last_became_active":"2023-07-11T00:01:03.861027+0000","last_became_peered":"2023-07-11T00:01:03.861027+0000","last_unstale":"2023-07-11T00:01:03.872709+0000","last_undegraded":"2023-07-11T00:01:03.872709+0000","last_fullsized":"2023-07-11T00:01:03.872709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:09:26.708017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877287+0000","last_change":"2023-07-11T00:01:03.872036+0000","last_active":"2023-07-11T00:01:03.877287+0000","last_peered":"2023-07-11T00:01:03.877287+0000","last_clean":"2023-07-11T00:01:03.877287+0000","last_became_active":"2023-07-11T00:01:03.871723+0000","last_became_peered":"2023-07-11T00:01:03.871723+0000","last_unstale":"2023-07-11T00:01:03.877287+0000","last_undegraded":"2023-07-11T00:01:03.877287+0000","last_fullsized":"2023-07-11T00:01:03.877287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:32:35.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877041+0000","last_change":"2023-07-11T00:01:03.875001+0000","last_active":"2023-07-11T00:01:03.877041+0000","last_peered":"2023-07-11T00:01:03.877041+0000","last_clean":"2023-07-11T00:01:03.877041+0000","last_became_active":"2023-07-11T00:01:03.874677+0000","last_became_peered":"2023-07-11T00:01:03.874677+0000","last_unstale":"2023-07-11T00:01:03.877041+0000","last_undegraded":"2023-07-11T00:01:03.877041+0000","last_fullsized":"2023-07-11T00:01:03.877041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:30.332160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.872498+0000","last_change":"2023-07-11T00:01:03.868412+0000","last_active":"2023-07-11T00:01:03.872498+0000","last_peered":"2023-07-11T00:01:03.872498+0000","last_clean":"2023-07-11T00:01:03.872498+0000","last_became_active":"2023-07-11T00:01:03.868131+0000","last_became_peered":"2023-07-11T00:01:03.868131+0000","last_unstale":"2023-07-11T00:01:03.872498+0000","last_undegraded":"2023-07-11T00:01:03.872498+0000","last_fullsized":"2023-07-11T00:01:03.872498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:43:37.195459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873680+0000","last_change":"2023-07-11T00:01:03.867323+0000","last_active":"2023-07-11T00:01:03.873680+0000","last_peered":"2023-07-11T00:01:03.873680+0000","last_clean":"2023-07-11T00:01:03.873680+0000","last_became_active":"2023-07-11T00:01:03.866917+0000","last_became_peered":"2023-07-11T00:01:03.866917+0000","last_unstale":"2023-07-11T00:01:03.873680+0000","last_undegraded":"2023-07-11T00:01:03.873680+0000","last_fullsized":"2023-07-11T00:01:03.873680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:06:13.772121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.866936+0000","last_change":"2023-07-11T00:01:03.865446+0000","last_active":"2023-07-11T00:01:03.866936+0000","last_peered":"2023-07-11T00:01:03.866936+0000","last_clean":"2023-07-11T00:01:03.866936+0000","last_became_active":"2023-07-11T00:01:03.865197+0000","last_became_peered":"2023-07-11T00:01:03.865197+0000","last_unstale":"2023-07-11T00:01:03.866936+0000","last_undegraded":"2023-07-11T00:01:03.866936+0000","last_fullsized":"2023-07-11T00:01:03.866936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:08.869768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.864642+0000","last_change":"2023-07-11T00:01:03.862298+0000","last_active":"2023-07-11T00:01:03.864642+0000","last_peered":"2023-07-11T00:01:03.864642+0000","last_clean":"2023-07-11T00:01:03.864642+0000","last_became_active":"2023-07-11T00:01:03.862009+0000","last_became_peered":"2023-07-11T00:01:03.862009+0000","last_unstale":"2023-07-11T00:01:03.864642+0000","last_undegraded":"2023-07-11T00:01:03.864642+0000","last_fullsized":"2023-07-11T00:01:03.864642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:04:15.268452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873716+0000","last_change":"2023-07-11T00:01:03.867038+0000","last_active":"2023-07-11T00:01:03.873716+0000","last_peered":"2023-07-11T00:01:03.873716+0000","last_clean":"2023-07-11T00:01:03.873716+0000","last_became_active":"2023-07-11T00:01:03.866739+0000","last_became_peered":"2023-07-11T00:01:03.866739+0000","last_unstale":"2023-07-11T00:01:03.873716+0000","last_undegraded":"2023-07-11T00:01:03.873716+0000","last_fullsized":"2023-07-11T00:01:03.873716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:30.332160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.867666+0000","last_change":"2023-07-11T00:01:03.865637+0000","last_active":"2023-07-11T00:01:03.867666+0000","last_peered":"2023-07-11T00:01:03.867666+0000","last_clean":"2023-07-11T00:01:03.867666+0000","last_became_active":"2023-07-11T00:01:03.865366+0000","last_became_peered":"2023-07-11T00:01:03.865366+0000","last_unstale":"2023-07-11T00:01:03.867666+0000","last_undegraded":"2023-07-11T00:01:03.867666+0000","last_fullsized":"2023-07-11T00:01:03.867666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:09:08.175808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.853852+0000","last_change":"2023-07-11T00:01:03.852419+0000","last_active":"2023-07-11T00:01:03.853852+0000","last_peered":"2023-07-11T00:01:03.853852+0000","last_clean":"2023-07-11T00:01:03.853852+0000","last_became_active":"2023-07-11T00:01:03.852117+0000","last_became_peered":"2023-07-11T00:01:03.852117+0000","last_unstale":"2023-07-11T00:01:03.853852+0000","last_undegraded":"2023-07-11T00:01:03.853852+0000","last_fullsized":"2023-07-11T00:01:03.853852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:49:34.332245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876182+0000","last_change":"2023-07-11T00:01:03.870796+0000","last_active":"2023-07-11T00:01:03.876182+0000","last_peered":"2023-07-11T00:01:03.876182+0000","last_clean":"2023-07-11T00:01:03.876182+0000","last_became_active":"2023-07-11T00:01:03.870556+0000","last_became_peered":"2023-07-11T00:01:03.870556+0000","last_unstale":"2023-07-11T00:01:03.876182+0000","last_undegraded":"2023-07-11T00:01:03.876182+0000","last_fullsized":"2023-07-11T00:01:03.876182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:06:13.772121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874782+0000","last_change":"2023-07-11T00:01:03.865944+0000","last_active":"2023-07-11T00:01:03.874782+0000","last_peered":"2023-07-11T00:01:03.874782+0000","last_clean":"2023-07-11T00:01:03.874782+0000","last_became_active":"2023-07-11T00:01:03.865488+0000","last_became_peered":"2023-07-11T00:01:03.865488+0000","last_unstale":"2023-07-11T00:01:03.874782+0000","last_undegraded":"2023-07-11T00:01:03.874782+0000","last_fullsized":"2023-07-11T00:01:03.874782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:09:08.175808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874318+0000","last_change":"2023-07-11T00:01:03.867622+0000","last_active":"2023-07-11T00:01:03.874318+0000","last_peered":"2023-07-11T00:01:03.874318+0000","last_clean":"2023-07-11T00:01:03.874318+0000","last_became_active":"2023-07-11T00:01:03.867396+0000","last_became_peered":"2023-07-11T00:01:03.867396+0000","last_unstale":"2023-07-11T00:01:03.874318+0000","last_undegraded":"2023-07-11T00:01:03.874318+0000","last_fullsized":"2023-07-11T00:01:03.874318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:52:21.022767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860359+0000","last_change":"2023-07-11T00:01:03.856340+0000","last_active":"2023-07-11T00:01:03.860359+0000","last_peered":"2023-07-11T00:01:03.860359+0000","last_clean":"2023-07-11T00:01:03.860359+0000","last_became_active":"2023-07-11T00:01:03.856093+0000","last_became_peered":"2023-07-11T00:01:03.856093+0000","last_unstale":"2023-07-11T00:01:03.860359+0000","last_undegraded":"2023-07-11T00:01:03.860359+0000","last_fullsized":"2023-07-11T00:01:03.860359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:33:33.634073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.879708+0000","last_change":"2023-07-11T00:01:03.871607+0000","last_active":"2023-07-11T00:01:03.879708+0000","last_peered":"2023-07-11T00:01:03.879708+0000","last_clean":"2023-07-11T00:01:03.879708+0000","last_became_active":"2023-07-11T00:01:03.871329+0000","last_became_peered":"2023-07-11T00:01:03.871329+0000","last_unstale":"2023-07-11T00:01:03.879708+0000","last_undegraded":"2023-07-11T00:01:03.879708+0000","last_fullsized":"2023-07-11T00:01:03.879708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:26:19.748934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.855032+0000","last_change":"2023-07-11T00:01:03.853399+0000","last_active":"2023-07-11T00:01:03.855032+0000","last_peered":"2023-07-11T00:01:03.855032+0000","last_clean":"2023-07-11T00:01:03.855032+0000","last_became_active":"2023-07-11T00:01:03.853135+0000","last_became_peered":"2023-07-11T00:01:03.853135+0000","last_unstale":"2023-07-11T00:01:03.855032+0000","last_undegraded":"2023-07-11T00:01:03.855032+0000","last_fullsized":"2023-07-11T00:01:03.855032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:28:36.982223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876026+0000","last_change":"2023-07-11T00:01:03.871147+0000","last_active":"2023-07-11T00:01:03.876026+0000","last_peered":"2023-07-11T00:01:03.876026+0000","last_clean":"2023-07-11T00:01:03.876026+0000","last_became_active":"2023-07-11T00:01:03.870854+0000","last_became_peered":"2023-07-11T00:01:03.870854+0000","last_unstale":"2023-07-11T00:01:03.876026+0000","last_undegraded":"2023-07-11T00:01:03.876026+0000","last_fullsized":"2023-07-11T00:01:03.876026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:43:36.518731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876839+0000","last_change":"2023-07-11T00:01:03.872033+0000","last_active":"2023-07-11T00:01:03.876839+0000","last_peered":"2023-07-11T00:01:03.876839+0000","last_clean":"2023-07-11T00:01:03.876839+0000","last_became_active":"2023-07-11T00:01:03.871766+0000","last_became_peered":"2023-07-11T00:01:03.871766+0000","last_unstale":"2023-07-11T00:01:03.876839+0000","last_undegraded":"2023-07-11T00:01:03.876839+0000","last_fullsized":"2023-07-11T00:01:03.876839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:23.837762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876715+0000","last_change":"2023-07-11T00:01:03.874198+0000","last_active":"2023-07-11T00:01:03.876715+0000","last_peered":"2023-07-11T00:01:03.876715+0000","last_clean":"2023-07-11T00:01:03.876715+0000","last_became_active":"2023-07-11T00:01:03.873950+0000","last_became_peered":"2023-07-11T00:01:03.873950+0000","last_unstale":"2023-07-11T00:01:03.876715+0000","last_undegraded":"2023-07-11T00:01:03.876715+0000","last_fullsized":"2023-07-11T00:01:03.876715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:14:31.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874135+0000","last_change":"2023-07-11T00:01:03.864976+0000","last_active":"2023-07-11T00:01:03.874135+0000","last_peered":"2023-07-11T00:01:03.874135+0000","last_clean":"2023-07-11T00:01:03.874135+0000","last_became_active":"2023-07-11T00:01:03.864611+0000","last_became_peered":"2023-07-11T00:01:03.864611+0000","last_unstale":"2023-07-11T00:01:03.874135+0000","last_undegraded":"2023-07-11T00:01:03.874135+0000","last_fullsized":"2023-07-11T00:01:03.874135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:46:05.973456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860197+0000","last_change":"2023-07-11T00:01:03.855272+0000","last_active":"2023-07-11T00:01:03.860197+0000","last_peered":"2023-07-11T00:01:03.860197+0000","last_clean":"2023-07-11T00:01:03.860197+0000","last_became_active":"2023-07-11T00:01:03.854998+0000","last_became_peered":"2023-07-11T00:01:03.854998+0000","last_unstale":"2023-07-11T00:01:03.860197+0000","last_undegraded":"2023-07-11T00:01:03.860197+0000","last_fullsized":"2023-07-11T00:01:03.860197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:32:35.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.870887+0000","last_change":"2023-07-11T00:01:03.865852+0000","last_active":"2023-07-11T00:01:03.870887+0000","last_peered":"2023-07-11T00:01:03.870887+0000","last_clean":"2023-07-11T00:01:03.870887+0000","last_became_active":"2023-07-11T00:01:03.865536+0000","last_became_peered":"2023-07-11T00:01:03.865536+0000","last_unstale":"2023-07-11T00:01:03.870887+0000","last_undegraded":"2023-07-11T00:01:03.870887+0000","last_fullsized":"2023-07-11T00:01:03.870887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:04:15.268452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.870853+0000","last_change":"2023-07-11T00:01:03.863487+0000","last_active":"2023-07-11T00:01:03.870853+0000","last_peered":"2023-07-11T00:01:03.870853+0000","last_clean":"2023-07-11T00:01:03.870853+0000","last_became_active":"2023-07-11T00:01:03.861980+0000","last_became_peered":"2023-07-11T00:01:03.861980+0000","last_unstale":"2023-07-11T00:01:03.870853+0000","last_undegraded":"2023-07-11T00:01:03.870853+0000","last_fullsized":"2023-07-11T00:01:03.870853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:30:09.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877017+0000","last_change":"2023-07-11T00:01:03.875416+0000","last_active":"2023-07-11T00:01:03.877017+0000","last_peered":"2023-07-11T00:01:03.877017+0000","last_clean":"2023-07-11T00:01:03.877017+0000","last_became_active":"2023-07-11T00:01:03.875136+0000","last_became_peered":"2023-07-11T00:01:03.875136+0000","last_unstale":"2023-07-11T00:01:03.877017+0000","last_undegraded":"2023-07-11T00:01:03.877017+0000","last_fullsized":"2023-07-11T00:01:03.877017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:01:37.967360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.871647+0000","last_change":"2023-07-11T00:01:03.868485+0000","last_active":"2023-07-11T00:01:03.871647+0000","last_peered":"2023-07-11T00:01:03.871647+0000","last_clean":"2023-07-11T00:01:03.871647+0000","last_became_active":"2023-07-11T00:01:03.868215+0000","last_became_peered":"2023-07-11T00:01:03.868215+0000","last_unstale":"2023-07-11T00:01:03.871647+0000","last_undegraded":"2023-07-11T00:01:03.871647+0000","last_fullsized":"2023-07-11T00:01:03.871647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:22:33.824631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876405+0000","last_change":"2023-07-11T00:01:03.873095+0000","last_active":"2023-07-11T00:01:03.876405+0000","last_peered":"2023-07-11T00:01:03.876405+0000","last_clean":"2023-07-11T00:01:03.876405+0000","last_became_active":"2023-07-11T00:01:03.872794+0000","last_became_peered":"2023-07-11T00:01:03.872794+0000","last_unstale":"2023-07-11T00:01:03.876405+0000","last_undegraded":"2023-07-11T00:01:03.876405+0000","last_fullsized":"2023-07-11T00:01:03.876405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:08:16.724567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874340+0000","last_change":"2023-07-11T00:01:03.870722+0000","last_active":"2023-07-11T00:01:03.874340+0000","last_peered":"2023-07-11T00:01:03.874340+0000","last_clean":"2023-07-11T00:01:03.874340+0000","last_became_active":"2023-07-11T00:01:03.870418+0000","last_became_peered":"2023-07-11T00:01:03.870418+0000","last_unstale":"2023-07-11T00:01:03.874340+0000","last_undegraded":"2023-07-11T00:01:03.874340+0000","last_fullsized":"2023-07-11T00:01:03.874340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:14:30.517707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.878206+0000","last_change":"2023-07-11T00:01:03.875061+0000","last_active":"2023-07-11T00:01:03.878206+0000","last_peered":"2023-07-11T00:01:03.878206+0000","last_clean":"2023-07-11T00:01:03.878206+0000","last_became_active":"2023-07-11T00:01:03.874747+0000","last_became_peered":"2023-07-11T00:01:03.874747+0000","last_unstale":"2023-07-11T00:01:03.878206+0000","last_undegraded":"2023-07-11T00:01:03.878206+0000","last_fullsized":"2023-07-11T00:01:03.878206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:47:25.299702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876554+0000","last_change":"2023-07-11T00:01:03.866236+0000","last_active":"2023-07-11T00:01:03.876554+0000","last_peered":"2023-07-11T00:01:03.876554+0000","last_clean":"2023-07-11T00:01:03.876554+0000","last_became_active":"2023-07-11T00:01:03.865918+0000","last_became_peered":"2023-07-11T00:01:03.865918+0000","last_unstale":"2023-07-11T00:01:03.876554+0000","last_undegraded":"2023-07-11T00:01:03.876554+0000","last_fullsized":"2023-07-11T00:01:03.876554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:51:04.426268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876232+0000","last_change":"2023-07-11T00:01:02.859445+0000","last_active":"2023-07-11T00:01:03.876232+0000","last_peered":"2023-07-11T00:01:03.876232+0000","last_clean":"2023-07-11T00:01:03.876232+0000","last_became_active":"2023-07-11T00:01:02.859159+0000","last_became_peered":"2023-07-11T00:01:02.859159+0000","last_unstale":"2023-07-11T00:01:03.876232+0000","last_undegraded":"2023-07-11T00:01:03.876232+0000","last_fullsized":"2023-07-11T00:01:03.876232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:01:19.035150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.870347+0000","last_change":"2023-07-11T00:01:03.866269+0000","last_active":"2023-07-11T00:01:03.870347+0000","last_peered":"2023-07-11T00:01:03.870347+0000","last_clean":"2023-07-11T00:01:03.870347+0000","last_became_active":"2023-07-11T00:01:03.865981+0000","last_became_peered":"2023-07-11T00:01:03.865981+0000","last_unstale":"2023-07-11T00:01:03.870347+0000","last_undegraded":"2023-07-11T00:01:03.870347+0000","last_fullsized":"2023-07-11T00:01:03.870347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:03:13.440872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876978+0000","last_change":"2023-07-11T00:01:02.860567+0000","last_active":"2023-07-11T00:01:03.876978+0000","last_peered":"2023-07-11T00:01:03.876978+0000","last_clean":"2023-07-11T00:01:03.876978+0000","last_became_active":"2023-07-11T00:01:02.860275+0000","last_became_peered":"2023-07-11T00:01:02.860275+0000","last_unstale":"2023-07-11T00:01:03.876978+0000","last_undegraded":"2023-07-11T00:01:03.876978+0000","last_fullsized":"2023-07-11T00:01:03.876978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:03:12.435937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.856348+0000","last_change":"2023-07-11T00:01:03.854763+0000","last_active":"2023-07-11T00:01:03.856348+0000","last_peered":"2023-07-11T00:01:03.856348+0000","last_clean":"2023-07-11T00:01:03.856348+0000","last_became_active":"2023-07-11T00:01:03.854440+0000","last_became_peered":"2023-07-11T00:01:03.854440+0000","last_unstale":"2023-07-11T00:01:03.856348+0000","last_undegraded":"2023-07-11T00:01:03.856348+0000","last_fullsized":"2023-07-11T00:01:03.856348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:02:44.899952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.878365+0000","last_change":"2023-07-11T00:01:02.859800+0000","last_active":"2023-07-11T00:01:03.878365+0000","last_peered":"2023-07-11T00:01:03.878365+0000","last_clean":"2023-07-11T00:01:03.878365+0000","last_became_active":"2023-07-11T00:01:02.859503+0000","last_became_peered":"2023-07-11T00:01:02.859503+0000","last_unstale":"2023-07-11T00:01:03.878365+0000","last_undegraded":"2023-07-11T00:01:03.878365+0000","last_fullsized":"2023-07-11T00:01:03.878365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:43:35.513796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.872290+0000","last_change":"2023-07-11T00:01:03.864168+0000","last_active":"2023-07-11T00:01:03.872290+0000","last_peered":"2023-07-11T00:01:03.872290+0000","last_clean":"2023-07-11T00:01:03.872290+0000","last_became_active":"2023-07-11T00:01:03.863251+0000","last_became_peered":"2023-07-11T00:01:03.863251+0000","last_unstale":"2023-07-11T00:01:03.872290+0000","last_undegraded":"2023-07-11T00:01:03.872290+0000","last_fullsized":"2023-07-11T00:01:03.872290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:14:31.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.880350+0000","last_change":"2023-07-11T00:01:02.867478+0000","last_active":"2023-07-11T00:01:03.880350+0000","last_peered":"2023-07-11T00:01:03.880350+0000","last_clean":"2023-07-11T00:01:03.880350+0000","last_became_active":"2023-07-11T00:01:02.867213+0000","last_became_peered":"2023-07-11T00:01:02.867213+0000","last_unstale":"2023-07-11T00:01:03.880350+0000","last_undegraded":"2023-07-11T00:01:03.880350+0000","last_fullsized":"2023-07-11T00:01:03.880350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:57:32.962303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873885+0000","last_change":"2023-07-11T00:01:03.868182+0000","last_active":"2023-07-11T00:01:03.873885+0000","last_peered":"2023-07-11T00:01:03.873885+0000","last_clean":"2023-07-11T00:01:03.873885+0000","last_became_active":"2023-07-11T00:01:03.867922+0000","last_became_peered":"2023-07-11T00:01:03.867922+0000","last_unstale":"2023-07-11T00:01:03.873885+0000","last_undegraded":"2023-07-11T00:01:03.873885+0000","last_fullsized":"2023-07-11T00:01:03.873885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:01:37.967360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877966+0000","last_change":"2023-07-11T00:01:02.863908+0000","last_active":"2023-07-11T00:01:03.877966+0000","last_peered":"2023-07-11T00:01:03.877966+0000","last_clean":"2023-07-11T00:01:03.877966+0000","last_became_active":"2023-07-11T00:01:02.863657+0000","last_became_peered":"2023-07-11T00:01:02.863657+0000","last_unstale":"2023-07-11T00:01:03.877966+0000","last_undegraded":"2023-07-11T00:01:03.877966+0000","last_fullsized":"2023-07-11T00:01:03.877966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:33:48.414474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.867686+0000","last_change":"2023-07-11T00:01:03.866671+0000","last_active":"2023-07-11T00:01:03.867686+0000","last_peered":"2023-07-11T00:01:03.867686+0000","last_clean":"2023-07-11T00:01:03.867686+0000","last_became_active":"2023-07-11T00:01:03.866396+0000","last_became_peered":"2023-07-11T00:01:03.866396+0000","last_unstale":"2023-07-11T00:01:03.867686+0000","last_undegraded":"2023-07-11T00:01:03.867686+0000","last_fullsized":"2023-07-11T00:01:03.867686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:03:13.440872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877399+0000","last_change":"2023-07-11T00:01:02.863465+0000","last_active":"2023-07-11T00:01:03.877399+0000","last_peered":"2023-07-11T00:01:03.877399+0000","last_clean":"2023-07-11T00:01:03.877399+0000","last_became_active":"2023-07-11T00:01:02.862752+0000","last_became_peered":"2023-07-11T00:01:02.862752+0000","last_unstale":"2023-07-11T00:01:03.877399+0000","last_undegraded":"2023-07-11T00:01:03.877399+0000","last_fullsized":"2023-07-11T00:01:03.877399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:33:48.414474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.862484+0000","last_change":"2023-07-11T00:01:03.860484+0000","last_active":"2023-07-11T00:01:03.862484+0000","last_peered":"2023-07-11T00:01:03.862484+0000","last_clean":"2023-07-11T00:01:03.862484+0000","last_became_active":"2023-07-11T00:01:03.860211+0000","last_became_peered":"2023-07-11T00:01:03.860211+0000","last_unstale":"2023-07-11T00:01:03.862484+0000","last_undegraded":"2023-07-11T00:01:03.862484+0000","last_fullsized":"2023-07-11T00:01:03.862484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:15:00.287935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860660+0000","last_change":"2023-07-11T00:01:02.861510+0000","last_active":"2023-07-11T00:01:03.860660+0000","last_peered":"2023-07-11T00:01:03.860660+0000","last_clean":"2023-07-11T00:01:03.860660+0000","last_became_active":"2023-07-11T00:01:02.861193+0000","last_became_peered":"2023-07-11T00:01:02.861193+0000","last_unstale":"2023-07-11T00:01:03.860660+0000","last_undegraded":"2023-07-11T00:01:03.860660+0000","last_fullsized":"2023-07-11T00:01:03.860660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:29.327224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873030+0000","last_change":"2023-07-11T00:01:03.863834+0000","last_active":"2023-07-11T00:01:03.873030+0000","last_peered":"2023-07-11T00:01:03.873030+0000","last_clean":"2023-07-11T00:01:03.873030+0000","last_became_active":"2023-07-11T00:01:03.863474+0000","last_became_peered":"2023-07-11T00:01:03.863474+0000","last_unstale":"2023-07-11T00:01:03.873030+0000","last_undegraded":"2023-07-11T00:01:03.873030+0000","last_fullsized":"2023-07-11T00:01:03.873030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:52:21.022767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.849848+0000","last_change":"2023-07-11T00:01:02.859230+0000","last_active":"2023-07-11T00:01:03.849848+0000","last_peered":"2023-07-11T00:01:03.849848+0000","last_clean":"2023-07-11T00:01:03.849848+0000","last_became_active":"2023-07-11T00:01:02.858952+0000","last_became_peered":"2023-07-11T00:01:02.858952+0000","last_unstale":"2023-07-11T00:01:03.849848+0000","last_undegraded":"2023-07-11T00:01:03.849848+0000","last_fullsized":"2023-07-11T00:01:03.849848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:47:00.820042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.880100+0000","last_change":"2023-07-11T00:01:03.872662+0000","last_active":"2023-07-11T00:01:03.880100+0000","last_peered":"2023-07-11T00:01:03.880100+0000","last_clean":"2023-07-11T00:01:03.880100+0000","last_became_active":"2023-07-11T00:01:03.869050+0000","last_became_peered":"2023-07-11T00:01:03.869050+0000","last_unstale":"2023-07-11T00:01:03.880100+0000","last_undegraded":"2023-07-11T00:01:03.880100+0000","last_fullsized":"2023-07-11T00:01:03.880100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:40:42.581792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.861511+0000","last_change":"2023-07-11T00:01:02.866548+0000","last_active":"2023-07-11T00:01:03.861511+0000","last_peered":"2023-07-11T00:01:03.861511+0000","last_clean":"2023-07-11T00:01:03.861511+0000","last_became_active":"2023-07-11T00:01:02.866262+0000","last_became_peered":"2023-07-11T00:01:02.866262+0000","last_unstale":"2023-07-11T00:01:03.861511+0000","last_undegraded":"2023-07-11T00:01:03.861511+0000","last_fullsized":"2023-07-11T00:01:03.861511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:46:20.898286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.869974+0000","last_change":"2023-07-11T00:01:03.865125+0000","last_active":"2023-07-11T00:01:03.869974+0000","last_peered":"2023-07-11T00:01:03.869974+0000","last_clean":"2023-07-11T00:01:03.869974+0000","last_became_active":"2023-07-11T00:01:03.864635+0000","last_became_peered":"2023-07-11T00:01:03.864635+0000","last_unstale":"2023-07-11T00:01:03.869974+0000","last_undegraded":"2023-07-11T00:01:03.869974+0000","last_fullsized":"2023-07-11T00:01:03.869974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:01:09.577811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.864780+0000","last_change":"2023-07-11T00:01:02.867674+0000","last_active":"2023-07-11T00:01:03.864780+0000","last_peered":"2023-07-11T00:01:03.864780+0000","last_clean":"2023-07-11T00:01:03.864780+0000","last_became_active":"2023-07-11T00:01:02.867393+0000","last_became_peered":"2023-07-11T00:01:02.867393+0000","last_unstale":"2023-07-11T00:01:03.864780+0000","last_undegraded":"2023-07-11T00:01:03.864780+0000","last_fullsized":"2023-07-11T00:01:03.864780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:38:33.154088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873586+0000","last_change":"2023-07-11T00:01:03.862554+0000","last_active":"2023-07-11T00:01:03.873586+0000","last_peered":"2023-07-11T00:01:03.873586+0000","last_clean":"2023-07-11T00:01:03.873586+0000","last_became_active":"2023-07-11T00:01:03.862253+0000","last_became_peered":"2023-07-11T00:01:03.862253+0000","last_unstale":"2023-07-11T00:01:03.873586+0000","last_undegraded":"2023-07-11T00:01:03.873586+0000","last_fullsized":"2023-07-11T00:01:03.873586+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:04:15.268452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"30'3","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.878547+0000","last_change":"2023-07-11T00:01:02.863167+0000","last_active":"2023-07-11T00:01:03.878547+0000","last_peered":"2023-07-11T00:01:03.878547+0000","last_clean":"2023-07-11T00:01:03.878547+0000","last_became_active":"2023-07-11T00:01:02.862373+0000","last_became_peered":"2023-07-11T00:01:02.862373+0000","last_unstale":"2023-07-11T00:01:03.878547+0000","last_undegraded":"2023-07-11T00:01:03.878547+0000","last_fullsized":"2023-07-11T00:01:03.878547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:05:13.558020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.863433+0000","last_change":"2023-07-11T00:01:03.861532+0000","last_active":"2023-07-11T00:01:03.863433+0000","last_peered":"2023-07-11T00:01:03.863433+0000","last_clean":"2023-07-11T00:01:03.863433+0000","last_became_active":"2023-07-11T00:01:03.861251+0000","last_became_peered":"2023-07-11T00:01:03.861251+0000","last_unstale":"2023-07-11T00:01:03.863433+0000","last_undegraded":"2023-07-11T00:01:03.863433+0000","last_fullsized":"2023-07-11T00:01:03.863433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:36:20.971140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"30'6","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.886013+0000","last_change":"2023-07-11T00:01:02.866307+0000","last_active":"2023-07-11T00:01:03.886013+0000","last_peered":"2023-07-11T00:01:03.886013+0000","last_clean":"2023-07-11T00:01:03.886013+0000","last_became_active":"2023-07-11T00:01:02.865613+0000","last_became_peered":"2023-07-11T00:01:02.865613+0000","last_unstale":"2023-07-11T00:01:03.886013+0000","last_undegraded":"2023-07-11T00:01:03.886013+0000","last_fullsized":"2023-07-11T00:01:03.886013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:08:22.458015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873865+0000","last_change":"2023-07-11T00:01:03.861918+0000","last_active":"2023-07-11T00:01:03.873865+0000","last_peered":"2023-07-11T00:01:03.873865+0000","last_clean":"2023-07-11T00:01:03.873865+0000","last_became_active":"2023-07-11T00:01:03.861639+0000","last_became_peered":"2023-07-11T00:01:03.861639+0000","last_unstale":"2023-07-11T00:01:03.873865+0000","last_undegraded":"2023-07-11T00:01:03.873865+0000","last_fullsized":"2023-07-11T00:01:03.873865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:43:36.518731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.879991+0000","last_change":"2023-07-11T00:01:02.863954+0000","last_active":"2023-07-11T00:01:03.879991+0000","last_peered":"2023-07-11T00:01:03.879991+0000","last_clean":"2023-07-11T00:01:03.879991+0000","last_became_active":"2023-07-11T00:01:02.863335+0000","last_became_peered":"2023-07-11T00:01:02.863335+0000","last_unstale":"2023-07-11T00:01:03.879991+0000","last_undegraded":"2023-07-11T00:01:03.879991+0000","last_fullsized":"2023-07-11T00:01:03.879991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:40:53.252640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.879511+0000","last_change":"2023-07-11T00:01:03.874064+0000","last_active":"2023-07-11T00:01:03.879511+0000","last_peered":"2023-07-11T00:01:03.879511+0000","last_clean":"2023-07-11T00:01:03.879511+0000","last_became_active":"2023-07-11T00:01:03.873773+0000","last_became_peered":"2023-07-11T00:01:03.873773+0000","last_unstale":"2023-07-11T00:01:03.879511+0000","last_undegraded":"2023-07-11T00:01:03.879511+0000","last_fullsized":"2023-07-11T00:01:03.879511+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:12:34.043950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.856078+0000","last_change":"2023-07-11T00:01:02.861790+0000","last_active":"2023-07-11T00:01:03.856078+0000","last_peered":"2023-07-11T00:01:03.856078+0000","last_clean":"2023-07-11T00:01:03.856078+0000","last_became_active":"2023-07-11T00:01:02.861481+0000","last_became_peered":"2023-07-11T00:01:02.861481+0000","last_unstale":"2023-07-11T00:01:03.856078+0000","last_undegraded":"2023-07-11T00:01:03.856078+0000","last_fullsized":"2023-07-11T00:01:03.856078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:08:15.719632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874357+0000","last_change":"2023-07-11T00:01:03.870708+0000","last_active":"2023-07-11T00:01:03.874357+0000","last_peered":"2023-07-11T00:01:03.874357+0000","last_clean":"2023-07-11T00:01:03.874357+0000","last_became_active":"2023-07-11T00:01:03.870421+0000","last_became_peered":"2023-07-11T00:01:03.870421+0000","last_unstale":"2023-07-11T00:01:03.874357+0000","last_undegraded":"2023-07-11T00:01:03.874357+0000","last_fullsized":"2023-07-11T00:01:03.874357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:42.503741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.850262+0000","last_change":"2023-07-11T00:01:02.860559+0000","last_active":"2023-07-11T00:01:03.850262+0000","last_peered":"2023-07-11T00:01:03.850262+0000","last_clean":"2023-07-11T00:01:03.850262+0000","last_became_active":"2023-07-11T00:01:02.860246+0000","last_became_peered":"2023-07-11T00:01:02.860246+0000","last_unstale":"2023-07-11T00:01:03.850262+0000","last_undegraded":"2023-07-11T00:01:03.850262+0000","last_fullsized":"2023-07-11T00:01:03.850262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:03:12.435937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.880120+0000","last_change":"2023-07-11T00:01:03.874856+0000","last_active":"2023-07-11T00:01:03.880120+0000","last_peered":"2023-07-11T00:01:03.880120+0000","last_clean":"2023-07-11T00:01:03.880120+0000","last_became_active":"2023-07-11T00:01:03.874438+0000","last_became_peered":"2023-07-11T00:01:03.874438+0000","last_unstale":"2023-07-11T00:01:03.880120+0000","last_undegraded":"2023-07-11T00:01:03.880120+0000","last_fullsized":"2023-07-11T00:01:03.880120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:14:30.517707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'8","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.878108+0000","last_change":"2023-07-11T00:01:02.863709+0000","last_active":"2023-07-11T00:01:03.878108+0000","last_peered":"2023-07-11T00:01:03.878108+0000","last_clean":"2023-07-11T00:01:03.878108+0000","last_became_active":"2023-07-11T00:01:02.862850+0000","last_became_peered":"2023-07-11T00:01:02.862850+0000","last_unstale":"2023-07-11T00:01:03.878108+0000","last_undegraded":"2023-07-11T00:01:03.878108+0000","last_fullsized":"2023-07-11T00:01:03.878108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:46:58.034360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.872962+0000","last_change":"2023-07-11T00:01:03.863250+0000","last_active":"2023-07-11T00:01:03.872962+0000","last_peered":"2023-07-11T00:01:03.872962+0000","last_clean":"2023-07-11T00:01:03.872962+0000","last_became_active":"2023-07-11T00:01:03.862779+0000","last_became_peered":"2023-07-11T00:01:03.862779+0000","last_unstale":"2023-07-11T00:01:03.872962+0000","last_undegraded":"2023-07-11T00:01:03.872962+0000","last_fullsized":"2023-07-11T00:01:03.872962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:34:03.703156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874834+0000","last_change":"2023-07-11T00:01:02.862067+0000","last_active":"2023-07-11T00:01:03.874834+0000","last_peered":"2023-07-11T00:01:03.874834+0000","last_clean":"2023-07-11T00:01:03.874834+0000","last_became_active":"2023-07-11T00:01:02.861790+0000","last_became_peered":"2023-07-11T00:01:02.861790+0000","last_unstale":"2023-07-11T00:01:03.874834+0000","last_undegraded":"2023-07-11T00:01:03.874834+0000","last_fullsized":"2023-07-11T00:01:03.874834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:36:19.640355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876180+0000","last_change":"2023-07-11T00:01:03.871316+0000","last_active":"2023-07-11T00:01:03.876180+0000","last_peered":"2023-07-11T00:01:03.876180+0000","last_clean":"2023-07-11T00:01:03.876180+0000","last_became_active":"2023-07-11T00:01:03.871059+0000","last_became_peered":"2023-07-11T00:01:03.871059+0000","last_unstale":"2023-07-11T00:01:03.876180+0000","last_undegraded":"2023-07-11T00:01:03.876180+0000","last_fullsized":"2023-07-11T00:01:03.876180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:42.503741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877088+0000","last_change":"2023-07-11T00:01:02.860729+0000","last_active":"2023-07-11T00:01:03.877088+0000","last_peered":"2023-07-11T00:01:03.877088+0000","last_clean":"2023-07-11T00:01:03.877088+0000","last_became_active":"2023-07-11T00:01:02.860435+0000","last_became_peered":"2023-07-11T00:01:02.860435+0000","last_unstale":"2023-07-11T00:01:03.877088+0000","last_undegraded":"2023-07-11T00:01:03.877088+0000","last_fullsized":"2023-07-11T00:01:03.877088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:27:24.369075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.871452+0000","last_change":"2023-07-11T00:01:03.867217+0000","last_active":"2023-07-11T00:01:03.871452+0000","last_peered":"2023-07-11T00:01:03.871452+0000","last_clean":"2023-07-11T00:01:03.871452+0000","last_became_active":"2023-07-11T00:01:03.866930+0000","last_became_peered":"2023-07-11T00:01:03.866930+0000","last_unstale":"2023-07-11T00:01:03.871452+0000","last_undegraded":"2023-07-11T00:01:03.871452+0000","last_fullsized":"2023-07-11T00:01:03.871452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:34:16.617223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.880227+0000","last_change":"2023-07-11T00:01:02.858258+0000","last_active":"2023-07-11T00:01:03.880227+0000","last_peered":"2023-07-11T00:01:03.880227+0000","last_clean":"2023-07-11T00:01:03.880227+0000","last_became_active":"2023-07-11T00:01:02.858045+0000","last_became_peered":"2023-07-11T00:01:02.858045+0000","last_unstale":"2023-07-11T00:01:03.880227+0000","last_undegraded":"2023-07-11T00:01:03.880227+0000","last_fullsized":"2023-07-11T00:01:03.880227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:25:53.309584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876319+0000","last_change":"2023-07-11T00:01:03.870779+0000","last_active":"2023-07-11T00:01:03.876319+0000","last_peered":"2023-07-11T00:01:03.876319+0000","last_clean":"2023-07-11T00:01:03.876319+0000","last_became_active":"2023-07-11T00:01:03.870493+0000","last_became_peered":"2023-07-11T00:01:03.870493+0000","last_unstale":"2023-07-11T00:01:03.876319+0000","last_undegraded":"2023-07-11T00:01:03.876319+0000","last_fullsized":"2023-07-11T00:01:03.876319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:03:58.067794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860601+0000","last_change":"2023-07-11T00:01:02.859815+0000","last_active":"2023-07-11T00:01:03.860601+0000","last_peered":"2023-07-11T00:01:03.860601+0000","last_clean":"2023-07-11T00:01:03.860601+0000","last_became_active":"2023-07-11T00:01:02.859519+0000","last_became_peered":"2023-07-11T00:01:02.859519+0000","last_unstale":"2023-07-11T00:01:03.860601+0000","last_undegraded":"2023-07-11T00:01:03.860601+0000","last_fullsized":"2023-07-11T00:01:03.860601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:07.864833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876746+0000","last_change":"2023-07-11T00:01:03.875788+0000","last_active":"2023-07-11T00:01:03.876746+0000","last_peered":"2023-07-11T00:01:03.876746+0000","last_clean":"2023-07-11T00:01:03.876746+0000","last_became_active":"2023-07-11T00:01:03.875552+0000","last_became_peered":"2023-07-11T00:01:03.875552+0000","last_unstale":"2023-07-11T00:01:03.876746+0000","last_undegraded":"2023-07-11T00:01:03.876746+0000","last_fullsized":"2023-07-11T00:01:03.876746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:05:14.562955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.880284+0000","last_change":"2023-07-11T00:01:02.863459+0000","last_active":"2023-07-11T00:01:03.880284+0000","last_peered":"2023-07-11T00:01:03.880284+0000","last_clean":"2023-07-11T00:01:03.880284+0000","last_became_active":"2023-07-11T00:01:02.863213+0000","last_became_peered":"2023-07-11T00:01:02.863213+0000","last_unstale":"2023-07-11T00:01:03.880284+0000","last_undegraded":"2023-07-11T00:01:03.880284+0000","last_fullsized":"2023-07-11T00:01:03.880284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:28:12.038469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873706+0000","last_change":"2023-07-11T00:01:03.863207+0000","last_active":"2023-07-11T00:01:03.873706+0000","last_peered":"2023-07-11T00:01:03.873706+0000","last_clean":"2023-07-11T00:01:03.873706+0000","last_became_active":"2023-07-11T00:01:03.862901+0000","last_became_peered":"2023-07-11T00:01:03.862901+0000","last_unstale":"2023-07-11T00:01:03.873706+0000","last_undegraded":"2023-07-11T00:01:03.873706+0000","last_fullsized":"2023-07-11T00:01:03.873706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:33:33.634073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.855326+0000","last_change":"2023-07-11T00:01:02.854752+0000","last_active":"2023-07-11T00:01:03.855326+0000","last_peered":"2023-07-11T00:01:03.855326+0000","last_clean":"2023-07-11T00:01:03.855326+0000","last_became_active":"2023-07-11T00:01:02.854449+0000","last_became_peered":"2023-07-11T00:01:02.854449+0000","last_unstale":"2023-07-11T00:01:03.855326+0000","last_undegraded":"2023-07-11T00:01:03.855326+0000","last_fullsized":"2023-07-11T00:01:03.855326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:53:26.141943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.865899+0000","last_change":"2023-07-11T00:01:03.864139+0000","last_active":"2023-07-11T00:01:03.865899+0000","last_peered":"2023-07-11T00:01:03.865899+0000","last_clean":"2023-07-11T00:01:03.865899+0000","last_became_active":"2023-07-11T00:01:03.863868+0000","last_became_peered":"2023-07-11T00:01:03.863868+0000","last_unstale":"2023-07-11T00:01:03.865899+0000","last_undegraded":"2023-07-11T00:01:03.865899+0000","last_fullsized":"2023-07-11T00:01:03.865899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:40:45.434809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860697+0000","last_change":"2023-07-11T00:01:02.863337+0000","last_active":"2023-07-11T00:01:03.860697+0000","last_peered":"2023-07-11T00:01:03.860697+0000","last_clean":"2023-07-11T00:01:03.860697+0000","last_became_active":"2023-07-11T00:01:02.863093+0000","last_became_peered":"2023-07-11T00:01:02.863093+0000","last_unstale":"2023-07-11T00:01:03.860697+0000","last_undegraded":"2023-07-11T00:01:03.860697+0000","last_fullsized":"2023-07-11T00:01:03.860697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:43:36.190524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873007+0000","last_change":"2023-07-11T00:01:03.863792+0000","last_active":"2023-07-11T00:01:03.873007+0000","last_peered":"2023-07-11T00:01:03.873007+0000","last_clean":"2023-07-11T00:01:03.873007+0000","last_became_active":"2023-07-11T00:01:03.863488+0000","last_became_peered":"2023-07-11T00:01:03.863488+0000","last_unstale":"2023-07-11T00:01:03.873007+0000","last_undegraded":"2023-07-11T00:01:03.873007+0000","last_fullsized":"2023-07-11T00:01:03.873007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:33:35.435035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.853817+0000","last_change":"2023-07-11T00:01:02.861955+0000","last_active":"2023-07-11T00:01:03.853817+0000","last_peered":"2023-07-11T00:01:03.853817+0000","last_clean":"2023-07-11T00:01:03.853817+0000","last_became_active":"2023-07-11T00:01:02.861663+0000","last_became_peered":"2023-07-11T00:01:02.861663+0000","last_unstale":"2023-07-11T00:01:03.853817+0000","last_undegraded":"2023-07-11T00:01:03.853817+0000","last_fullsized":"2023-07-11T00:01:03.853817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:24:27.967495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877012+0000","last_change":"2023-07-11T00:01:03.874802+0000","last_active":"2023-07-11T00:01:03.877012+0000","last_peered":"2023-07-11T00:01:03.877012+0000","last_clean":"2023-07-11T00:01:03.877012+0000","last_became_active":"2023-07-11T00:01:03.874549+0000","last_became_peered":"2023-07-11T00:01:03.874549+0000","last_unstale":"2023-07-11T00:01:03.877012+0000","last_undegraded":"2023-07-11T00:01:03.877012+0000","last_fullsized":"2023-07-11T00:01:03.877012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:47:36.952910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.849756+0000","last_change":"2023-07-11T00:01:02.866039+0000","last_active":"2023-07-11T00:01:03.849756+0000","last_peered":"2023-07-11T00:01:03.849756+0000","last_clean":"2023-07-11T00:01:03.849756+0000","last_became_active":"2023-07-11T00:01:02.865740+0000","last_became_peered":"2023-07-11T00:01:02.865740+0000","last_unstale":"2023-07-11T00:01:03.849756+0000","last_undegraded":"2023-07-11T00:01:03.849756+0000","last_fullsized":"2023-07-11T00:01:03.849756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:53:40.237446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.850452+0000","last_change":"2023-07-11T00:00:11.737777+0000","last_active":"2023-07-11T00:01:03.850452+0000","last_peered":"2023-07-11T00:01:03.850452+0000","last_clean":"2023-07-11T00:01:03.850452+0000","last_became_active":"2023-07-11T00:00:11.737518+0000","last_became_peered":"2023-07-11T00:00:11.737518+0000","last_unstale":"2023-07-11T00:01:03.850452+0000","last_undegraded":"2023-07-11T00:01:03.850452+0000","last_fullsized":"2023-07-11T00:01:03.850452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:40:36.580854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.869900+0000","last_change":"2023-07-11T00:01:03.863286+0000","last_active":"2023-07-11T00:01:03.869900+0000","last_peered":"2023-07-11T00:01:03.869900+0000","last_clean":"2023-07-11T00:01:03.869900+0000","last_became_active":"2023-07-11T00:01:03.862978+0000","last_became_peered":"2023-07-11T00:01:03.862978+0000","last_unstale":"2023-07-11T00:01:03.869900+0000","last_undegraded":"2023-07-11T00:01:03.869900+0000","last_fullsized":"2023-07-11T00:01:03.869900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:38:34.159024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.858432+0000","last_change":"2023-07-11T00:01:02.866639+0000","last_active":"2023-07-11T00:01:03.858432+0000","last_peered":"2023-07-11T00:01:03.858432+0000","last_clean":"2023-07-11T00:01:03.858432+0000","last_became_active":"2023-07-11T00:01:02.866297+0000","last_became_peered":"2023-07-11T00:01:02.866297+0000","last_unstale":"2023-07-11T00:01:03.858432+0000","last_undegraded":"2023-07-11T00:01:03.858432+0000","last_fullsized":"2023-07-11T00:01:03.858432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:46:03.697648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860440+0000","last_change":"2023-07-11T00:00:11.270609+0000","last_active":"2023-07-11T00:01:03.860440+0000","last_peered":"2023-07-11T00:01:03.860440+0000","last_clean":"2023-07-11T00:01:03.860440+0000","last_became_active":"2023-07-11T00:00:11.270289+0000","last_became_peered":"2023-07-11T00:00:11.270289+0000","last_unstale":"2023-07-11T00:01:03.860440+0000","last_undegraded":"2023-07-11T00:01:03.860440+0000","last_fullsized":"2023-07-11T00:01:03.860440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:04:15.587394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.870241+0000","last_change":"2023-07-11T00:01:03.865834+0000","last_active":"2023-07-11T00:01:03.870241+0000","last_peered":"2023-07-11T00:01:03.870241+0000","last_clean":"2023-07-11T00:01:03.870241+0000","last_became_active":"2023-07-11T00:01:03.865526+0000","last_became_peered":"2023-07-11T00:01:03.865526+0000","last_unstale":"2023-07-11T00:01:03.870241+0000","last_undegraded":"2023-07-11T00:01:03.870241+0000","last_fullsized":"2023-07-11T00:01:03.870241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:22:33.824631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.875093+0000","last_change":"2023-07-11T00:01:02.864849+0000","last_active":"2023-07-11T00:01:03.875093+0000","last_peered":"2023-07-11T00:01:03.875093+0000","last_clean":"2023-07-11T00:01:03.875093+0000","last_became_active":"2023-07-11T00:01:02.864519+0000","last_became_peered":"2023-07-11T00:01:02.864519+0000","last_unstale":"2023-07-11T00:01:03.875093+0000","last_undegraded":"2023-07-11T00:01:03.875093+0000","last_fullsized":"2023-07-11T00:01:03.875093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:34:02.698221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.859964+0000","last_change":"2023-07-11T00:00:11.269546+0000","last_active":"2023-07-11T00:01:03.859964+0000","last_peered":"2023-07-11T00:01:03.859964+0000","last_clean":"2023-07-11T00:01:03.859964+0000","last_became_active":"2023-07-11T00:00:11.269178+0000","last_became_peered":"2023-07-11T00:00:11.269178+0000","last_unstale":"2023-07-11T00:01:03.859964+0000","last_undegraded":"2023-07-11T00:01:03.859964+0000","last_fullsized":"2023-07-11T00:01:03.859964+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:00:27.446817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":181,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.857068+0000","last_change":"2023-07-11T00:00:11.270402+0000","last_active":"2023-07-11T00:01:03.857068+0000","last_peered":"2023-07-11T00:01:03.857068+0000","last_clean":"2023-07-11T00:01:03.857068+0000","last_became_active":"2023-07-11T00:00:11.270024+0000","last_became_peered":"2023-07-11T00:00:11.270024+0000","last_unstale":"2023-07-11T00:01:03.857068+0000","last_undegraded":"2023-07-11T00:01:03.857068+0000","last_fullsized":"2023-07-11T00:01:03.857068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:33:11.109888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.869931+0000","last_change":"2023-07-11T00:01:03.864925+0000","last_active":"2023-07-11T00:01:03.869931+0000","last_peered":"2023-07-11T00:01:03.869931+0000","last_clean":"2023-07-11T00:01:03.869931+0000","last_became_active":"2023-07-11T00:01:03.864239+0000","last_became_peered":"2023-07-11T00:01:03.864239+0000","last_unstale":"2023-07-11T00:01:03.869931+0000","last_undegraded":"2023-07-11T00:01:03.869931+0000","last_fullsized":"2023-07-11T00:01:03.869931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:33:35.435035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.856960+0000","last_change":"2023-07-11T00:01:02.860340+0000","last_active":"2023-07-11T00:01:03.856960+0000","last_peered":"2023-07-11T00:01:03.856960+0000","last_clean":"2023-07-11T00:01:03.856960+0000","last_became_active":"2023-07-11T00:01:02.859982+0000","last_became_peered":"2023-07-11T00:01:02.859982+0000","last_unstale":"2023-07-11T00:01:03.856960+0000","last_undegraded":"2023-07-11T00:01:03.856960+0000","last_fullsized":"2023-07-11T00:01:03.856960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:29:46.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.856708+0000","last_change":"2023-07-11T00:00:11.518743+0000","last_active":"2023-07-11T00:01:03.856708+0000","last_peered":"2023-07-11T00:01:03.856708+0000","last_clean":"2023-07-11T00:01:03.856708+0000","last_became_active":"2023-07-11T00:00:11.518395+0000","last_became_peered":"2023-07-11T00:00:11.518395+0000","last_unstale":"2023-07-11T00:01:03.856708+0000","last_undegraded":"2023-07-11T00:01:03.856708+0000","last_fullsized":"2023-07-11T00:01:03.856708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:33:46.317368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876920+0000","last_change":"2023-07-11T00:01:03.875245+0000","last_active":"2023-07-11T00:01:03.876920+0000","last_peered":"2023-07-11T00:01:03.876920+0000","last_clean":"2023-07-11T00:01:03.876920+0000","last_became_active":"2023-07-11T00:01:03.874562+0000","last_became_peered":"2023-07-11T00:01:03.874562+0000","last_unstale":"2023-07-11T00:01:03.876920+0000","last_undegraded":"2023-07-11T00:01:03.876920+0000","last_fullsized":"2023-07-11T00:01:03.876920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:34:38.910637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.857955+0000","last_change":"2023-07-11T00:01:02.866458+0000","last_active":"2023-07-11T00:01:03.857955+0000","last_peered":"2023-07-11T00:01:03.857955+0000","last_clean":"2023-07-11T00:01:03.857955+0000","last_became_active":"2023-07-11T00:01:02.866141+0000","last_became_peered":"2023-07-11T00:01:02.866141+0000","last_unstale":"2023-07-11T00:01:03.857955+0000","last_undegraded":"2023-07-11T00:01:03.857955+0000","last_fullsized":"2023-07-11T00:01:03.857955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:12:33.039015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.856932+0000","last_change":"2023-07-11T00:00:11.518875+0000","last_active":"2023-07-11T00:01:03.856932+0000","last_peered":"2023-07-11T00:01:03.856932+0000","last_clean":"2023-07-11T00:01:03.856932+0000","last_became_active":"2023-07-11T00:00:11.518595+0000","last_became_peered":"2023-07-11T00:00:11.518595+0000","last_unstale":"2023-07-11T00:01:03.856932+0000","last_undegraded":"2023-07-11T00:01:03.856932+0000","last_fullsized":"2023-07-11T00:01:03.856932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:35:28.052022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.872126+0000","last_change":"2023-07-11T00:01:03.862855+0000","last_active":"2023-07-11T00:01:03.872126+0000","last_peered":"2023-07-11T00:01:03.872126+0000","last_clean":"2023-07-11T00:01:03.872126+0000","last_became_active":"2023-07-11T00:01:03.862555+0000","last_became_peered":"2023-07-11T00:01:03.862555+0000","last_unstale":"2023-07-11T00:01:03.872126+0000","last_undegraded":"2023-07-11T00:01:03.872126+0000","last_fullsized":"2023-07-11T00:01:03.872126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:38:34.159024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.850278+0000","last_change":"2023-07-11T00:01:02.862126+0000","last_active":"2023-07-11T00:01:03.850278+0000","last_peered":"2023-07-11T00:01:03.850278+0000","last_clean":"2023-07-11T00:01:03.850278+0000","last_became_active":"2023-07-11T00:01:02.861786+0000","last_became_peered":"2023-07-11T00:01:02.861786+0000","last_unstale":"2023-07-11T00:01:03.850278+0000","last_undegraded":"2023-07-11T00:01:03.850278+0000","last_fullsized":"2023-07-11T00:01:03.850278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:47:24.294767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860652+0000","last_change":"2023-07-11T00:00:11.518769+0000","last_active":"2023-07-11T00:01:03.860652+0000","last_peered":"2023-07-11T00:01:03.860652+0000","last_clean":"2023-07-11T00:01:03.860652+0000","last_became_active":"2023-07-11T00:00:11.518440+0000","last_became_peered":"2023-07-11T00:00:11.518440+0000","last_unstale":"2023-07-11T00:01:03.860652+0000","last_undegraded":"2023-07-11T00:01:03.860652+0000","last_fullsized":"2023-07-11T00:01:03.860652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:46:06.446026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.870915+0000","last_change":"2023-07-11T00:01:03.865690+0000","last_active":"2023-07-11T00:01:03.870915+0000","last_peered":"2023-07-11T00:01:03.870915+0000","last_clean":"2023-07-11T00:01:03.870915+0000","last_became_active":"2023-07-11T00:01:03.865375+0000","last_became_peered":"2023-07-11T00:01:03.865375+0000","last_unstale":"2023-07-11T00:01:03.870915+0000","last_undegraded":"2023-07-11T00:01:03.870915+0000","last_fullsized":"2023-07-11T00:01:03.870915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:33:33.634073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.850254+0000","last_change":"2023-07-11T00:01:02.862708+0000","last_active":"2023-07-11T00:01:03.850254+0000","last_peered":"2023-07-11T00:01:03.850254+0000","last_clean":"2023-07-11T00:01:03.850254+0000","last_became_active":"2023-07-11T00:01:02.862404+0000","last_became_peered":"2023-07-11T00:01:02.862404+0000","last_unstale":"2023-07-11T00:01:03.850254+0000","last_undegraded":"2023-07-11T00:01:03.850254+0000","last_fullsized":"2023-07-11T00:01:03.850254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:04:14.263517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.849938+0000","last_change":"2023-07-11T00:00:11.518696+0000","last_active":"2023-07-11T00:01:03.849938+0000","last_peered":"2023-07-11T00:01:03.849938+0000","last_clean":"2023-07-11T00:01:03.849938+0000","last_became_active":"2023-07-11T00:00:11.518413+0000","last_became_peered":"2023-07-11T00:00:11.518413+0000","last_unstale":"2023-07-11T00:01:03.849938+0000","last_undegraded":"2023-07-11T00:01:03.849938+0000","last_fullsized":"2023-07-11T00:01:03.849938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:34:16.276499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873904+0000","last_change":"2023-07-11T00:01:03.868847+0000","last_active":"2023-07-11T00:01:03.873904+0000","last_peered":"2023-07-11T00:01:03.873904+0000","last_clean":"2023-07-11T00:01:03.873904+0000","last_became_active":"2023-07-11T00:01:03.868393+0000","last_became_peered":"2023-07-11T00:01:03.868393+0000","last_unstale":"2023-07-11T00:01:03.873904+0000","last_undegraded":"2023-07-11T00:01:03.873904+0000","last_fullsized":"2023-07-11T00:01:03.873904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:01:20.040086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.850719+0000","last_change":"2023-07-11T00:01:02.862969+0000","last_active":"2023-07-11T00:01:03.850719+0000","last_peered":"2023-07-11T00:01:03.850719+0000","last_clean":"2023-07-11T00:01:03.850719+0000","last_became_active":"2023-07-11T00:01:02.862647+0000","last_became_peered":"2023-07-11T00:01:02.862647+0000","last_unstale":"2023-07-11T00:01:03.850719+0000","last_undegraded":"2023-07-11T00:01:03.850719+0000","last_fullsized":"2023-07-11T00:01:03.850719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:07.864833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.849671+0000","last_change":"2023-07-11T00:00:11.269674+0000","last_active":"2023-07-11T00:01:03.849671+0000","last_peered":"2023-07-11T00:01:03.849671+0000","last_clean":"2023-07-11T00:01:03.849671+0000","last_became_active":"2023-07-11T00:00:11.269355+0000","last_became_peered":"2023-07-11T00:00:11.269355+0000","last_unstale":"2023-07-11T00:01:03.849671+0000","last_undegraded":"2023-07-11T00:01:03.849671+0000","last_fullsized":"2023-07-11T00:01:03.849671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:46:32.706434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":717359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":717359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":135717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:01:08.014 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-11T00:01:08.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.170+0000 7fc566c58700 1 Processor -- start 2023-07-11T00:01:08.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.170+0000 7fc566c58700 1 -- start start 2023-07-11T00:01:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc566c58700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc5600b6ce0 0x7fc56014a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc566c58700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc5600b5a10 0x7fc56014ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc566c58700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5600b5f00 con 0x7fc560144820 2023-07-11T00:01:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc566c58700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5600b61e0 con 0x7fc5600b6ce0 2023-07-11T00:01:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc566c58700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5600c17d0 con 0x7fc5600b5a10 2023-07-11T00:01:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc557fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc5600b6ce0 0x7fc56014a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc557fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc5600b6ce0 0x7fc56014a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59168/0 (socket says 172.21.15.38:59168) 2023-07-11T00:01:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc557fff700 1 -- 172.21.15.38:0/3804186243 learned_addr learned my addr 172.21.15.38:0/3804186243 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc5651f5700 1 --2- 172.21.15.38:0/3804186243 >> v2:172.21.15.70:3300/0 conn(0x7fc5600b5a10 0x7fc56014ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc557fff700 1 -- 172.21.15.38:0/3804186243 >> v2:172.21.15.70:3300/0 conn(0x7fc5600b5a10 msgr2=0x7fc56014ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc557fff700 1 --2- 172.21.15.38:0/3804186243 >> v2:172.21.15.70:3300/0 conn(0x7fc5600b5a10 0x7fc56014ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc557fff700 1 -- 172.21.15.38:0/3804186243 >> v1:172.21.15.70:6789/0 conn(0x7fc560144820 legacy=0x7fc5600b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.171+0000 7fc557fff700 1 -- 172.21.15.38:0/3804186243 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5600b7160 con 0x7fc5600b6ce0 2023-07-11T00:01:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.172+0000 7fc557fff700 1 --2- 172.21.15.38:0/3804186243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5600b6ce0 0x7fc56014a800 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc56006cff0 tx=0x7fc550009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564387327db54b2e server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.172+0000 7fc5577fe700 1 -- 172.21.15.38:0/3804186243 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550011830 con 0x7fc5600b6ce0 2023-07-11T00:01:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.172+0000 7fc5577fe700 1 -- 172.21.15.38:0/3804186243 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc550011990 con 0x7fc5600b6ce0 2023-07-11T00:01:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.172+0000 7fc5577fe700 1 -- 172.21.15.38:0/3804186243 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550011d20 con 0x7fc5600b6ce0 2023-07-11T00:01:08.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.172+0000 7fc566c58700 1 -- 172.21.15.38:0/3804186243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5600b6ce0 msgr2=0x7fc56014a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.172+0000 7fc566c58700 1 --2- 172.21.15.38:0/3804186243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5600b6ce0 0x7fc56014a800 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc56006cff0 tx=0x7fc550009bd0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.172+0000 7fc566c58700 1 -- 172.21.15.38:0/3804186243 shutdown_connections 2023-07-11T00:01:08.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.172+0000 7fc566c58700 1 --2- 172.21.15.38:0/3804186243 >> v2:172.21.15.70:3300/0 conn(0x7fc5600b5a10 0x7fc56014ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.172+0000 7fc566c58700 1 --2- 172.21.15.38:0/3804186243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5600b6ce0 0x7fc56014a800 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.172+0000 7fc566c58700 1 -- 172.21.15.38:0/3804186243 >> 172.21.15.38:0/3804186243 conn(0x7fc5600c08f0 msgr2=0x7fc5600c0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:08.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.172+0000 7fc566c58700 1 -- 172.21.15.38:0/3804186243 shutdown_connections 2023-07-11T00:01:08.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.173+0000 7fc566c58700 1 -- 172.21.15.38:0/3804186243 wait complete. 2023-07-11T00:01:08.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.174+0000 7fc566c58700 1 Processor -- start 2023-07-11T00:01:08.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.174+0000 7fc566c58700 1 -- start start 2023-07-11T00:01:08.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.174+0000 7fc566c58700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5600b5a10 0x7fc5601456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:08.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.174+0000 7fc566c58700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc560144820 0x7fc5601473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:08.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.174+0000 7fc566c58700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc560147900 0x7fc5601e0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:08.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.174+0000 7fc566c58700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc560145c20 con 0x7fc560147900 2023-07-11T00:01:08.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.174+0000 7fc566c58700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56013e750 con 0x7fc5600b5a10 2023-07-11T00:01:08.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.174+0000 7fc566c58700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc560145200 con 0x7fc560144820 2023-07-11T00:01:08.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.174+0000 7fc5651f5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc560147900 0x7fc5601e0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:08.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.174+0000 7fc5651f5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc560147900 0x7fc5601e0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59172/0 (socket says 172.21.15.38:59172) 2023-07-11T00:01:08.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.174+0000 7fc5651f5700 1 -- 172.21.15.38:0/3312903076 learned_addr learned my addr 172.21.15.38:0/3312903076 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:08.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc557fff700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc560144820 0x7fc5601473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:08.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc5649f4700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5600b5a10 0x7fc5601456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:08.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc5651f5700 1 -- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc560144820 msgr2=0x7fc5601473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc5651f5700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc560144820 0x7fc5601473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc5651f5700 1 -- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5600b5a10 msgr2=0x7fc5601456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc5651f5700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5600b5a10 0x7fc5601456e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc5651f5700 1 -- 172.21.15.38:0/3312903076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc550009550 con 0x7fc560147900 2023-07-11T00:01:08.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc5649f4700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5600b5a10 0x7fc5601456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:01:08.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc5651f5700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc560147900 0x7fc5601e0520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc558009cb0 tx=0x7fc55800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:08.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc5557fa700 1 -- 172.21.15.38:0/3312903076 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558009b20 con 0x7fc560147900 2023-07-11T00:01:08.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc5557fa700 1 -- 172.21.15.38:0/3312903076 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55800f040 con 0x7fc560147900 2023-07-11T00:01:08.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc5557fa700 1 -- 172.21.15.38:0/3312903076 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55800cde0 con 0x7fc560147900 2023-07-11T00:01:08.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc566c58700 1 -- 172.21.15.38:0/3312903076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc560146e00 con 0x7fc560147900 2023-07-11T00:01:08.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.175+0000 7fc566c58700 1 -- 172.21.15.38:0/3312903076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5601d6eb0 con 0x7fc560147900 2023-07-11T00:01:08.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.176+0000 7fc566c58700 1 -- 172.21.15.38:0/3312903076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5601d70a0 con 0x7fc560147900 2023-07-11T00:01:08.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.176+0000 7fc5557fa700 1 -- 172.21.15.38:0/3312903076 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc558014480 con 0x7fc560147900 2023-07-11T00:01:08.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.177+0000 7fc5557fa700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc54c06ace0 0x7fc54c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:08.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.177+0000 7fc5557fa700 1 -- 172.21.15.38:0/3312903076 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc558089f90 con 0x7fc560147900 2023-07-11T00:01:08.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.177+0000 7fc5649f4700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc54c06ace0 0x7fc54c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:08.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.178+0000 7fc5649f4700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc54c06ace0 0x7fc54c06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc55c000f60 tx=0x7fc55c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:08.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.182+0000 7fc5557fa700 1 -- 172.21.15.38:0/3312903076 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc5580bc380 con 0x7fc560147900 2023-07-11T00:01:08.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.375+0000 7fc566c58700 1 -- 172.21.15.38:0/3312903076 --> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc560144bf0 con 0x7fc54c06ace0 2023-07-11T00:01:08.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.383+0000 7fc5557fa700 1 -- 172.21.15.38:0/3312903076 <== mgr.4105 v2:172.21.15.70:6832/2073477499 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286928 (secure 0 0 0) 0x7fc55c0014f0 con 0x7fc54c06ace0 2023-07-11T00:01:08.388 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:01:08.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 -- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc54c06ace0 msgr2=0x7fc54c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc54c06ace0 0x7fc54c06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc55c000f60 tx=0x7fc55c009040 comp rx=0 tx=0).stop 2023-07-11T00:01:08.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 -- 172.21.15.38:0/3312903076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc560147900 msgr2=0x7fc5601e0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc560147900 0x7fc5601e0520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc558009cb0 tx=0x7fc55800c0c0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 -- 172.21.15.38:0/3312903076 shutdown_connections 2023-07-11T00:01:08.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fc54c06ace0 0x7fc54c06d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc560147900 0x7fc5601e0520 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5600b5a10 0x7fc5601456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 --2- 172.21.15.38:0/3312903076 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc560144820 0x7fc5601473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 -- 172.21.15.38:0/3312903076 >> 172.21.15.38:0/3312903076 conn(0x7fc5600c08f0 msgr2=0x7fc5600be7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:08.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 -- 172.21.15.38:0/3312903076 shutdown_connections 2023-07-11T00:01:08.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.386+0000 7fc566c58700 1 -- 172.21.15.38:0/3312903076 wait complete. 2023-07-11T00:01:08.392 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-07-11T00:01:08.400 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-07-11T00:01:07.961854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219912,"kb_used_data":3716,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754808,"statfs":{"total":773094113280,"available":772868923392,"internally_reserved":0,"allocated":3805184,"data_stored":2205390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001503"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.879930+0000","last_change":"2023-07-11T00:01:03.874198+0000","last_active":"2023-07-11T00:01:03.879930+0000","last_peered":"2023-07-11T00:01:03.879930+0000","last_clean":"2023-07-11T00:01:03.879930+0000","last_became_active":"2023-07-11T00:01:03.873880+0000","last_became_peered":"2023-07-11T00:01:03.873880+0000","last_unstale":"2023-07-11T00:01:03.879930+0000","last_undegraded":"2023-07-11T00:01:03.879930+0000","last_fullsized":"2023-07-11T00:01:03.879930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:01:09.577811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877482+0000","last_change":"2023-07-11T00:01:03.870700+0000","last_active":"2023-07-11T00:01:03.877482+0000","last_peered":"2023-07-11T00:01:03.877482+0000","last_clean":"2023-07-11T00:01:03.877482+0000","last_became_active":"2023-07-11T00:01:03.870419+0000","last_became_peered":"2023-07-11T00:01:03.870419+0000","last_unstale":"2023-07-11T00:01:03.877482+0000","last_undegraded":"2023-07-11T00:01:03.877482+0000","last_fullsized":"2023-07-11T00:01:03.877482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:51:04.426268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874106+0000","last_change":"2023-07-11T00:01:03.867383+0000","last_active":"2023-07-11T00:01:03.874106+0000","last_peered":"2023-07-11T00:01:03.874106+0000","last_clean":"2023-07-11T00:01:03.874106+0000","last_became_active":"2023-07-11T00:01:03.867069+0000","last_became_peered":"2023-07-11T00:01:03.867069+0000","last_unstale":"2023-07-11T00:01:03.874106+0000","last_undegraded":"2023-07-11T00:01:03.874106+0000","last_fullsized":"2023-07-11T00:01:03.874106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:40:45.434809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877131+0000","last_change":"2023-07-11T00:01:03.869075+0000","last_active":"2023-07-11T00:01:03.877131+0000","last_peered":"2023-07-11T00:01:03.877131+0000","last_clean":"2023-07-11T00:01:03.877131+0000","last_became_active":"2023-07-11T00:01:03.868752+0000","last_became_peered":"2023-07-11T00:01:03.868752+0000","last_unstale":"2023-07-11T00:01:03.877131+0000","last_undegraded":"2023-07-11T00:01:03.877131+0000","last_fullsized":"2023-07-11T00:01:03.877131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:10:25.054581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.872709+0000","last_change":"2023-07-11T00:01:03.861295+0000","last_active":"2023-07-11T00:01:03.872709+0000","last_peered":"2023-07-11T00:01:03.872709+0000","last_clean":"2023-07-11T00:01:03.872709+0000","last_became_active":"2023-07-11T00:01:03.861027+0000","last_became_peered":"2023-07-11T00:01:03.861027+0000","last_unstale":"2023-07-11T00:01:03.872709+0000","last_undegraded":"2023-07-11T00:01:03.872709+0000","last_fullsized":"2023-07-11T00:01:03.872709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:09:26.708017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877287+0000","last_change":"2023-07-11T00:01:03.872036+0000","last_active":"2023-07-11T00:01:03.877287+0000","last_peered":"2023-07-11T00:01:03.877287+0000","last_clean":"2023-07-11T00:01:03.877287+0000","last_became_active":"2023-07-11T00:01:03.871723+0000","last_became_peered":"2023-07-11T00:01:03.871723+0000","last_unstale":"2023-07-11T00:01:03.877287+0000","last_undegraded":"2023-07-11T00:01:03.877287+0000","last_fullsized":"2023-07-11T00:01:03.877287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:32:35.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877041+0000","last_change":"2023-07-11T00:01:03.875001+0000","last_active":"2023-07-11T00:01:03.877041+0000","last_peered":"2023-07-11T00:01:03.877041+0000","last_clean":"2023-07-11T00:01:03.877041+0000","last_became_active":"2023-07-11T00:01:03.874677+0000","last_became_peered":"2023-07-11T00:01:03.874677+0000","last_unstale":"2023-07-11T00:01:03.877041+0000","last_undegraded":"2023-07-11T00:01:03.877041+0000","last_fullsized":"2023-07-11T00:01:03.877041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:30.332160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.872498+0000","last_change":"2023-07-11T00:01:03.868412+0000","last_active":"2023-07-11T00:01:03.872498+0000","last_peered":"2023-07-11T00:01:03.872498+0000","last_clean":"2023-07-11T00:01:03.872498+0000","last_became_active":"2023-07-11T00:01:03.868131+0000","last_became_peered":"2023-07-11T00:01:03.868131+0000","last_unstale":"2023-07-11T00:01:03.872498+0000","last_undegraded":"2023-07-11T00:01:03.872498+0000","last_fullsized":"2023-07-11T00:01:03.872498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:43:37.195459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873680+0000","last_change":"2023-07-11T00:01:03.867323+0000","last_active":"2023-07-11T00:01:03.873680+0000","last_peered":"2023-07-11T00:01:03.873680+0000","last_clean":"2023-07-11T00:01:03.873680+0000","last_became_active":"2023-07-11T00:01:03.866917+0000","last_became_peered":"2023-07-11T00:01:03.866917+0000","last_unstale":"2023-07-11T00:01:03.873680+0000","last_undegraded":"2023-07-11T00:01:03.873680+0000","last_fullsized":"2023-07-11T00:01:03.873680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:06:13.772121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.866936+0000","last_change":"2023-07-11T00:01:03.865446+0000","last_active":"2023-07-11T00:01:03.866936+0000","last_peered":"2023-07-11T00:01:03.866936+0000","last_clean":"2023-07-11T00:01:03.866936+0000","last_became_active":"2023-07-11T00:01:03.865197+0000","last_became_peered":"2023-07-11T00:01:03.865197+0000","last_unstale":"2023-07-11T00:01:03.866936+0000","last_undegraded":"2023-07-11T00:01:03.866936+0000","last_fullsized":"2023-07-11T00:01:03.866936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:08.869768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.864642+0000","last_change":"2023-07-11T00:01:03.862298+0000","last_active":"2023-07-11T00:01:03.864642+0000","last_peered":"2023-07-11T00:01:03.864642+0000","last_clean":"2023-07-11T00:01:03.864642+0000","last_became_active":"2023-07-11T00:01:03.862009+0000","last_became_peered":"2023-07-11T00:01:03.862009+0000","last_unstale":"2023-07-11T00:01:03.864642+0000","last_undegraded":"2023-07-11T00:01:03.864642+0000","last_fullsized":"2023-07-11T00:01:03.864642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:04:15.268452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873716+0000","last_change":"2023-07-11T00:01:03.867038+0000","last_active":"2023-07-11T00:01:03.873716+0000","last_peered":"2023-07-11T00:01:03.873716+0000","last_clean":"2023-07-11T00:01:03.873716+0000","last_became_active":"2023-07-11T00:01:03.866739+0000","last_became_peered":"2023-07-11T00:01:03.866739+0000","last_unstale":"2023-07-11T00:01:03.873716+0000","last_undegraded":"2023-07-11T00:01:03.873716+0000","last_fullsized":"2023-07-11T00:01:03.873716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:30.332160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.867666+0000","last_change":"2023-07-11T00:01:03.865637+0000","last_active":"2023-07-11T00:01:03.867666+0000","last_peered":"2023-07-11T00:01:03.867666+0000","last_clean":"2023-07-11T00:01:03.867666+0000","last_became_active":"2023-07-11T00:01:03.865366+0000","last_became_peered":"2023-07-11T00:01:03.865366+0000","last_unstale":"2023-07-11T00:01:03.867666+0000","last_undegraded":"2023-07-11T00:01:03.867666+0000","last_fullsized":"2023-07-11T00:01:03.867666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:09:08.175808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.853852+0000","last_change":"2023-07-11T00:01:03.852419+0000","last_active":"2023-07-11T00:01:03.853852+0000","last_peered":"2023-07-11T00:01:03.853852+0000","last_clean":"2023-07-11T00:01:03.853852+0000","last_became_active":"2023-07-11T00:01:03.852117+0000","last_became_peered":"2023-07-11T00:01:03.852117+0000","last_unstale":"2023-07-11T00:01:03.853852+0000","last_undegraded":"2023-07-11T00:01:03.853852+0000","last_fullsized":"2023-07-11T00:01:03.853852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:49:34.332245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876182+0000","last_change":"2023-07-11T00:01:03.870796+0000","last_active":"2023-07-11T00:01:03.876182+0000","last_peered":"2023-07-11T00:01:03.876182+0000","last_clean":"2023-07-11T00:01:03.876182+0000","last_became_active":"2023-07-11T00:01:03.870556+0000","last_became_peered":"2023-07-11T00:01:03.870556+0000","last_unstale":"2023-07-11T00:01:03.876182+0000","last_undegraded":"2023-07-11T00:01:03.876182+0000","last_fullsized":"2023-07-11T00:01:03.876182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:06:13.772121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874782+0000","last_change":"2023-07-11T00:01:03.865944+0000","last_active":"2023-07-11T00:01:03.874782+0000","last_peered":"2023-07-11T00:01:03.874782+0000","last_clean":"2023-07-11T00:01:03.874782+0000","last_became_active":"2023-07-11T00:01:03.865488+0000","last_became_peered":"2023-07-11T00:01:03.865488+0000","last_unstale":"2023-07-11T00:01:03.874782+0000","last_undegraded":"2023-07-11T00:01:03.874782+0000","last_fullsized":"2023-07-11T00:01:03.874782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:09:08.175808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874318+0000","last_change":"2023-07-11T00:01:03.867622+0000","last_active":"2023-07-11T00:01:03.874318+0000","last_peered":"2023-07-11T00:01:03.874318+0000","last_clean":"2023-07-11T00:01:03.874318+0000","last_became_active":"2023-07-11T00:01:03.867396+0000","last_became_peered":"2023-07-11T00:01:03.867396+0000","last_unstale":"2023-07-11T00:01:03.874318+0000","last_undegraded":"2023-07-11T00:01:03.874318+0000","last_fullsized":"2023-07-11T00:01:03.874318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:52:21.022767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860359+0000","last_change":"2023-07-11T00:01:03.856340+0000","last_active":"2023-07-11T00:01:03.860359+0000","last_peered":"2023-07-11T00:01:03.860359+0000","last_clean":"2023-07-11T00:01:03.860359+0000","last_became_active":"2023-07-11T00:01:03.856093+0000","last_became_peered":"2023-07-11T00:01:03.856093+0000","last_unstale":"2023-07-11T00:01:03.860359+0000","last_undegraded":"2023-07-11T00:01:03.860359+0000","last_fullsized":"2023-07-11T00:01:03.860359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:33:33.634073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.879708+0000","last_change":"2023-07-11T00:01:03.871607+0000","last_active":"2023-07-11T00:01:03.879708+0000","last_peered":"2023-07-11T00:01:03.879708+0000","last_clean":"2023-07-11T00:01:03.879708+0000","last_became_active":"2023-07-11T00:01:03.871329+0000","last_became_peered":"2023-07-11T00:01:03.871329+0000","last_unstale":"2023-07-11T00:01:03.879708+0000","last_undegraded":"2023-07-11T00:01:03.879708+0000","last_fullsized":"2023-07-11T00:01:03.879708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:26:19.748934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.855032+0000","last_change":"2023-07-11T00:01:03.853399+0000","last_active":"2023-07-11T00:01:03.855032+0000","last_peered":"2023-07-11T00:01:03.855032+0000","last_clean":"2023-07-11T00:01:03.855032+0000","last_became_active":"2023-07-11T00:01:03.853135+0000","last_became_peered":"2023-07-11T00:01:03.853135+0000","last_unstale":"2023-07-11T00:01:03.855032+0000","last_undegraded":"2023-07-11T00:01:03.855032+0000","last_fullsized":"2023-07-11T00:01:03.855032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:28:36.982223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876026+0000","last_change":"2023-07-11T00:01:03.871147+0000","last_active":"2023-07-11T00:01:03.876026+0000","last_peered":"2023-07-11T00:01:03.876026+0000","last_clean":"2023-07-11T00:01:03.876026+0000","last_became_active":"2023-07-11T00:01:03.870854+0000","last_became_peered":"2023-07-11T00:01:03.870854+0000","last_unstale":"2023-07-11T00:01:03.876026+0000","last_undegraded":"2023-07-11T00:01:03.876026+0000","last_fullsized":"2023-07-11T00:01:03.876026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:43:36.518731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876839+0000","last_change":"2023-07-11T00:01:03.872033+0000","last_active":"2023-07-11T00:01:03.876839+0000","last_peered":"2023-07-11T00:01:03.876839+0000","last_clean":"2023-07-11T00:01:03.876839+0000","last_became_active":"2023-07-11T00:01:03.871766+0000","last_became_peered":"2023-07-11T00:01:03.871766+0000","last_unstale":"2023-07-11T00:01:03.876839+0000","last_undegraded":"2023-07-11T00:01:03.876839+0000","last_fullsized":"2023-07-11T00:01:03.876839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:33:23.837762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876715+0000","last_change":"2023-07-11T00:01:03.874198+0000","last_active":"2023-07-11T00:01:03.876715+0000","last_peered":"2023-07-11T00:01:03.876715+0000","last_clean":"2023-07-11T00:01:03.876715+0000","last_became_active":"2023-07-11T00:01:03.873950+0000","last_became_peered":"2023-07-11T00:01:03.873950+0000","last_unstale":"2023-07-11T00:01:03.876715+0000","last_undegraded":"2023-07-11T00:01:03.876715+0000","last_fullsized":"2023-07-11T00:01:03.876715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:14:31.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874135+0000","last_change":"2023-07-11T00:01:03.864976+0000","last_active":"2023-07-11T00:01:03.874135+0000","last_peered":"2023-07-11T00:01:03.874135+0000","last_clean":"2023-07-11T00:01:03.874135+0000","last_became_active":"2023-07-11T00:01:03.864611+0000","last_became_peered":"2023-07-11T00:01:03.864611+0000","last_unstale":"2023-07-11T00:01:03.874135+0000","last_undegraded":"2023-07-11T00:01:03.874135+0000","last_fullsized":"2023-07-11T00:01:03.874135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:46:05.973456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860197+0000","last_change":"2023-07-11T00:01:03.855272+0000","last_active":"2023-07-11T00:01:03.860197+0000","last_peered":"2023-07-11T00:01:03.860197+0000","last_clean":"2023-07-11T00:01:03.860197+0000","last_became_active":"2023-07-11T00:01:03.854998+0000","last_became_peered":"2023-07-11T00:01:03.854998+0000","last_unstale":"2023-07-11T00:01:03.860197+0000","last_undegraded":"2023-07-11T00:01:03.860197+0000","last_fullsized":"2023-07-11T00:01:03.860197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:32:35.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.870887+0000","last_change":"2023-07-11T00:01:03.865852+0000","last_active":"2023-07-11T00:01:03.870887+0000","last_peered":"2023-07-11T00:01:03.870887+0000","last_clean":"2023-07-11T00:01:03.870887+0000","last_became_active":"2023-07-11T00:01:03.865536+0000","last_became_peered":"2023-07-11T00:01:03.865536+0000","last_unstale":"2023-07-11T00:01:03.870887+0000","last_undegraded":"2023-07-11T00:01:03.870887+0000","last_fullsized":"2023-07-11T00:01:03.870887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:04:15.268452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.870853+0000","last_change":"2023-07-11T00:01:03.863487+0000","last_active":"2023-07-11T00:01:03.870853+0000","last_peered":"2023-07-11T00:01:03.870853+0000","last_clean":"2023-07-11T00:01:03.870853+0000","last_became_active":"2023-07-11T00:01:03.861980+0000","last_became_peered":"2023-07-11T00:01:03.861980+0000","last_unstale":"2023-07-11T00:01:03.870853+0000","last_undegraded":"2023-07-11T00:01:03.870853+0000","last_fullsized":"2023-07-11T00:01:03.870853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:30:09.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877017+0000","last_change":"2023-07-11T00:01:03.875416+0000","last_active":"2023-07-11T00:01:03.877017+0000","last_peered":"2023-07-11T00:01:03.877017+0000","last_clean":"2023-07-11T00:01:03.877017+0000","last_became_active":"2023-07-11T00:01:03.875136+0000","last_became_peered":"2023-07-11T00:01:03.875136+0000","last_unstale":"2023-07-11T00:01:03.877017+0000","last_undegraded":"2023-07-11T00:01:03.877017+0000","last_fullsized":"2023-07-11T00:01:03.877017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:01:37.967360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.871647+0000","last_change":"2023-07-11T00:01:03.868485+0000","last_active":"2023-07-11T00:01:03.871647+0000","last_peered":"2023-07-11T00:01:03.871647+0000","last_clean":"2023-07-11T00:01:03.871647+0000","last_became_active":"2023-07-11T00:01:03.868215+0000","last_became_peered":"2023-07-11T00:01:03.868215+0000","last_unstale":"2023-07-11T00:01:03.871647+0000","last_undegraded":"2023-07-11T00:01:03.871647+0000","last_fullsized":"2023-07-11T00:01:03.871647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:22:33.824631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876405+0000","last_change":"2023-07-11T00:01:03.873095+0000","last_active":"2023-07-11T00:01:03.876405+0000","last_peered":"2023-07-11T00:01:03.876405+0000","last_clean":"2023-07-11T00:01:03.876405+0000","last_became_active":"2023-07-11T00:01:03.872794+0000","last_became_peered":"2023-07-11T00:01:03.872794+0000","last_unstale":"2023-07-11T00:01:03.876405+0000","last_undegraded":"2023-07-11T00:01:03.876405+0000","last_fullsized":"2023-07-11T00:01:03.876405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:08:16.724567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874340+0000","last_change":"2023-07-11T00:01:03.870722+0000","last_active":"2023-07-11T00:01:03.874340+0000","last_peered":"2023-07-11T00:01:03.874340+0000","last_clean":"2023-07-11T00:01:03.874340+0000","last_became_active":"2023-07-11T00:01:03.870418+0000","last_became_peered":"2023-07-11T00:01:03.870418+0000","last_unstale":"2023-07-11T00:01:03.874340+0000","last_undegraded":"2023-07-11T00:01:03.874340+0000","last_fullsized":"2023-07-11T00:01:03.874340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:14:30.517707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.878206+0000","last_change":"2023-07-11T00:01:03.875061+0000","last_active":"2023-07-11T00:01:03.878206+0000","last_peered":"2023-07-11T00:01:03.878206+0000","last_clean":"2023-07-11T00:01:03.878206+0000","last_became_active":"2023-07-11T00:01:03.874747+0000","last_became_peered":"2023-07-11T00:01:03.874747+0000","last_unstale":"2023-07-11T00:01:03.878206+0000","last_undegraded":"2023-07-11T00:01:03.878206+0000","last_fullsized":"2023-07-11T00:01:03.878206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:47:25.299702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876554+0000","last_change":"2023-07-11T00:01:03.866236+0000","last_active":"2023-07-11T00:01:03.876554+0000","last_peered":"2023-07-11T00:01:03.876554+0000","last_clean":"2023-07-11T00:01:03.876554+0000","last_became_active":"2023-07-11T00:01:03.865918+0000","last_became_peered":"2023-07-11T00:01:03.865918+0000","last_unstale":"2023-07-11T00:01:03.876554+0000","last_undegraded":"2023-07-11T00:01:03.876554+0000","last_fullsized":"2023-07-11T00:01:03.876554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:51:04.426268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876232+0000","last_change":"2023-07-11T00:01:02.859445+0000","last_active":"2023-07-11T00:01:03.876232+0000","last_peered":"2023-07-11T00:01:03.876232+0000","last_clean":"2023-07-11T00:01:03.876232+0000","last_became_active":"2023-07-11T00:01:02.859159+0000","last_became_peered":"2023-07-11T00:01:02.859159+0000","last_unstale":"2023-07-11T00:01:03.876232+0000","last_undegraded":"2023-07-11T00:01:03.876232+0000","last_fullsized":"2023-07-11T00:01:03.876232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:01:19.035150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.870347+0000","last_change":"2023-07-11T00:01:03.866269+0000","last_active":"2023-07-11T00:01:03.870347+0000","last_peered":"2023-07-11T00:01:03.870347+0000","last_clean":"2023-07-11T00:01:03.870347+0000","last_became_active":"2023-07-11T00:01:03.865981+0000","last_became_peered":"2023-07-11T00:01:03.865981+0000","last_unstale":"2023-07-11T00:01:03.870347+0000","last_undegraded":"2023-07-11T00:01:03.870347+0000","last_fullsized":"2023-07-11T00:01:03.870347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:03:13.440872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876978+0000","last_change":"2023-07-11T00:01:02.860567+0000","last_active":"2023-07-11T00:01:03.876978+0000","last_peered":"2023-07-11T00:01:03.876978+0000","last_clean":"2023-07-11T00:01:03.876978+0000","last_became_active":"2023-07-11T00:01:02.860275+0000","last_became_peered":"2023-07-11T00:01:02.860275+0000","last_unstale":"2023-07-11T00:01:03.876978+0000","last_undegraded":"2023-07-11T00:01:03.876978+0000","last_fullsized":"2023-07-11T00:01:03.876978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:03:12.435937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.856348+0000","last_change":"2023-07-11T00:01:03.854763+0000","last_active":"2023-07-11T00:01:03.856348+0000","last_peered":"2023-07-11T00:01:03.856348+0000","last_clean":"2023-07-11T00:01:03.856348+0000","last_became_active":"2023-07-11T00:01:03.854440+0000","last_became_peered":"2023-07-11T00:01:03.854440+0000","last_unstale":"2023-07-11T00:01:03.856348+0000","last_undegraded":"2023-07-11T00:01:03.856348+0000","last_fullsized":"2023-07-11T00:01:03.856348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:02:44.899952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.878365+0000","last_change":"2023-07-11T00:01:02.859800+0000","last_active":"2023-07-11T00:01:03.878365+0000","last_peered":"2023-07-11T00:01:03.878365+0000","last_clean":"2023-07-11T00:01:03.878365+0000","last_became_active":"2023-07-11T00:01:02.859503+0000","last_became_peered":"2023-07-11T00:01:02.859503+0000","last_unstale":"2023-07-11T00:01:03.878365+0000","last_undegraded":"2023-07-11T00:01:03.878365+0000","last_fullsized":"2023-07-11T00:01:03.878365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:43:35.513796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.872290+0000","last_change":"2023-07-11T00:01:03.864168+0000","last_active":"2023-07-11T00:01:03.872290+0000","last_peered":"2023-07-11T00:01:03.872290+0000","last_clean":"2023-07-11T00:01:03.872290+0000","last_became_active":"2023-07-11T00:01:03.863251+0000","last_became_peered":"2023-07-11T00:01:03.863251+0000","last_unstale":"2023-07-11T00:01:03.872290+0000","last_undegraded":"2023-07-11T00:01:03.872290+0000","last_fullsized":"2023-07-11T00:01:03.872290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:14:31.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.880350+0000","last_change":"2023-07-11T00:01:02.867478+0000","last_active":"2023-07-11T00:01:03.880350+0000","last_peered":"2023-07-11T00:01:03.880350+0000","last_clean":"2023-07-11T00:01:03.880350+0000","last_became_active":"2023-07-11T00:01:02.867213+0000","last_became_peered":"2023-07-11T00:01:02.867213+0000","last_unstale":"2023-07-11T00:01:03.880350+0000","last_undegraded":"2023-07-11T00:01:03.880350+0000","last_fullsized":"2023-07-11T00:01:03.880350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:57:32.962303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873885+0000","last_change":"2023-07-11T00:01:03.868182+0000","last_active":"2023-07-11T00:01:03.873885+0000","last_peered":"2023-07-11T00:01:03.873885+0000","last_clean":"2023-07-11T00:01:03.873885+0000","last_became_active":"2023-07-11T00:01:03.867922+0000","last_became_peered":"2023-07-11T00:01:03.867922+0000","last_unstale":"2023-07-11T00:01:03.873885+0000","last_undegraded":"2023-07-11T00:01:03.873885+0000","last_fullsized":"2023-07-11T00:01:03.873885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:01:37.967360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877966+0000","last_change":"2023-07-11T00:01:02.863908+0000","last_active":"2023-07-11T00:01:03.877966+0000","last_peered":"2023-07-11T00:01:03.877966+0000","last_clean":"2023-07-11T00:01:03.877966+0000","last_became_active":"2023-07-11T00:01:02.863657+0000","last_became_peered":"2023-07-11T00:01:02.863657+0000","last_unstale":"2023-07-11T00:01:03.877966+0000","last_undegraded":"2023-07-11T00:01:03.877966+0000","last_fullsized":"2023-07-11T00:01:03.877966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:33:48.414474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.867686+0000","last_change":"2023-07-11T00:01:03.866671+0000","last_active":"2023-07-11T00:01:03.867686+0000","last_peered":"2023-07-11T00:01:03.867686+0000","last_clean":"2023-07-11T00:01:03.867686+0000","last_became_active":"2023-07-11T00:01:03.866396+0000","last_became_peered":"2023-07-11T00:01:03.866396+0000","last_unstale":"2023-07-11T00:01:03.867686+0000","last_undegraded":"2023-07-11T00:01:03.867686+0000","last_fullsized":"2023-07-11T00:01:03.867686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:03:13.440872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877399+0000","last_change":"2023-07-11T00:01:02.863465+0000","last_active":"2023-07-11T00:01:03.877399+0000","last_peered":"2023-07-11T00:01:03.877399+0000","last_clean":"2023-07-11T00:01:03.877399+0000","last_became_active":"2023-07-11T00:01:02.862752+0000","last_became_peered":"2023-07-11T00:01:02.862752+0000","last_unstale":"2023-07-11T00:01:03.877399+0000","last_undegraded":"2023-07-11T00:01:03.877399+0000","last_fullsized":"2023-07-11T00:01:03.877399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:33:48.414474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.862484+0000","last_change":"2023-07-11T00:01:03.860484+0000","last_active":"2023-07-11T00:01:03.862484+0000","last_peered":"2023-07-11T00:01:03.862484+0000","last_clean":"2023-07-11T00:01:03.862484+0000","last_became_active":"2023-07-11T00:01:03.860211+0000","last_became_peered":"2023-07-11T00:01:03.860211+0000","last_unstale":"2023-07-11T00:01:03.862484+0000","last_undegraded":"2023-07-11T00:01:03.862484+0000","last_fullsized":"2023-07-11T00:01:03.862484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:15:00.287935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860660+0000","last_change":"2023-07-11T00:01:02.861510+0000","last_active":"2023-07-11T00:01:03.860660+0000","last_peered":"2023-07-11T00:01:03.860660+0000","last_clean":"2023-07-11T00:01:03.860660+0000","last_became_active":"2023-07-11T00:01:02.861193+0000","last_became_peered":"2023-07-11T00:01:02.861193+0000","last_unstale":"2023-07-11T00:01:03.860660+0000","last_undegraded":"2023-07-11T00:01:03.860660+0000","last_fullsized":"2023-07-11T00:01:03.860660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:58:29.327224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873030+0000","last_change":"2023-07-11T00:01:03.863834+0000","last_active":"2023-07-11T00:01:03.873030+0000","last_peered":"2023-07-11T00:01:03.873030+0000","last_clean":"2023-07-11T00:01:03.873030+0000","last_became_active":"2023-07-11T00:01:03.863474+0000","last_became_peered":"2023-07-11T00:01:03.863474+0000","last_unstale":"2023-07-11T00:01:03.873030+0000","last_undegraded":"2023-07-11T00:01:03.873030+0000","last_fullsized":"2023-07-11T00:01:03.873030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:52:21.022767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.849848+0000","last_change":"2023-07-11T00:01:02.859230+0000","last_active":"2023-07-11T00:01:03.849848+0000","last_peered":"2023-07-11T00:01:03.849848+0000","last_clean":"2023-07-11T00:01:03.849848+0000","last_became_active":"2023-07-11T00:01:02.858952+0000","last_became_peered":"2023-07-11T00:01:02.858952+0000","last_unstale":"2023-07-11T00:01:03.849848+0000","last_undegraded":"2023-07-11T00:01:03.849848+0000","last_fullsized":"2023-07-11T00:01:03.849848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:47:00.820042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.880100+0000","last_change":"2023-07-11T00:01:03.872662+0000","last_active":"2023-07-11T00:01:03.880100+0000","last_peered":"2023-07-11T00:01:03.880100+0000","last_clean":"2023-07-11T00:01:03.880100+0000","last_became_active":"2023-07-11T00:01:03.869050+0000","last_became_peered":"2023-07-11T00:01:03.869050+0000","last_unstale":"2023-07-11T00:01:03.880100+0000","last_undegraded":"2023-07-11T00:01:03.880100+0000","last_fullsized":"2023-07-11T00:01:03.880100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:40:42.581792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.861511+0000","last_change":"2023-07-11T00:01:02.866548+0000","last_active":"2023-07-11T00:01:03.861511+0000","last_peered":"2023-07-11T00:01:03.861511+0000","last_clean":"2023-07-11T00:01:03.861511+0000","last_became_active":"2023-07-11T00:01:02.866262+0000","last_became_peered":"2023-07-11T00:01:02.866262+0000","last_unstale":"2023-07-11T00:01:03.861511+0000","last_undegraded":"2023-07-11T00:01:03.861511+0000","last_fullsized":"2023-07-11T00:01:03.861511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:46:20.898286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.869974+0000","last_change":"2023-07-11T00:01:03.865125+0000","last_active":"2023-07-11T00:01:03.869974+0000","last_peered":"2023-07-11T00:01:03.869974+0000","last_clean":"2023-07-11T00:01:03.869974+0000","last_became_active":"2023-07-11T00:01:03.864635+0000","last_became_peered":"2023-07-11T00:01:03.864635+0000","last_unstale":"2023-07-11T00:01:03.869974+0000","last_undegraded":"2023-07-11T00:01:03.869974+0000","last_fullsized":"2023-07-11T00:01:03.869974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:01:09.577811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.864780+0000","last_change":"2023-07-11T00:01:02.867674+0000","last_active":"2023-07-11T00:01:03.864780+0000","last_peered":"2023-07-11T00:01:03.864780+0000","last_clean":"2023-07-11T00:01:03.864780+0000","last_became_active":"2023-07-11T00:01:02.867393+0000","last_became_peered":"2023-07-11T00:01:02.867393+0000","last_unstale":"2023-07-11T00:01:03.864780+0000","last_undegraded":"2023-07-11T00:01:03.864780+0000","last_fullsized":"2023-07-11T00:01:03.864780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:38:33.154088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873586+0000","last_change":"2023-07-11T00:01:03.862554+0000","last_active":"2023-07-11T00:01:03.873586+0000","last_peered":"2023-07-11T00:01:03.873586+0000","last_clean":"2023-07-11T00:01:03.873586+0000","last_became_active":"2023-07-11T00:01:03.862253+0000","last_became_peered":"2023-07-11T00:01:03.862253+0000","last_unstale":"2023-07-11T00:01:03.873586+0000","last_undegraded":"2023-07-11T00:01:03.873586+0000","last_fullsized":"2023-07-11T00:01:03.873586+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:04:15.268452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"30'3","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.878547+0000","last_change":"2023-07-11T00:01:02.863167+0000","last_active":"2023-07-11T00:01:03.878547+0000","last_peered":"2023-07-11T00:01:03.878547+0000","last_clean":"2023-07-11T00:01:03.878547+0000","last_became_active":"2023-07-11T00:01:02.862373+0000","last_became_peered":"2023-07-11T00:01:02.862373+0000","last_unstale":"2023-07-11T00:01:03.878547+0000","last_undegraded":"2023-07-11T00:01:03.878547+0000","last_fullsized":"2023-07-11T00:01:03.878547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:05:13.558020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.863433+0000","last_change":"2023-07-11T00:01:03.861532+0000","last_active":"2023-07-11T00:01:03.863433+0000","last_peered":"2023-07-11T00:01:03.863433+0000","last_clean":"2023-07-11T00:01:03.863433+0000","last_became_active":"2023-07-11T00:01:03.861251+0000","last_became_peered":"2023-07-11T00:01:03.861251+0000","last_unstale":"2023-07-11T00:01:03.863433+0000","last_undegraded":"2023-07-11T00:01:03.863433+0000","last_fullsized":"2023-07-11T00:01:03.863433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:36:20.971140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"30'6","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.886013+0000","last_change":"2023-07-11T00:01:02.866307+0000","last_active":"2023-07-11T00:01:03.886013+0000","last_peered":"2023-07-11T00:01:03.886013+0000","last_clean":"2023-07-11T00:01:03.886013+0000","last_became_active":"2023-07-11T00:01:02.865613+0000","last_became_peered":"2023-07-11T00:01:02.865613+0000","last_unstale":"2023-07-11T00:01:03.886013+0000","last_undegraded":"2023-07-11T00:01:03.886013+0000","last_fullsized":"2023-07-11T00:01:03.886013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:08:22.458015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873865+0000","last_change":"2023-07-11T00:01:03.861918+0000","last_active":"2023-07-11T00:01:03.873865+0000","last_peered":"2023-07-11T00:01:03.873865+0000","last_clean":"2023-07-11T00:01:03.873865+0000","last_became_active":"2023-07-11T00:01:03.861639+0000","last_became_peered":"2023-07-11T00:01:03.861639+0000","last_unstale":"2023-07-11T00:01:03.873865+0000","last_undegraded":"2023-07-11T00:01:03.873865+0000","last_fullsized":"2023-07-11T00:01:03.873865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:43:36.518731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.879991+0000","last_change":"2023-07-11T00:01:02.863954+0000","last_active":"2023-07-11T00:01:03.879991+0000","last_peered":"2023-07-11T00:01:03.879991+0000","last_clean":"2023-07-11T00:01:03.879991+0000","last_became_active":"2023-07-11T00:01:02.863335+0000","last_became_peered":"2023-07-11T00:01:02.863335+0000","last_unstale":"2023-07-11T00:01:03.879991+0000","last_undegraded":"2023-07-11T00:01:03.879991+0000","last_fullsized":"2023-07-11T00:01:03.879991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:40:53.252640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.879511+0000","last_change":"2023-07-11T00:01:03.874064+0000","last_active":"2023-07-11T00:01:03.879511+0000","last_peered":"2023-07-11T00:01:03.879511+0000","last_clean":"2023-07-11T00:01:03.879511+0000","last_became_active":"2023-07-11T00:01:03.873773+0000","last_became_peered":"2023-07-11T00:01:03.873773+0000","last_unstale":"2023-07-11T00:01:03.879511+0000","last_undegraded":"2023-07-11T00:01:03.879511+0000","last_fullsized":"2023-07-11T00:01:03.879511+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:12:34.043950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.856078+0000","last_change":"2023-07-11T00:01:02.861790+0000","last_active":"2023-07-11T00:01:03.856078+0000","last_peered":"2023-07-11T00:01:03.856078+0000","last_clean":"2023-07-11T00:01:03.856078+0000","last_became_active":"2023-07-11T00:01:02.861481+0000","last_became_peered":"2023-07-11T00:01:02.861481+0000","last_unstale":"2023-07-11T00:01:03.856078+0000","last_undegraded":"2023-07-11T00:01:03.856078+0000","last_fullsized":"2023-07-11T00:01:03.856078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T03:08:15.719632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874357+0000","last_change":"2023-07-11T00:01:03.870708+0000","last_active":"2023-07-11T00:01:03.874357+0000","last_peered":"2023-07-11T00:01:03.874357+0000","last_clean":"2023-07-11T00:01:03.874357+0000","last_became_active":"2023-07-11T00:01:03.870421+0000","last_became_peered":"2023-07-11T00:01:03.870421+0000","last_unstale":"2023-07-11T00:01:03.874357+0000","last_undegraded":"2023-07-11T00:01:03.874357+0000","last_fullsized":"2023-07-11T00:01:03.874357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:42.503741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.850262+0000","last_change":"2023-07-11T00:01:02.860559+0000","last_active":"2023-07-11T00:01:03.850262+0000","last_peered":"2023-07-11T00:01:03.850262+0000","last_clean":"2023-07-11T00:01:03.850262+0000","last_became_active":"2023-07-11T00:01:02.860246+0000","last_became_peered":"2023-07-11T00:01:02.860246+0000","last_unstale":"2023-07-11T00:01:03.850262+0000","last_undegraded":"2023-07-11T00:01:03.850262+0000","last_fullsized":"2023-07-11T00:01:03.850262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:03:12.435937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.880120+0000","last_change":"2023-07-11T00:01:03.874856+0000","last_active":"2023-07-11T00:01:03.880120+0000","last_peered":"2023-07-11T00:01:03.880120+0000","last_clean":"2023-07-11T00:01:03.880120+0000","last_became_active":"2023-07-11T00:01:03.874438+0000","last_became_peered":"2023-07-11T00:01:03.874438+0000","last_unstale":"2023-07-11T00:01:03.880120+0000","last_undegraded":"2023-07-11T00:01:03.880120+0000","last_fullsized":"2023-07-11T00:01:03.880120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:14:30.517707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'8","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.878108+0000","last_change":"2023-07-11T00:01:02.863709+0000","last_active":"2023-07-11T00:01:03.878108+0000","last_peered":"2023-07-11T00:01:03.878108+0000","last_clean":"2023-07-11T00:01:03.878108+0000","last_became_active":"2023-07-11T00:01:02.862850+0000","last_became_peered":"2023-07-11T00:01:02.862850+0000","last_unstale":"2023-07-11T00:01:03.878108+0000","last_undegraded":"2023-07-11T00:01:03.878108+0000","last_fullsized":"2023-07-11T00:01:03.878108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:46:58.034360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.872962+0000","last_change":"2023-07-11T00:01:03.863250+0000","last_active":"2023-07-11T00:01:03.872962+0000","last_peered":"2023-07-11T00:01:03.872962+0000","last_clean":"2023-07-11T00:01:03.872962+0000","last_became_active":"2023-07-11T00:01:03.862779+0000","last_became_peered":"2023-07-11T00:01:03.862779+0000","last_unstale":"2023-07-11T00:01:03.872962+0000","last_undegraded":"2023-07-11T00:01:03.872962+0000","last_fullsized":"2023-07-11T00:01:03.872962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:34:03.703156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.874834+0000","last_change":"2023-07-11T00:01:02.862067+0000","last_active":"2023-07-11T00:01:03.874834+0000","last_peered":"2023-07-11T00:01:03.874834+0000","last_clean":"2023-07-11T00:01:03.874834+0000","last_became_active":"2023-07-11T00:01:02.861790+0000","last_became_peered":"2023-07-11T00:01:02.861790+0000","last_unstale":"2023-07-11T00:01:03.874834+0000","last_undegraded":"2023-07-11T00:01:03.874834+0000","last_fullsized":"2023-07-11T00:01:03.874834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:36:19.640355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876180+0000","last_change":"2023-07-11T00:01:03.871316+0000","last_active":"2023-07-11T00:01:03.876180+0000","last_peered":"2023-07-11T00:01:03.876180+0000","last_clean":"2023-07-11T00:01:03.876180+0000","last_became_active":"2023-07-11T00:01:03.871059+0000","last_became_peered":"2023-07-11T00:01:03.871059+0000","last_unstale":"2023-07-11T00:01:03.876180+0000","last_undegraded":"2023-07-11T00:01:03.876180+0000","last_fullsized":"2023-07-11T00:01:03.876180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:47:42.503741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877088+0000","last_change":"2023-07-11T00:01:02.860729+0000","last_active":"2023-07-11T00:01:03.877088+0000","last_peered":"2023-07-11T00:01:03.877088+0000","last_clean":"2023-07-11T00:01:03.877088+0000","last_became_active":"2023-07-11T00:01:02.860435+0000","last_became_peered":"2023-07-11T00:01:02.860435+0000","last_unstale":"2023-07-11T00:01:03.877088+0000","last_undegraded":"2023-07-11T00:01:03.877088+0000","last_fullsized":"2023-07-11T00:01:03.877088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:27:24.369075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.871452+0000","last_change":"2023-07-11T00:01:03.867217+0000","last_active":"2023-07-11T00:01:03.871452+0000","last_peered":"2023-07-11T00:01:03.871452+0000","last_clean":"2023-07-11T00:01:03.871452+0000","last_became_active":"2023-07-11T00:01:03.866930+0000","last_became_peered":"2023-07-11T00:01:03.866930+0000","last_unstale":"2023-07-11T00:01:03.871452+0000","last_undegraded":"2023-07-11T00:01:03.871452+0000","last_fullsized":"2023-07-11T00:01:03.871452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:34:16.617223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.880227+0000","last_change":"2023-07-11T00:01:02.858258+0000","last_active":"2023-07-11T00:01:03.880227+0000","last_peered":"2023-07-11T00:01:03.880227+0000","last_clean":"2023-07-11T00:01:03.880227+0000","last_became_active":"2023-07-11T00:01:02.858045+0000","last_became_peered":"2023-07-11T00:01:02.858045+0000","last_unstale":"2023-07-11T00:01:03.880227+0000","last_undegraded":"2023-07-11T00:01:03.880227+0000","last_fullsized":"2023-07-11T00:01:03.880227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:25:53.309584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876319+0000","last_change":"2023-07-11T00:01:03.870779+0000","last_active":"2023-07-11T00:01:03.876319+0000","last_peered":"2023-07-11T00:01:03.876319+0000","last_clean":"2023-07-11T00:01:03.876319+0000","last_became_active":"2023-07-11T00:01:03.870493+0000","last_became_peered":"2023-07-11T00:01:03.870493+0000","last_unstale":"2023-07-11T00:01:03.876319+0000","last_undegraded":"2023-07-11T00:01:03.876319+0000","last_fullsized":"2023-07-11T00:01:03.876319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:03:58.067794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860601+0000","last_change":"2023-07-11T00:01:02.859815+0000","last_active":"2023-07-11T00:01:03.860601+0000","last_peered":"2023-07-11T00:01:03.860601+0000","last_clean":"2023-07-11T00:01:03.860601+0000","last_became_active":"2023-07-11T00:01:02.859519+0000","last_became_peered":"2023-07-11T00:01:02.859519+0000","last_unstale":"2023-07-11T00:01:03.860601+0000","last_undegraded":"2023-07-11T00:01:03.860601+0000","last_fullsized":"2023-07-11T00:01:03.860601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:07.864833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876746+0000","last_change":"2023-07-11T00:01:03.875788+0000","last_active":"2023-07-11T00:01:03.876746+0000","last_peered":"2023-07-11T00:01:03.876746+0000","last_clean":"2023-07-11T00:01:03.876746+0000","last_became_active":"2023-07-11T00:01:03.875552+0000","last_became_peered":"2023-07-11T00:01:03.875552+0000","last_unstale":"2023-07-11T00:01:03.876746+0000","last_undegraded":"2023-07-11T00:01:03.876746+0000","last_fullsized":"2023-07-11T00:01:03.876746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:05:14.562955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.880284+0000","last_change":"2023-07-11T00:01:02.863459+0000","last_active":"2023-07-11T00:01:03.880284+0000","last_peered":"2023-07-11T00:01:03.880284+0000","last_clean":"2023-07-11T00:01:03.880284+0000","last_became_active":"2023-07-11T00:01:02.863213+0000","last_became_peered":"2023-07-11T00:01:02.863213+0000","last_unstale":"2023-07-11T00:01:03.880284+0000","last_undegraded":"2023-07-11T00:01:03.880284+0000","last_fullsized":"2023-07-11T00:01:03.880284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:28:12.038469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873706+0000","last_change":"2023-07-11T00:01:03.863207+0000","last_active":"2023-07-11T00:01:03.873706+0000","last_peered":"2023-07-11T00:01:03.873706+0000","last_clean":"2023-07-11T00:01:03.873706+0000","last_became_active":"2023-07-11T00:01:03.862901+0000","last_became_peered":"2023-07-11T00:01:03.862901+0000","last_unstale":"2023-07-11T00:01:03.873706+0000","last_undegraded":"2023-07-11T00:01:03.873706+0000","last_fullsized":"2023-07-11T00:01:03.873706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:33:33.634073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.855326+0000","last_change":"2023-07-11T00:01:02.854752+0000","last_active":"2023-07-11T00:01:03.855326+0000","last_peered":"2023-07-11T00:01:03.855326+0000","last_clean":"2023-07-11T00:01:03.855326+0000","last_became_active":"2023-07-11T00:01:02.854449+0000","last_became_peered":"2023-07-11T00:01:02.854449+0000","last_unstale":"2023-07-11T00:01:03.855326+0000","last_undegraded":"2023-07-11T00:01:03.855326+0000","last_fullsized":"2023-07-11T00:01:03.855326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:53:26.141943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.865899+0000","last_change":"2023-07-11T00:01:03.864139+0000","last_active":"2023-07-11T00:01:03.865899+0000","last_peered":"2023-07-11T00:01:03.865899+0000","last_clean":"2023-07-11T00:01:03.865899+0000","last_became_active":"2023-07-11T00:01:03.863868+0000","last_became_peered":"2023-07-11T00:01:03.863868+0000","last_unstale":"2023-07-11T00:01:03.865899+0000","last_undegraded":"2023-07-11T00:01:03.865899+0000","last_fullsized":"2023-07-11T00:01:03.865899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:40:45.434809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860697+0000","last_change":"2023-07-11T00:01:02.863337+0000","last_active":"2023-07-11T00:01:03.860697+0000","last_peered":"2023-07-11T00:01:03.860697+0000","last_clean":"2023-07-11T00:01:03.860697+0000","last_became_active":"2023-07-11T00:01:02.863093+0000","last_became_peered":"2023-07-11T00:01:02.863093+0000","last_unstale":"2023-07-11T00:01:03.860697+0000","last_undegraded":"2023-07-11T00:01:03.860697+0000","last_fullsized":"2023-07-11T00:01:03.860697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:43:36.190524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873007+0000","last_change":"2023-07-11T00:01:03.863792+0000","last_active":"2023-07-11T00:01:03.873007+0000","last_peered":"2023-07-11T00:01:03.873007+0000","last_clean":"2023-07-11T00:01:03.873007+0000","last_became_active":"2023-07-11T00:01:03.863488+0000","last_became_peered":"2023-07-11T00:01:03.863488+0000","last_unstale":"2023-07-11T00:01:03.873007+0000","last_undegraded":"2023-07-11T00:01:03.873007+0000","last_fullsized":"2023-07-11T00:01:03.873007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:33:35.435035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.853817+0000","last_change":"2023-07-11T00:01:02.861955+0000","last_active":"2023-07-11T00:01:03.853817+0000","last_peered":"2023-07-11T00:01:03.853817+0000","last_clean":"2023-07-11T00:01:03.853817+0000","last_became_active":"2023-07-11T00:01:02.861663+0000","last_became_peered":"2023-07-11T00:01:02.861663+0000","last_unstale":"2023-07-11T00:01:03.853817+0000","last_undegraded":"2023-07-11T00:01:03.853817+0000","last_fullsized":"2023-07-11T00:01:03.853817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:24:27.967495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.877012+0000","last_change":"2023-07-11T00:01:03.874802+0000","last_active":"2023-07-11T00:01:03.877012+0000","last_peered":"2023-07-11T00:01:03.877012+0000","last_clean":"2023-07-11T00:01:03.877012+0000","last_became_active":"2023-07-11T00:01:03.874549+0000","last_became_peered":"2023-07-11T00:01:03.874549+0000","last_unstale":"2023-07-11T00:01:03.877012+0000","last_undegraded":"2023-07-11T00:01:03.877012+0000","last_fullsized":"2023-07-11T00:01:03.877012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:47:36.952910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.849756+0000","last_change":"2023-07-11T00:01:02.866039+0000","last_active":"2023-07-11T00:01:03.849756+0000","last_peered":"2023-07-11T00:01:03.849756+0000","last_clean":"2023-07-11T00:01:03.849756+0000","last_became_active":"2023-07-11T00:01:02.865740+0000","last_became_peered":"2023-07-11T00:01:02.865740+0000","last_unstale":"2023-07-11T00:01:03.849756+0000","last_undegraded":"2023-07-11T00:01:03.849756+0000","last_fullsized":"2023-07-11T00:01:03.849756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:53:40.237446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.850452+0000","last_change":"2023-07-11T00:00:11.737777+0000","last_active":"2023-07-11T00:01:03.850452+0000","last_peered":"2023-07-11T00:01:03.850452+0000","last_clean":"2023-07-11T00:01:03.850452+0000","last_became_active":"2023-07-11T00:00:11.737518+0000","last_became_peered":"2023-07-11T00:00:11.737518+0000","last_unstale":"2023-07-11T00:01:03.850452+0000","last_undegraded":"2023-07-11T00:01:03.850452+0000","last_fullsized":"2023-07-11T00:01:03.850452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:40:36.580854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.869900+0000","last_change":"2023-07-11T00:01:03.863286+0000","last_active":"2023-07-11T00:01:03.869900+0000","last_peered":"2023-07-11T00:01:03.869900+0000","last_clean":"2023-07-11T00:01:03.869900+0000","last_became_active":"2023-07-11T00:01:03.862978+0000","last_became_peered":"2023-07-11T00:01:03.862978+0000","last_unstale":"2023-07-11T00:01:03.869900+0000","last_undegraded":"2023-07-11T00:01:03.869900+0000","last_fullsized":"2023-07-11T00:01:03.869900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:38:34.159024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.858432+0000","last_change":"2023-07-11T00:01:02.866639+0000","last_active":"2023-07-11T00:01:03.858432+0000","last_peered":"2023-07-11T00:01:03.858432+0000","last_clean":"2023-07-11T00:01:03.858432+0000","last_became_active":"2023-07-11T00:01:02.866297+0000","last_became_peered":"2023-07-11T00:01:02.866297+0000","last_unstale":"2023-07-11T00:01:03.858432+0000","last_undegraded":"2023-07-11T00:01:03.858432+0000","last_fullsized":"2023-07-11T00:01:03.858432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:46:03.697648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860440+0000","last_change":"2023-07-11T00:00:11.270609+0000","last_active":"2023-07-11T00:01:03.860440+0000","last_peered":"2023-07-11T00:01:03.860440+0000","last_clean":"2023-07-11T00:01:03.860440+0000","last_became_active":"2023-07-11T00:00:11.270289+0000","last_became_peered":"2023-07-11T00:00:11.270289+0000","last_unstale":"2023-07-11T00:01:03.860440+0000","last_undegraded":"2023-07-11T00:01:03.860440+0000","last_fullsized":"2023-07-11T00:01:03.860440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T07:04:15.587394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.870241+0000","last_change":"2023-07-11T00:01:03.865834+0000","last_active":"2023-07-11T00:01:03.870241+0000","last_peered":"2023-07-11T00:01:03.870241+0000","last_clean":"2023-07-11T00:01:03.870241+0000","last_became_active":"2023-07-11T00:01:03.865526+0000","last_became_peered":"2023-07-11T00:01:03.865526+0000","last_unstale":"2023-07-11T00:01:03.870241+0000","last_undegraded":"2023-07-11T00:01:03.870241+0000","last_fullsized":"2023-07-11T00:01:03.870241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:22:33.824631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.875093+0000","last_change":"2023-07-11T00:01:02.864849+0000","last_active":"2023-07-11T00:01:03.875093+0000","last_peered":"2023-07-11T00:01:03.875093+0000","last_clean":"2023-07-11T00:01:03.875093+0000","last_became_active":"2023-07-11T00:01:02.864519+0000","last_became_peered":"2023-07-11T00:01:02.864519+0000","last_unstale":"2023-07-11T00:01:03.875093+0000","last_undegraded":"2023-07-11T00:01:03.875093+0000","last_fullsized":"2023-07-11T00:01:03.875093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:34:02.698221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.859964+0000","last_change":"2023-07-11T00:00:11.269546+0000","last_active":"2023-07-11T00:01:03.859964+0000","last_peered":"2023-07-11T00:01:03.859964+0000","last_clean":"2023-07-11T00:01:03.859964+0000","last_became_active":"2023-07-11T00:00:11.269178+0000","last_became_peered":"2023-07-11T00:00:11.269178+0000","last_unstale":"2023-07-11T00:01:03.859964+0000","last_undegraded":"2023-07-11T00:01:03.859964+0000","last_fullsized":"2023-07-11T00:01:03.859964+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:00:27.446817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":181,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.857068+0000","last_change":"2023-07-11T00:00:11.270402+0000","last_active":"2023-07-11T00:01:03.857068+0000","last_peered":"2023-07-11T00:01:03.857068+0000","last_clean":"2023-07-11T00:01:03.857068+0000","last_became_active":"2023-07-11T00:00:11.270024+0000","last_became_peered":"2023-07-11T00:00:11.270024+0000","last_unstale":"2023-07-11T00:01:03.857068+0000","last_undegraded":"2023-07-11T00:01:03.857068+0000","last_fullsized":"2023-07-11T00:01:03.857068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T00:33:11.109888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.869931+0000","last_change":"2023-07-11T00:01:03.864925+0000","last_active":"2023-07-11T00:01:03.869931+0000","last_peered":"2023-07-11T00:01:03.869931+0000","last_clean":"2023-07-11T00:01:03.869931+0000","last_became_active":"2023-07-11T00:01:03.864239+0000","last_became_peered":"2023-07-11T00:01:03.864239+0000","last_unstale":"2023-07-11T00:01:03.869931+0000","last_undegraded":"2023-07-11T00:01:03.869931+0000","last_fullsized":"2023-07-11T00:01:03.869931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:33:35.435035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.856960+0000","last_change":"2023-07-11T00:01:02.860340+0000","last_active":"2023-07-11T00:01:03.856960+0000","last_peered":"2023-07-11T00:01:03.856960+0000","last_clean":"2023-07-11T00:01:03.856960+0000","last_became_active":"2023-07-11T00:01:02.859982+0000","last_became_peered":"2023-07-11T00:01:02.859982+0000","last_unstale":"2023-07-11T00:01:03.856960+0000","last_undegraded":"2023-07-11T00:01:03.856960+0000","last_fullsized":"2023-07-11T00:01:03.856960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:29:46.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.856708+0000","last_change":"2023-07-11T00:00:11.518743+0000","last_active":"2023-07-11T00:01:03.856708+0000","last_peered":"2023-07-11T00:01:03.856708+0000","last_clean":"2023-07-11T00:01:03.856708+0000","last_became_active":"2023-07-11T00:00:11.518395+0000","last_became_peered":"2023-07-11T00:00:11.518395+0000","last_unstale":"2023-07-11T00:01:03.856708+0000","last_undegraded":"2023-07-11T00:01:03.856708+0000","last_fullsized":"2023-07-11T00:01:03.856708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:33:46.317368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.876920+0000","last_change":"2023-07-11T00:01:03.875245+0000","last_active":"2023-07-11T00:01:03.876920+0000","last_peered":"2023-07-11T00:01:03.876920+0000","last_clean":"2023-07-11T00:01:03.876920+0000","last_became_active":"2023-07-11T00:01:03.874562+0000","last_became_peered":"2023-07-11T00:01:03.874562+0000","last_unstale":"2023-07-11T00:01:03.876920+0000","last_undegraded":"2023-07-11T00:01:03.876920+0000","last_fullsized":"2023-07-11T00:01:03.876920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:34:38.910637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.857955+0000","last_change":"2023-07-11T00:01:02.866458+0000","last_active":"2023-07-11T00:01:03.857955+0000","last_peered":"2023-07-11T00:01:03.857955+0000","last_clean":"2023-07-11T00:01:03.857955+0000","last_became_active":"2023-07-11T00:01:02.866141+0000","last_became_peered":"2023-07-11T00:01:02.866141+0000","last_unstale":"2023-07-11T00:01:03.857955+0000","last_undegraded":"2023-07-11T00:01:03.857955+0000","last_fullsized":"2023-07-11T00:01:03.857955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T10:12:33.039015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.856932+0000","last_change":"2023-07-11T00:00:11.518875+0000","last_active":"2023-07-11T00:01:03.856932+0000","last_peered":"2023-07-11T00:01:03.856932+0000","last_clean":"2023-07-11T00:01:03.856932+0000","last_became_active":"2023-07-11T00:00:11.518595+0000","last_became_peered":"2023-07-11T00:00:11.518595+0000","last_unstale":"2023-07-11T00:01:03.856932+0000","last_undegraded":"2023-07-11T00:01:03.856932+0000","last_fullsized":"2023-07-11T00:01:03.856932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:35:28.052022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.872126+0000","last_change":"2023-07-11T00:01:03.862855+0000","last_active":"2023-07-11T00:01:03.872126+0000","last_peered":"2023-07-11T00:01:03.872126+0000","last_clean":"2023-07-11T00:01:03.872126+0000","last_became_active":"2023-07-11T00:01:03.862555+0000","last_became_peered":"2023-07-11T00:01:03.862555+0000","last_unstale":"2023-07-11T00:01:03.872126+0000","last_undegraded":"2023-07-11T00:01:03.872126+0000","last_fullsized":"2023-07-11T00:01:03.872126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T05:38:34.159024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.850278+0000","last_change":"2023-07-11T00:01:02.862126+0000","last_active":"2023-07-11T00:01:03.850278+0000","last_peered":"2023-07-11T00:01:03.850278+0000","last_clean":"2023-07-11T00:01:03.850278+0000","last_became_active":"2023-07-11T00:01:02.861786+0000","last_became_peered":"2023-07-11T00:01:02.861786+0000","last_unstale":"2023-07-11T00:01:03.850278+0000","last_undegraded":"2023-07-11T00:01:03.850278+0000","last_fullsized":"2023-07-11T00:01:03.850278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:47:24.294767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.860652+0000","last_change":"2023-07-11T00:00:11.518769+0000","last_active":"2023-07-11T00:01:03.860652+0000","last_peered":"2023-07-11T00:01:03.860652+0000","last_clean":"2023-07-11T00:01:03.860652+0000","last_became_active":"2023-07-11T00:00:11.518440+0000","last_became_peered":"2023-07-11T00:00:11.518440+0000","last_unstale":"2023-07-11T00:01:03.860652+0000","last_undegraded":"2023-07-11T00:01:03.860652+0000","last_fullsized":"2023-07-11T00:01:03.860652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T06:46:06.446026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.870915+0000","last_change":"2023-07-11T00:01:03.865690+0000","last_active":"2023-07-11T00:01:03.870915+0000","last_peered":"2023-07-11T00:01:03.870915+0000","last_clean":"2023-07-11T00:01:03.870915+0000","last_became_active":"2023-07-11T00:01:03.865375+0000","last_became_peered":"2023-07-11T00:01:03.865375+0000","last_unstale":"2023-07-11T00:01:03.870915+0000","last_undegraded":"2023-07-11T00:01:03.870915+0000","last_fullsized":"2023-07-11T00:01:03.870915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T09:33:33.634073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.850254+0000","last_change":"2023-07-11T00:01:02.862708+0000","last_active":"2023-07-11T00:01:03.850254+0000","last_peered":"2023-07-11T00:01:03.850254+0000","last_clean":"2023-07-11T00:01:03.850254+0000","last_became_active":"2023-07-11T00:01:02.862404+0000","last_became_peered":"2023-07-11T00:01:02.862404+0000","last_unstale":"2023-07-11T00:01:03.850254+0000","last_undegraded":"2023-07-11T00:01:03.850254+0000","last_fullsized":"2023-07-11T00:01:03.850254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T04:04:14.263517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.849938+0000","last_change":"2023-07-11T00:00:11.518696+0000","last_active":"2023-07-11T00:01:03.849938+0000","last_peered":"2023-07-11T00:01:03.849938+0000","last_clean":"2023-07-11T00:01:03.849938+0000","last_became_active":"2023-07-11T00:00:11.518413+0000","last_became_peered":"2023-07-11T00:00:11.518413+0000","last_unstale":"2023-07-11T00:01:03.849938+0000","last_undegraded":"2023-07-11T00:01:03.849938+0000","last_fullsized":"2023-07-11T00:01:03.849938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:34:16.276499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.873904+0000","last_change":"2023-07-11T00:01:03.868847+0000","last_active":"2023-07-11T00:01:03.873904+0000","last_peered":"2023-07-11T00:01:03.873904+0000","last_clean":"2023-07-11T00:01:03.873904+0000","last_became_active":"2023-07-11T00:01:03.868393+0000","last_became_peered":"2023-07-11T00:01:03.868393+0000","last_unstale":"2023-07-11T00:01:03.873904+0000","last_undegraded":"2023-07-11T00:01:03.873904+0000","last_fullsized":"2023-07-11T00:01:03.873904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:02.839428+0000","last_clean_scrub_stamp":"2023-07-11T00:01:02.839428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T08:01:20.040086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.850719+0000","last_change":"2023-07-11T00:01:02.862969+0000","last_active":"2023-07-11T00:01:03.850719+0000","last_peered":"2023-07-11T00:01:03.850719+0000","last_clean":"2023-07-11T00:01:03.850719+0000","last_became_active":"2023-07-11T00:01:02.862647+0000","last_became_peered":"2023-07-11T00:01:02.862647+0000","last_unstale":"2023-07-11T00:01:03.850719+0000","last_undegraded":"2023-07-11T00:01:03.850719+0000","last_fullsized":"2023-07-11T00:01:03.850719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:01:01.834493+0000","last_clean_scrub_stamp":"2023-07-11T00:01:01.834493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T02:35:07.864833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-11T00:01:03.849671+0000","last_change":"2023-07-11T00:00:11.269674+0000","last_active":"2023-07-11T00:01:03.849671+0000","last_peered":"2023-07-11T00:01:03.849671+0000","last_clean":"2023-07-11T00:01:03.849671+0000","last_became_active":"2023-07-11T00:00:11.269355+0000","last_became_peered":"2023-07-11T00:00:11.269355+0000","last_unstale":"2023-07-11T00:01:03.849671+0000","last_undegraded":"2023-07-11T00:01:03.849671+0000","last_fullsized":"2023-07-11T00:01:03.849671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-11T00:00:10.246159+0000","last_clean_scrub_stamp":"2023-07-11T00:00:10.246159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-12T01:46:32.706434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":717359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":717359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":135717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-11T00:01:08.406 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-11T00:01:08.407 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-11T00:01:08.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.571+0000 7f955267f700 1 Processor -- start 2023-07-11T00:01:08.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.571+0000 7f955267f700 1 -- start start 2023-07-11T00:01:08.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.571+0000 7f955267f700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f954c0bc810 0x7f954c0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:08.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.571+0000 7f955267f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c0b8620 con 0x7f954c1449d0 2023-07-11T00:01:08.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.571+0000 7f955267f700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c0b8900 con 0x7f954c0b8d90 2023-07-11T00:01:08.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.571+0000 7f955267f700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c0b97a0 con 0x7f954c0bc810 2023-07-11T00:01:08.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.571+0000 7f954bfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f954c1449d0 0x7f954c14db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33610/0 (socket says 172.21.15.38:33610) 2023-07-11T00:01:08.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.571+0000 7f954bfff700 1 -- 172.21.15.38:0/863410998 learned_addr learned my addr 172.21.15.38:0/863410998 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:01:08.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954b7fe700 1 --2- 172.21.15.38:0/863410998 >> v2:172.21.15.70:3300/0 conn(0x7f954c0bc810 0x7f954c0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:08.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954affd700 1 -- 172.21.15.38:0/863410998 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051811754 0 0) 0x7f954c0b8620 con 0x7f954c1449d0 2023-07-11T00:01:08.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954affd700 1 -- 172.21.15.38:0/863410998 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95340035b0 con 0x7f954c1449d0 2023-07-11T00:01:08.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954affd700 1 -- 172.21.15.38:0/863410998 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261596124 0 0) 0x7f954c0b8900 con 0x7f954c0b8d90 2023-07-11T00:01:08.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954affd700 1 -- 172.21.15.38:0/863410998 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f954c0b8620 con 0x7f954c0b8d90 2023-07-11T00:01:08.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954b7fe700 1 -- 172.21.15.38:0/863410998 >> v1:172.21.15.70:6789/0 conn(0x7f954c0b8d90 legacy=0x7f954c06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954b7fe700 1 -- 172.21.15.38:0/863410998 >> v1:172.21.15.38:6789/0 conn(0x7f954c1449d0 legacy=0x7f954c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954b7fe700 1 -- 172.21.15.38:0/863410998 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c06b4f0 con 0x7f954c0bc810 2023-07-11T00:01:08.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954b7fe700 1 --2- 172.21.15.38:0/863410998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f954c0bc810 0x7f954c0ba530 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9540009840 tx=0x7f9540009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80f93164cc510463 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:08.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954affd700 1 -- 172.21.15.38:0/863410998 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540011830 con 0x7f954c0bc810 2023-07-11T00:01:08.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954affd700 1 -- 172.21.15.38:0/863410998 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9540011990 con 0x7f954c0bc810 2023-07-11T00:01:08.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.572+0000 7f954affd700 1 -- 172.21.15.38:0/863410998 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540011d20 con 0x7f954c0bc810 2023-07-11T00:01:08.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.573+0000 7f955267f700 1 -- 172.21.15.38:0/863410998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f954c0bc810 msgr2=0x7f954c0ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.573+0000 7f955267f700 1 --2- 172.21.15.38:0/863410998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f954c0bc810 0x7f954c0ba530 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9540009840 tx=0x7f9540009b50 comp rx=0 tx=0).stop 2023-07-11T00:01:08.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.573+0000 7f955267f700 1 -- 172.21.15.38:0/863410998 shutdown_connections 2023-07-11T00:01:08.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.573+0000 7f955267f700 1 --2- 172.21.15.38:0/863410998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f954c0bc810 0x7f954c0ba530 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.573+0000 7f955267f700 1 -- 172.21.15.38:0/863410998 >> 172.21.15.38:0/863410998 conn(0x7f954c0c0860 msgr2=0x7f954c0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:08.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.573+0000 7f955267f700 1 -- 172.21.15.38:0/863410998 shutdown_connections 2023-07-11T00:01:08.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.573+0000 7f955267f700 1 -- 172.21.15.38:0/863410998 wait complete. 2023-07-11T00:01:08.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.574+0000 7f955267f700 1 Processor -- start 2023-07-11T00:01:08.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.574+0000 7f955267f700 1 -- start start 2023-07-11T00:01:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f955267f700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f954c0b8d90 0x7f954c14d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f955267f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f954c0bc810 0x7f954c147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f955267f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f954c1449d0 0x7f954c1462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f955267f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c14d800 con 0x7f954c1449d0 2023-07-11T00:01:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f955267f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c1453b0 con 0x7f954c0bc810 2023-07-11T00:01:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f955267f700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0b3480 con 0x7f954c0b8d90 2023-07-11T00:01:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f9550c1c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f954c1449d0 0x7f954c1462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f9550c1c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f954c1449d0 0x7f954c1462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59186/0 (socket says 172.21.15.38:59186) 2023-07-11T00:01:08.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f9550c1c700 1 -- 172.21.15.38:0/3333965312 learned_addr learned my addr 172.21.15.38:0/3333965312 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:08.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f954bfff700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f954c0b8d90 0x7f954c14d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:08.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f954b7fe700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f954c0bc810 0x7f954c147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:08.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f9550c1c700 1 -- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f954c0b8d90 msgr2=0x7f954c14d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f9550c1c700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f954c0b8d90 0x7f954c14d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f9550c1c700 1 -- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f954c0bc810 msgr2=0x7f954c147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f9550c1c700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f954c0bc810 0x7f954c147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f9550c1c700 1 -- 172.21.15.38:0/3333965312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95400094a0 con 0x7f954c1449d0 2023-07-11T00:01:08.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f954b7fe700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f954c0bc810 0x7f954c147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:01:08.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f9550c1c700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f954c1449d0 0x7f954c1462a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f954400cc20 tx=0x7f954400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:08.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.575+0000 7f9548ff9700 1 -- 172.21.15.38:0/3333965312 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400ac20 con 0x7f954c1449d0 2023-07-11T00:01:08.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.576+0000 7f9548ff9700 1 -- 172.21.15.38:0/3333965312 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954400ad80 con 0x7f954c1449d0 2023-07-11T00:01:08.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.576+0000 7f955267f700 1 -- 172.21.15.38:0/3333965312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c1455a0 con 0x7f954c1449d0 2023-07-11T00:01:08.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.576+0000 7f9548ff9700 1 -- 172.21.15.38:0/3333965312 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544003c20 con 0x7f954c1449d0 2023-07-11T00:01:08.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.576+0000 7f955267f700 1 -- 172.21.15.38:0/3333965312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c14b290 con 0x7f954c1449d0 2023-07-11T00:01:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.576+0000 7f955267f700 1 -- 172.21.15.38:0/3333965312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c145fc0 con 0x7f954c1449d0 2023-07-11T00:01:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.577+0000 7f9548ff9700 1 -- 172.21.15.38:0/3333965312 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95440050d0 con 0x7f954c1449d0 2023-07-11T00:01:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.577+0000 7f9548ff9700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f953806ace0 0x7f953806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.577+0000 7f9548ff9700 1 -- 172.21.15.38:0/3333965312 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95440895a0 con 0x7f954c1449d0 2023-07-11T00:01:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.578+0000 7f954bfff700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f953806ace0 0x7f953806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.578+0000 7f954bfff700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f953806ace0 0x7f953806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f953c0011e0 tx=0x7f953c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.582+0000 7f9548ff9700 1 -- 172.21.15.38:0/3333965312 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f954c145fc0 con 0x7f954c1449d0 2023-07-11T00:01:08.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.861+0000 7f955267f700 1 -- 172.21.15.38:0/3333965312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f954c145fc0 con 0x7f954c1449d0 2023-07-11T00:01:08.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.867+0000 7f9548ff9700 1 -- 172.21.15.38:0/3333965312 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f954c145fc0 con 0x7f954c1449d0 2023-07-11T00:01:08.869 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2023-07-11T00:01:08.869 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBXm6xks53eBRAAIEobJD+VB3RoJP54ghJ6rw== 2023-07-11T00:01:08.869 INFO:teuthology.orchestra.run.smithi038.stdout: caps mds = "allow" 2023-07-11T00:01:08.869 INFO:teuthology.orchestra.run.smithi038.stdout: caps mon = "allow r" 2023-07-11T00:01:08.869 INFO:teuthology.orchestra.run.smithi038.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-11T00:01:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 -- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f953806ace0 msgr2=0x7f953806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f953806ace0 0x7f953806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f953c0011e0 tx=0x7f953c009040 comp rx=0 tx=0).stop 2023-07-11T00:01:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 -- 172.21.15.38:0/3333965312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f954c1449d0 msgr2=0x7f954c1462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f954c1449d0 0x7f954c1462a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f954400cc20 tx=0x7f954400a060 comp rx=0 tx=0).stop 2023-07-11T00:01:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 -- 172.21.15.38:0/3333965312 shutdown_connections 2023-07-11T00:01:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f953806ace0 0x7f953806d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f954c1449d0 0x7f954c1462a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f954c0b8d90 0x7f954c14d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 --2- 172.21.15.38:0/3333965312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f954c0bc810 0x7f954c147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 -- 172.21.15.38:0/3333965312 >> 172.21.15.38:0/3333965312 conn(0x7f954c0c0860 msgr2=0x7f954c0beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:08.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 -- 172.21.15.38:0/3333965312 shutdown_connections 2023-07-11T00:01:08.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:08.869+0000 7f955267f700 1 -- 172.21.15.38:0/3333965312 wait complete. 2023-07-11T00:01:08.873 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2023-07-11T00:01:08.883 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-11T00:01:09.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.008+0000 7ff37e939700 1 Processor -- start 2023-07-11T00:01:09.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.008+0000 7ff37e939700 1 -- start start 2023-07-11T00:01:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.008+0000 7ff37e939700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff3781449d0 0x7ff37814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.008+0000 7ff37e939700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff3780bc810 0x7ff3780ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.008+0000 7ff37e939700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff3780b8d90 0x7ff37806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.008+0000 7ff37e939700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3780b97a0 con 0x7ff3781449d0 2023-07-11T00:01:09.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.008+0000 7ff37e939700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff378144da0 con 0x7ff3780bc810 2023-07-11T00:01:09.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.008+0000 7ff37e939700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3780b8620 con 0x7ff3780b8d90 2023-07-11T00:01:09.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.008+0000 7ff377fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff3781449d0 0x7ff37814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.008+0000 7ff377fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff3781449d0 0x7ff37814db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59188/0 (socket says 172.21.15.38:59188) 2023-07-11T00:01:09.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.008+0000 7ff377fff700 1 -- 172.21.15.38:0/3889982986 learned_addr learned my addr 172.21.15.38:0/3889982986 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:09.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff37ced6700 1 --2- 172.21.15.38:0/3889982986 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff3780b8d90 0x7ff37806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff3777fe700 1 --2- 172.21.15.38:0/3889982986 >> v2:172.21.15.70:3300/0 conn(0x7ff3780bc810 0x7ff3780ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff377fff700 1 -- 172.21.15.38:0/3889982986 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff3780b8d90 msgr2=0x7ff37806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff377fff700 1 --2- 172.21.15.38:0/3889982986 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff3780b8d90 0x7ff37806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff377fff700 1 -- 172.21.15.38:0/3889982986 >> v2:172.21.15.70:3300/0 conn(0x7ff3780bc810 msgr2=0x7ff3780ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff377fff700 1 --2- 172.21.15.38:0/3889982986 >> v2:172.21.15.70:3300/0 conn(0x7ff3780bc810 0x7ff3780ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff377fff700 1 -- 172.21.15.38:0/3889982986 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3780b8900 con 0x7ff3781449d0 2023-07-11T00:01:09.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff3777fe700 1 --2- 172.21.15.38:0/3889982986 >> v2:172.21.15.70:3300/0 conn(0x7ff3780bc810 0x7ff3780ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:01:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff377fff700 1 --2- 172.21.15.38:0/3889982986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3781449d0 0x7ff37814db50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff37806ce40 tx=0x7ff368009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fec8f94a812b7d server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff376ffd700 1 -- 172.21.15.38:0/3889982986 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800b870 con 0x7ff3781449d0 2023-07-11T00:01:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff376ffd700 1 -- 172.21.15.38:0/3889982986 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36800b9d0 con 0x7ff3781449d0 2023-07-11T00:01:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.009+0000 7ff376ffd700 1 -- 172.21.15.38:0/3889982986 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800bd60 con 0x7ff3781449d0 2023-07-11T00:01:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.010+0000 7ff37e939700 1 -- 172.21.15.38:0/3889982986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3781449d0 msgr2=0x7ff37814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.010+0000 7ff37e939700 1 --2- 172.21.15.38:0/3889982986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3781449d0 0x7ff37814db50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff37806ce40 tx=0x7ff368009bd0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.010+0000 7ff37e939700 1 -- 172.21.15.38:0/3889982986 shutdown_connections 2023-07-11T00:01:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.010+0000 7ff37e939700 1 --2- 172.21.15.38:0/3889982986 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff3780b8d90 0x7ff37806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.010+0000 7ff37e939700 1 --2- 172.21.15.38:0/3889982986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3781449d0 0x7ff37814db50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.010+0000 7ff37e939700 1 --2- 172.21.15.38:0/3889982986 >> v2:172.21.15.70:3300/0 conn(0x7ff3780bc810 0x7ff3780ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.010+0000 7ff37e939700 1 -- 172.21.15.38:0/3889982986 >> 172.21.15.38:0/3889982986 conn(0x7ff3780c0860 msgr2=0x7ff3780c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.010+0000 7ff37e939700 1 -- 172.21.15.38:0/3889982986 shutdown_connections 2023-07-11T00:01:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.010+0000 7ff37e939700 1 -- 172.21.15.38:0/3889982986 wait complete. 2023-07-11T00:01:09.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.011+0000 7ff37e939700 1 Processor -- start 2023-07-11T00:01:09.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.011+0000 7ff37e939700 1 -- start start 2023-07-11T00:01:09.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff37e939700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff3780b8d90 0x7ff37814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff37e939700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3780bc810 0x7ff3780a5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff37e939700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3781449d0 0x7ff3780a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff37e939700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781e3e10 con 0x7ff3780bc810 2023-07-11T00:01:09.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff37e939700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37814a660 con 0x7ff3781449d0 2023-07-11T00:01:09.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff37e939700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781e37c0 con 0x7ff3780b8d90 2023-07-11T00:01:09.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff3777fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3780bc810 0x7ff3780a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff3777fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3780bc810 0x7ff3780a5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59196/0 (socket says 172.21.15.38:59196) 2023-07-11T00:01:09.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff3777fe700 1 -- 172.21.15.38:0/2796432337 learned_addr learned my addr 172.21.15.38:0/2796432337 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:09.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff377fff700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff3780b8d90 0x7ff37814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff37ced6700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3781449d0 0x7ff3780a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff3777fe700 1 -- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff3780b8d90 msgr2=0x7ff37814adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff3777fe700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff3780b8d90 0x7ff37814adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff3777fe700 1 -- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3781449d0 msgr2=0x7ff3780a59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff3777fe700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3781449d0 0x7ff3780a59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff3777fe700 1 -- 172.21.15.38:0/2796432337 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff368009550 con 0x7ff3780bc810 2023-07-11T00:01:09.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.012+0000 7ff3777fe700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3780bc810 0x7ff3780a5490 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00c750 tx=0x7ff36c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.013+0000 7ff374ff9700 1 -- 172.21.15.38:0/2796432337 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c011800 con 0x7ff3780bc810 2023-07-11T00:01:09.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.013+0000 7ff374ff9700 1 -- 172.21.15.38:0/2796432337 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c011960 con 0x7ff3780bc810 2023-07-11T00:01:09.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.013+0000 7ff374ff9700 1 -- 172.21.15.38:0/2796432337 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c011cd0 con 0x7ff3780bc810 2023-07-11T00:01:09.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.013+0000 7ff37e939700 1 -- 172.21.15.38:0/2796432337 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3781e3aa0 con 0x7ff3780bc810 2023-07-11T00:01:09.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.013+0000 7ff37e939700 1 -- 172.21.15.38:0/2796432337 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37814d960 con 0x7ff3780bc810 2023-07-11T00:01:09.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.014+0000 7ff37e939700 1 -- 172.21.15.38:0/2796432337 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3781e3c30 con 0x7ff3780bc810 2023-07-11T00:01:09.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.014+0000 7ff374ff9700 1 -- 172.21.15.38:0/2796432337 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff36c021350 con 0x7ff3780bc810 2023-07-11T00:01:09.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.014+0000 7ff374ff9700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff36406ace0 0x7ff36406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.015+0000 7ff374ff9700 1 -- 172.21.15.38:0/2796432337 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff36c089260 con 0x7ff3780bc810 2023-07-11T00:01:09.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.015+0000 7ff377fff700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff36406ace0 0x7ff36406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.015+0000 7ff377fff700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff36406ace0 0x7ff36406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff368014040 tx=0x7ff368008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.019+0000 7ff374ff9700 1 -- 172.21.15.38:0/2796432337 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff36c057e30 con 0x7ff3780bc810 2023-07-11T00:01:09.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.260+0000 7ff37e939700 1 -- 172.21.15.38:0/2796432337 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff378074360 con 0x7ff3780bc810 2023-07-11T00:01:09.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.260+0000 7ff374ff9700 1 -- 172.21.15.38:0/2796432337 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3914 (secure 0 0 0) 0x7ff36c0579c0 con 0x7ff3780bc810 2023-07-11T00:01:09.263 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:01:09.263 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3230958485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3230958485},{"type":"v1","addr":"172.21.15.70:6835","nonce":3230958485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2068482801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2068482801},{"type":"v1","addr":"172.21.15.38:6835","nonce":2068482801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-11T00:01:03.266349+0000","modified":"2023-07-11T00:01:06.289683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.38:6834/2519374117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2519374117},{"type":"v1","addr":"172.21.15.38:6834","nonce":2519374117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-11T00:01:09.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 -- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff36406ace0 msgr2=0x7ff36406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff36406ace0 0x7ff36406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff368014040 tx=0x7ff368008030 comp rx=0 tx=0).stop 2023-07-11T00:01:09.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 -- 172.21.15.38:0/2796432337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3780bc810 msgr2=0x7ff3780a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3780bc810 0x7ff3780a5490 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00c750 tx=0x7ff36c00ca60 comp rx=0 tx=0).stop 2023-07-11T00:01:09.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 -- 172.21.15.38:0/2796432337 shutdown_connections 2023-07-11T00:01:09.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7ff36406ace0 0x7ff36406d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3781449d0 0x7ff3780a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff3780b8d90 0x7ff37814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 --2- 172.21.15.38:0/2796432337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3780bc810 0x7ff3780a5490 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 -- 172.21.15.38:0/2796432337 >> 172.21.15.38:0/2796432337 conn(0x7ff3780c0860 msgr2=0x7ff37814e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:09.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 -- 172.21.15.38:0/2796432337 shutdown_connections 2023-07-11T00:01:09.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.262+0000 7ff37e939700 1 -- 172.21.15.38:0/2796432337 wait complete. 2023-07-11T00:01:09.267 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 16 2023-07-11T00:01:09.579 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-11T00:01:03.266349+0000', 'modified': '2023-07-11T00:01:06.289683+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4968}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4968': {'gid': 4968, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.38:6834/2519374117', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 2519374117}, {'type': 'v1', 'addr': '172.21.15.38:6834', 'nonce': 2519374117}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-11T00:01:09.580 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-11T00:01:09.580 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-11T00:01:09.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.708+0000 7f732f888700 1 Processor -- start 2023-07-11T00:01:09.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.708+0000 7f732f888700 1 -- start start 2023-07-11T00:01:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732f888700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f732814bf30 0x7f73280b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732f888700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7328145fc0 0x7f7328153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732f888700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7328070130 con 0x7f7328071d20 2023-07-11T00:01:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732f888700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7328070f80 con 0x7f732814bf30 2023-07-11T00:01:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732f888700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7328071260 con 0x7f7328145fc0 2023-07-11T00:01:09.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732d624700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f732814bf30 0x7f73280b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732ce23700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7328071d20 0x7f73281458b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33622/0 (socket says 172.21.15.38:33622) 2023-07-11T00:01:09.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732ce23700 1 -- 172.21.15.38:0/1396881175 learned_addr learned my addr 172.21.15.38:0/1396881175 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:01:09.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732de25700 1 --2- 172.21.15.38:0/1396881175 >> v2:172.21.15.70:3300/0 conn(0x7f7328145fc0 0x7f7328153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732d624700 1 -- 172.21.15.38:0/1396881175 >> v2:172.21.15.70:3300/0 conn(0x7f7328145fc0 msgr2=0x7f7328153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732d624700 1 --2- 172.21.15.38:0/1396881175 >> v2:172.21.15.70:3300/0 conn(0x7f7328145fc0 0x7f7328153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732d624700 1 -- 172.21.15.38:0/1396881175 >> v1:172.21.15.38:6789/0 conn(0x7f7328071d20 legacy=0x7f73281458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732d624700 1 -- 172.21.15.38:0/1396881175 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7328071540 con 0x7f732814bf30 2023-07-11T00:01:09.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f731ffff700 1 -- 172.21.15.38:0/1396881175 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830210547 0 0) 0x7f7328070130 con 0x7f7328071d20 2023-07-11T00:01:09.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.709+0000 7f732d624700 1 --2- 172.21.15.38:0/1396881175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f732814bf30 0x7f73280b8ff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f73280b1db0 tx=0x7f7318009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55fba09e9e2b2b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.710+0000 7f731ffff700 1 -- 172.21.15.38:0/1396881175 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318011830 con 0x7f732814bf30 2023-07-11T00:01:09.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.710+0000 7f731ffff700 1 -- 172.21.15.38:0/1396881175 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7318011990 con 0x7f732814bf30 2023-07-11T00:01:09.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.710+0000 7f731ffff700 1 -- 172.21.15.38:0/1396881175 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318011d20 con 0x7f732814bf30 2023-07-11T00:01:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.710+0000 7f732f888700 1 -- 172.21.15.38:0/1396881175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f732814bf30 msgr2=0x7f73280b8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.710+0000 7f732f888700 1 --2- 172.21.15.38:0/1396881175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f732814bf30 0x7f73280b8ff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f73280b1db0 tx=0x7f7318009b20 comp rx=0 tx=0).stop 2023-07-11T00:01:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.710+0000 7f732f888700 1 -- 172.21.15.38:0/1396881175 shutdown_connections 2023-07-11T00:01:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.710+0000 7f732f888700 1 --2- 172.21.15.38:0/1396881175 >> v2:172.21.15.70:3300/0 conn(0x7f7328145fc0 0x7f7328153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.710+0000 7f732f888700 1 --2- 172.21.15.38:0/1396881175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f732814bf30 0x7f73280b8ff0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.710+0000 7f732f888700 1 -- 172.21.15.38:0/1396881175 >> 172.21.15.38:0/1396881175 conn(0x7f73280be670 msgr2=0x7f73280bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.710+0000 7f732f888700 1 -- 172.21.15.38:0/1396881175 shutdown_connections 2023-07-11T00:01:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.710+0000 7f732f888700 1 -- 172.21.15.38:0/1396881175 wait complete. 2023-07-11T00:01:09.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.711+0000 7f732f888700 1 Processor -- start 2023-07-11T00:01:09.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.711+0000 7f732f888700 1 -- start start 2023-07-11T00:01:09.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732f888700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7328071d20 0x7f73280b8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732f888700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7328145fc0 0x7f732813ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732f888700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f732814bf30 0x7f73281d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732f888700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73280b8a60 con 0x7f7328071d20 2023-07-11T00:01:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732f888700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73280b7ee0 con 0x7f732814bf30 2023-07-11T00:01:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732f888700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73280b7120 con 0x7f7328145fc0 2023-07-11T00:01:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732d624700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7328071d20 0x7f73280b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732d624700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7328071d20 0x7f73280b8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59214/0 (socket says 172.21.15.38:59214) 2023-07-11T00:01:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732d624700 1 -- 172.21.15.38:0/2179297203 learned_addr learned my addr 172.21.15.38:0/2179297203 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732d624700 1 -- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7328145fc0 msgr2=0x7f732813ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732d624700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7328145fc0 0x7f732813ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732d624700 1 -- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f732814bf30 msgr2=0x7f73281d2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732de25700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f732814bf30 0x7f73281d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732d624700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f732814bf30 0x7f73281d2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732d624700 1 -- 172.21.15.38:0/2179297203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73180094a0 con 0x7f7328071d20 2023-07-11T00:01:09.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.712+0000 7f732d624700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7328071d20 0x7f73280b8520 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7318000c00 tx=0x7f7318004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.713+0000 7f731dffb700 1 -- 172.21.15.38:0/2179297203 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73180036a0 con 0x7f7328071d20 2023-07-11T00:01:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.713+0000 7f731dffb700 1 -- 172.21.15.38:0/2179297203 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731801e070 con 0x7f7328071d20 2023-07-11T00:01:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.713+0000 7f732f888700 1 -- 172.21.15.38:0/2179297203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73280b7400 con 0x7f7328071d20 2023-07-11T00:01:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.713+0000 7f731dffb700 1 -- 172.21.15.38:0/2179297203 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318003a60 con 0x7f7328071d20 2023-07-11T00:01:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.713+0000 7f732f888700 1 -- 172.21.15.38:0/2179297203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73280b79c0 con 0x7f7328071d20 2023-07-11T00:01:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.714+0000 7f731dffb700 1 -- 172.21.15.38:0/2179297203 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7318003bc0 con 0x7f7328071d20 2023-07-11T00:01:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.715+0000 7f731dffb700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f730c06ace0 0x7f730c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.715+0000 7f731dffb700 1 -- 172.21.15.38:0/2179297203 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f731808a4e0 con 0x7f7328071d20 2023-07-11T00:01:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.715+0000 7f732ce23700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f730c06ace0 0x7f730c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.715+0000 7f732ce23700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f730c06ace0 0x7f730c06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73240011e0 tx=0x7f73240079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.716+0000 7f733ba21b80 1 Processor -- start 2023-07-11T00:01:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.716+0000 7f733ba21b80 1 -- start start 2023-07-11T00:01:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dcd650 0x5616b3dca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3df79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3df7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f733ba21b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b3d43ea0 con 0x5616b3dca200 2023-07-11T00:01:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f733ba21b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b3cb7600 con 0x5616b3dcd650 2023-07-11T00:01:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f733ba21b80 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616b3d26910 con 0x5616b3dc9db0 2023-07-11T00:01:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f732de25700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3df7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f732de25700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3df7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59222/0 (socket says 172.21.15.38:59222) 2023-07-11T00:01:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f732de25700 1 -- 172.21.15.38:0/1828528336 learned_addr learned my addr 172.21.15.38:0/1828528336 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f732d624700 1 --2- 172.21.15.38:0/1828528336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dcd650 0x5616b3dca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f732ce23700 1 --2- 172.21.15.38:0/1828528336 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3df79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f732de25700 1 -- 172.21.15.38:0/1828528336 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 msgr2=0x5616b3df79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f732de25700 1 --2- 172.21.15.38:0/1828528336 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3df79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f732de25700 1 -- 172.21.15.38:0/1828528336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dcd650 msgr2=0x5616b3dca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f732de25700 1 --2- 172.21.15.38:0/1828528336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dcd650 0x5616b3dca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.717+0000 7f732de25700 1 -- 172.21.15.38:0/1828528336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616b3b13790 con 0x5616b3dca200 2023-07-11T00:01:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f732de25700 1 --2- 172.21.15.38:0/1828528336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3df7f30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7320007360 tx=0x7f7320007670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6f057507e2d1a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f7312ffd700 1 -- 172.21.15.38:0/1828528336 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320014610 con 0x5616b3dca200 2023-07-11T00:01:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f7312ffd700 1 -- 172.21.15.38:0/1828528336 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732000f050 con 0x5616b3dca200 2023-07-11T00:01:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f7312ffd700 1 -- 172.21.15.38:0/1828528336 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320014990 con 0x5616b3dca200 2023-07-11T00:01:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f733ba21b80 1 -- 172.21.15.38:0/1828528336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 msgr2=0x5616b3df7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f733ba21b80 1 --2- 172.21.15.38:0/1828528336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3df7f30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7320007360 tx=0x7f7320007670 comp rx=0 tx=0).stop 2023-07-11T00:01:09.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f733ba21b80 1 -- 172.21.15.38:0/1828528336 shutdown_connections 2023-07-11T00:01:09.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f733ba21b80 1 --2- 172.21.15.38:0/1828528336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3df7f30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f733ba21b80 1 --2- 172.21.15.38:0/1828528336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dcd650 0x5616b3dca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f733ba21b80 1 --2- 172.21.15.38:0/1828528336 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3df79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f733ba21b80 1 -- 172.21.15.38:0/1828528336 >> 172.21.15.38:0/1828528336 conn(0x5616b3dc4320 msgr2=0x5616b3dce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:09.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f733ba21b80 1 -- 172.21.15.38:0/1828528336 shutdown_connections 2023-07-11T00:01:09.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.718+0000 7f733ba21b80 1 -- 172.21.15.38:0/1828528336 wait complete. 2023-07-11T00:01:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.719+0000 7f733ba21b80 1 -- start start 2023-07-11T00:01:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.719+0000 7f733ba21b80 1 Processor -- start 2023-07-11T00:01:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3df9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e18fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dcd650 0x5616b3def5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f733ba21b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b3d1fbe0 con 0x5616b3dca200 2023-07-11T00:01:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f733ba21b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b3cdd5b0 con 0x5616b3dcd650 2023-07-11T00:01:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f733ba21b80 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616b3cc3910 con 0x5616b3dc9db0 2023-07-11T00:01:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f733ba21b80 10 client.0 _ll_register_callbacks cb 0x5616b3cdbb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-11T00:01:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f732ce23700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e18fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f732ce23700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e18fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59228/0 (socket says 172.21.15.38:59228) 2023-07-11T00:01:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f732ce23700 1 -- 172.21.15.38:0/4197938253 learned_addr learned my addr 172.21.15.38:0/4197938253 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f732d624700 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3df9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f732de25700 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dcd650 0x5616b3def5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f732ce23700 1 -- 172.21.15.38:0/4197938253 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 msgr2=0x5616b3df9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f732ce23700 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3df9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f732ce23700 1 -- 172.21.15.38:0/4197938253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dcd650 msgr2=0x5616b3def5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f732ce23700 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dcd650 0x5616b3def5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f732ce23700 1 -- 172.21.15.38:0/4197938253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7320009c40 con 0x5616b3dca200 2023-07-11T00:01:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f732ce23700 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e18fc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f73280bc8c0 tx=0x7f73240010f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5462a4e7dee7c038 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.720+0000 7f7307fff700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-07-11T00:01:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f7307fff700 1 -- 172.21.15.38:0/4197938253 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732401d040 con 0x5616b3dca200 2023-07-11T00:01:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f7307fff700 1 -- 172.21.15.38:0/4197938253 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7324015de0 con 0x5616b3dca200 2023-07-11T00:01:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f733ba21b80 1 -- 172.21.15.38:0/4197938253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616b3dc1930 con 0x5616b3dca200 2023-07-11T00:01:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f7307fff700 1 -- 172.21.15.38:0/4197938253 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7324012400 con 0x5616b3dca200 2023-07-11T00:01:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f733ba21b80 10 client.5142 fetch_fsmap learned FSMap version 16 2023-07-11T00:01:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f733ba21b80 1 -- 172.21.15.38:0/4197938253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5616b3c000a0 con 0x5616b3dca200 2023-07-11T00:01:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f7307fff700 1 -- 172.21.15.38:0/4197938253 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5616b3dc1930 con 0x5616b3dca200 2023-07-11T00:01:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f7307fff700 1 -- 172.21.15.38:0/4197938253 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 16) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f732402c470 con 0x5616b3dca200 2023-07-11T00:01:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f733ba21b80 10 client.5142 fetch_fsmap finished waiting for FSMap version 16 2023-07-11T00:01:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f733ba21b80 10 client.5142 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-11T00:01:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f733ba21b80 20 client.5142 populate_metadata read hostname 'smithi038' 2023-07-11T00:01:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f733ba21b80 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.38:6832/2519374117,v1:172.21.15.38:6834/2519374117] conn(0x5616b3df83d0 0x5616b3df87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f733ba21b80 4 client.5142 mds_command: new command op to 4968 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-11T00:01:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f733ba21b80 1 -- 172.21.15.38:0/4197938253 --> [v2:172.21.15.38:6832/2519374117,v1:172.21.15.38:6834/2519374117] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616b3d9e0e0 con 0x5616b3df83d0 2023-07-11T00:01:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.721+0000 7f732d624700 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.38:6832/2519374117,v1:172.21.15.38:6834/2519374117] conn(0x5616b3df83d0 0x5616b3df87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f7307fff700 10 client.5142 ms_handle_connect on v2:172.21.15.38:6832/2519374117 2023-07-11T00:01:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f732d624700 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.38:6832/2519374117,v1:172.21.15.38:6834/2519374117] conn(0x5616b3df83d0 0x5616b3df87a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8659ed765a845b76 server_cookie=ad188585956ffd5 in_seq=0 out_seq=0 2023-07-11T00:01:09.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f7307fff700 1 -- 172.21.15.38:0/4197938253 <== mds.0 v2:172.21.15.38:6832/2519374117 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5616b3d9e0e0 con 0x5616b3df83d0 2023-07-11T00:01:09.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f7307fff700 10 client.5142 handle_command_reply: tid=0 2023-07-11T00:01:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f733ba21b80 1 client.5142 shutdown 2023-07-11T00:01:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f733ba21b80 1 -- 172.21.15.38:0/4197938253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 msgr2=0x5616b3e18fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f733ba21b80 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e18fc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f73280bc8c0 tx=0x7f73240010f0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f733ba21b80 1 -- 172.21.15.38:0/4197938253 shutdown_connections 2023-07-11T00:01:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f733ba21b80 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dcd650 0x5616b3def5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f733ba21b80 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.38:6832/2519374117,v1:172.21.15.38:6834/2519374117] conn(0x5616b3df83d0 0x5616b3df87a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f733ba21b80 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3df9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f733ba21b80 1 --2- 172.21.15.38:0/4197938253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e18fc0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f733ba21b80 1 -- 172.21.15.38:0/4197938253 >> 172.21.15.38:0/4197938253 conn(0x5616b3dc4320 msgr2=0x5616b3dc85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:09.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.722+0000 7f7307fff700 0 client.5142 ms_handle_reset on v2:172.21.15.38:6832/2519374117 2023-07-11T00:01:09.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.723+0000 7f733ba21b80 1 -- 172.21.15.38:0/4197938253 shutdown_connections 2023-07-11T00:01:09.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.723+0000 7f733ba21b80 1 -- 172.21.15.38:0/4197938253 wait complete. 2023-07-11T00:01:09.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.723+0000 7f733ba21b80 20 client.5142 trim_cache size 0 max 16384 2023-07-11T00:01:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.740+0000 7f733ba21b80 1 Processor -- start 2023-07-11T00:01:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.740+0000 7f733ba21b80 1 -- start start 2023-07-11T00:01:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3dca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dca200 0x5616b3df8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dcd650 0x5616b3df8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f733ba21b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b3b14390 con 0x5616b3dcd650 2023-07-11T00:01:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f733ba21b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b3df04d0 con 0x5616b3dca200 2023-07-11T00:01:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f733ba21b80 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616b3dcde10 con 0x5616b3dc9db0 2023-07-11T00:01:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f732de25700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dcd650 0x5616b3df8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f732de25700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dcd650 0x5616b3df8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59240/0 (socket says 172.21.15.38:59240) 2023-07-11T00:01:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f732de25700 1 -- 172.21.15.38:0/2556576326 learned_addr learned my addr 172.21.15.38:0/2556576326 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:09.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f732d624700 1 --2- 172.21.15.38:0/2556576326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3dca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f732ce23700 1 --2- 172.21.15.38:0/2556576326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dca200 0x5616b3df8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f732de25700 1 -- 172.21.15.38:0/2556576326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 msgr2=0x5616b3dca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f732de25700 1 --2- 172.21.15.38:0/2556576326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3dca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f732de25700 1 -- 172.21.15.38:0/2556576326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dca200 msgr2=0x5616b3df8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f732de25700 1 --2- 172.21.15.38:0/2556576326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dca200 0x5616b3df8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f732de25700 1 -- 172.21.15.38:0/2556576326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616b3ce5b10 con 0x5616b3dcd650 2023-07-11T00:01:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f732de25700 1 --2- 172.21.15.38:0/2556576326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dcd650 0x5616b3df8c60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7320015000 tx=0x7f7320013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de81d2ecc07cc81 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f73137fe700 1 -- 172.21.15.38:0/2556576326 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320024070 con 0x5616b3dcd650 2023-07-11T00:01:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f73137fe700 1 -- 172.21.15.38:0/2556576326 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7320003a20 con 0x5616b3dcd650 2023-07-11T00:01:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.741+0000 7f73137fe700 1 -- 172.21.15.38:0/2556576326 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320003dd0 con 0x5616b3dcd650 2023-07-11T00:01:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.742+0000 7f733ba21b80 1 -- 172.21.15.38:0/2556576326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dcd650 msgr2=0x5616b3df8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.742+0000 7f733ba21b80 1 --2- 172.21.15.38:0/2556576326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dcd650 0x5616b3df8c60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7320015000 tx=0x7f7320013000 comp rx=0 tx=0).stop 2023-07-11T00:01:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.742+0000 7f733ba21b80 1 -- 172.21.15.38:0/2556576326 shutdown_connections 2023-07-11T00:01:09.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.742+0000 7f733ba21b80 1 --2- 172.21.15.38:0/2556576326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dcd650 0x5616b3df8c60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.742+0000 7f733ba21b80 1 --2- 172.21.15.38:0/2556576326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dc9db0 0x5616b3dca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.742+0000 7f733ba21b80 1 --2- 172.21.15.38:0/2556576326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dca200 0x5616b3df8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.742+0000 7f733ba21b80 1 -- 172.21.15.38:0/2556576326 >> 172.21.15.38:0/2556576326 conn(0x5616b3dc4320 msgr2=0x5616b3df9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:09.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.742+0000 7f733ba21b80 1 -- 172.21.15.38:0/2556576326 shutdown_connections 2023-07-11T00:01:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.742+0000 7f733ba21b80 1 -- 172.21.15.38:0/2556576326 wait complete. 2023-07-11T00:01:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.743+0000 7f733ba21b80 1 -- start start 2023-07-11T00:01:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.743+0000 7f733ba21b80 1 Processor -- start 2023-07-11T00:01:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dc9db0 0x5616b3dc8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e69c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f733ba21b80 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dcd650 0x5616b3e6a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f733ba21b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b3e6a6d0 con 0x5616b3dca200 2023-07-11T00:01:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f733ba21b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616b3e70140 con 0x5616b3dc9db0 2023-07-11T00:01:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f733ba21b80 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616b3e702e0 con 0x5616b3dcd650 2023-07-11T00:01:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f733ba21b80 10 client.0 _ll_register_callbacks cb 0x7f7324005f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-11T00:01:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f732ce23700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e69c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f732ce23700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e69c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59252/0 (socket says 172.21.15.38:59252) 2023-07-11T00:01:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f732ce23700 1 -- 172.21.15.38:0/551062220 learned_addr learned my addr 172.21.15.38:0/551062220 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f732d624700 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dc9db0 0x5616b3dc8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f732de25700 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dcd650 0x5616b3e6a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f732ce23700 1 -- 172.21.15.38:0/551062220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dcd650 msgr2=0x5616b3e6a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f732ce23700 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dcd650 0x5616b3e6a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f732ce23700 1 -- 172.21.15.38:0/551062220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dc9db0 msgr2=0x5616b3dc8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f732ce23700 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dc9db0 0x5616b3dc8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.744+0000 7f732ce23700 1 -- 172.21.15.38:0/551062220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616b3b13790 con 0x5616b3dca200 2023-07-11T00:01:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f732ce23700 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e69c50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f73280bc8c0 tx=0x7f7324007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357633bd70a5a76a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f7307fff700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-07-11T00:01:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f7307fff700 1 -- 172.21.15.38:0/551062220 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732401d040 con 0x5616b3dca200 2023-07-11T00:01:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f7307fff700 1 -- 172.21.15.38:0/551062220 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f732402c470 con 0x5616b3dca200 2023-07-11T00:01:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f733ba21b80 1 -- 172.21.15.38:0/551062220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f732000f050 con 0x5616b3dca200 2023-07-11T00:01:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f7307fff700 1 -- 172.21.15.38:0/551062220 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7324015ab0 con 0x5616b3dca200 2023-07-11T00:01:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f733ba21b80 10 client.5148 fetch_fsmap learned FSMap version 16 2023-07-11T00:01:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f733ba21b80 1 -- 172.21.15.38:0/551062220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5616b3b741d0 con 0x5616b3dca200 2023-07-11T00:01:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f7307fff700 1 -- 172.21.15.38:0/551062220 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732000f050 con 0x5616b3dca200 2023-07-11T00:01:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f7307fff700 1 -- 172.21.15.38:0/551062220 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 16) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f7324015c10 con 0x5616b3dca200 2023-07-11T00:01:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f733ba21b80 10 client.5148 fetch_fsmap finished waiting for FSMap version 16 2023-07-11T00:01:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f733ba21b80 10 client.5148 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-11T00:01:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f733ba21b80 20 client.5148 populate_metadata read hostname 'smithi038' 2023-07-11T00:01:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f733ba21b80 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.38:6832/2519374117,v1:172.21.15.38:6834/2519374117] conn(0x5616b3df8e60 0x5616b3debbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f733ba21b80 4 client.5148 mds_command: new command op to 4968 tid=0[{"prefix": "status"}] 2023-07-11T00:01:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f733ba21b80 1 -- 172.21.15.38:0/551062220 --> [v2:172.21.15.38:6832/2519374117,v1:172.21.15.38:6834/2519374117] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5616b3d18d20 con 0x5616b3df8e60 2023-07-11T00:01:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.745+0000 7f732d624700 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.38:6832/2519374117,v1:172.21.15.38:6834/2519374117] conn(0x5616b3df8e60 0x5616b3debbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f7307fff700 10 client.5148 ms_handle_connect on v2:172.21.15.38:6832/2519374117 2023-07-11T00:01:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f732d624700 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.38:6832/2519374117,v1:172.21.15.38:6834/2519374117] conn(0x5616b3df8e60 0x5616b3debbd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bedbb8759b314d server_cookie=c9ab60537dd7f1fd in_seq=0 out_seq=0 2023-07-11T00:01:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f7307fff700 1 -- 172.21.15.38:0/551062220 <== mds.0 v2:172.21.15.38:6832/2519374117 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5616b3d18d20 con 0x5616b3df8e60 2023-07-11T00:01:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f7307fff700 10 client.5148 handle_command_reply: tid=0 2023-07-11T00:01:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 1 client.5148 shutdown 2023-07-11T00:01:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 1 -- 172.21.15.38:0/551062220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 msgr2=0x5616b3e69c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e69c50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f73280bc8c0 tx=0x7f7324007000 comp rx=0 tx=0).stop 2023-07-11T00:01:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 1 -- 172.21.15.38:0/551062220 shutdown_connections 2023-07-11T00:01:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.38:6832/2519374117,v1:172.21.15.38:6834/2519374117] conn(0x5616b3df8e60 0x5616b3debbd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x5616b3dcd650 0x5616b3e6a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5616b3dc9db0 0x5616b3dc8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 1 --2- 172.21.15.38:0/551062220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616b3dca200 0x5616b3e69c50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 1 -- 172.21.15.38:0/551062220 >> 172.21.15.38:0/551062220 conn(0x5616b3dc4320 msgr2=0x5616b3df99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f7307fff700 0 client.5148 ms_handle_reset on v2:172.21.15.38:6832/2519374117 2023-07-11T00:01:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 1 -- 172.21.15.38:0/551062220 shutdown_connections 2023-07-11T00:01:09.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 1 -- 172.21.15.38:0/551062220 wait complete. 2023-07-11T00:01:09.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.746+0000 7f733ba21b80 20 client.5148 trim_cache size 0 max 16384 2023-07-11T00:01:09.760 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-07-11T00:01:09.760 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "712aa6bd-5b82-40dc-8d7c-7e66131fef83", 2023-07-11T00:01:09.760 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-07-11T00:01:09.761 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4968, 2023-07-11T00:01:09.761 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-07-11T00:01:09.761 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-07-11T00:01:09.761 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-07-11T00:01:09.761 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 5.9001679380000001, 2023-07-11T00:01:09.762 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 16, 2023-07-11T00:01:09.762 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 31, 2023-07-11T00:01:09.762 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 31, 2023-07-11T00:01:09.762 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 13.910076788 2023-07-11T00:01:09.762 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-07-11T00:01:09.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 -- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f730c06ace0 msgr2=0x7f730c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f730c06ace0 0x7f730c06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73240011e0 tx=0x7f73240079b0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 -- 172.21.15.38:0/2179297203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7328071d20 msgr2=0x7f73280b8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7328071d20 0x7f73280b8520 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7318000c00 tx=0x7f7318004750 comp rx=0 tx=0).stop 2023-07-11T00:01:09.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 -- 172.21.15.38:0/2179297203 shutdown_connections 2023-07-11T00:01:09.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f730c06ace0 0x7f730c06d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f732814bf30 0x7f73281d2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7328071d20 0x7f73280b8520 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 --2- 172.21.15.38:0/2179297203 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7328145fc0 0x7f732813ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 -- 172.21.15.38:0/2179297203 >> 172.21.15.38:0/2179297203 conn(0x7f73280be670 msgr2=0x7f73280b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 -- 172.21.15.38:0/2179297203 shutdown_connections 2023-07-11T00:01:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.747+0000 7f732f888700 1 -- 172.21.15.38:0/2179297203 wait complete. 2023-07-11T00:01:09.766 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-11T00:01:09.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.889+0000 7fbca731d700 1 Processor -- start 2023-07-11T00:01:09.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.889+0000 7fbca731d700 1 -- start start 2023-07-11T00:01:09.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.890+0000 7fbca731d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca01449d0 0x7fbca014db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.890+0000 7fbca731d700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbca00bc810 0x7fbca00ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.890+0000 7fbca731d700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca00b8620 con 0x7fbca00b8d90 2023-07-11T00:01:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.890+0000 7fbca731d700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca00b97a0 con 0x7fbca00bc810 2023-07-11T00:01:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.890+0000 7fbca731d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca0144da0 con 0x7fbca01449d0 2023-07-11T00:01:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.890+0000 7fbca50b9700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca01449d0 0x7fbca014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.890+0000 7fbca48b8700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbca00bc810 0x7fbca00ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.890+0000 7fbca50b9700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca01449d0 0x7fbca014db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:37128/0 (socket says 172.21.15.38:37128) 2023-07-11T00:01:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.890+0000 7fbca50b9700 1 -- 172.21.15.38:0/1712432684 learned_addr learned my addr 172.21.15.38:0/1712432684 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbca50b9700 1 -- 172.21.15.38:0/1712432684 >> v2:172.21.15.70:3300/0 conn(0x7fbca00bc810 msgr2=0x7fbca00ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbca50b9700 1 --2- 172.21.15.38:0/1712432684 >> v2:172.21.15.70:3300/0 conn(0x7fbca00bc810 0x7fbca00ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbca50b9700 1 -- 172.21.15.38:0/1712432684 >> v1:172.21.15.70:6789/0 conn(0x7fbca00b8d90 legacy=0x7fbca006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbca50b9700 1 -- 172.21.15.38:0/1712432684 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca00b8900 con 0x7fbca01449d0 2023-07-11T00:01:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbca50b9700 1 --2- 172.21.15.38:0/1712432684 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca01449d0 0x7fbca014db50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc900098f0 tx=0x7fbc90009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e1d02da0cd90334 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbc97fff700 1 -- 172.21.15.38:0/1712432684 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90011830 con 0x7fbca01449d0 2023-07-11T00:01:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbc97fff700 1 -- 172.21.15.38:0/1712432684 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc90011990 con 0x7fbca01449d0 2023-07-11T00:01:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbc97fff700 1 -- 172.21.15.38:0/1712432684 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90011d20 con 0x7fbca01449d0 2023-07-11T00:01:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbca731d700 1 -- 172.21.15.38:0/1712432684 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca01449d0 msgr2=0x7fbca014db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbca731d700 1 --2- 172.21.15.38:0/1712432684 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca01449d0 0x7fbca014db50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc900098f0 tx=0x7fbc90009c00 comp rx=0 tx=0).stop 2023-07-11T00:01:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbca731d700 1 -- 172.21.15.38:0/1712432684 shutdown_connections 2023-07-11T00:01:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbca731d700 1 --2- 172.21.15.38:0/1712432684 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca01449d0 0x7fbca014db50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbca731d700 1 --2- 172.21.15.38:0/1712432684 >> v2:172.21.15.70:3300/0 conn(0x7fbca00bc810 0x7fbca00ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.891+0000 7fbca731d700 1 -- 172.21.15.38:0/1712432684 >> 172.21.15.38:0/1712432684 conn(0x7fbca00c0860 msgr2=0x7fbca00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.892+0000 7fbca731d700 1 -- 172.21.15.38:0/1712432684 shutdown_connections 2023-07-11T00:01:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.892+0000 7fbca731d700 1 -- 172.21.15.38:0/1712432684 wait complete. 2023-07-11T00:01:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.893+0000 7fbca731d700 1 Processor -- start 2023-07-11T00:01:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.893+0000 7fbca731d700 1 -- start start 2023-07-11T00:01:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca731d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbca00b8d90 0x7fbca01485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca731d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca00bc810 0x7fbca01e3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca731d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbca01449d0 0x7fbca014a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca731d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca0148af0 con 0x7fbca00b8d90 2023-07-11T00:01:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca731d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca014d5f0 con 0x7fbca01449d0 2023-07-11T00:01:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca731d700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca00b4400 con 0x7fbca00bc810 2023-07-11T00:01:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca50b9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbca00b8d90 0x7fbca01485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca50b9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbca00b8d90 0x7fbca01485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59254/0 (socket says 172.21.15.38:59254) 2023-07-11T00:01:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca50b9700 1 -- 172.21.15.38:0/3477778859 learned_addr learned my addr 172.21.15.38:0/3477778859 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca48b8700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca00bc810 0x7fbca01e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca58ba700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbca01449d0 0x7fbca014a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca50b9700 1 -- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca00bc810 msgr2=0x7fbca01e3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca50b9700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca00bc810 0x7fbca01e3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca50b9700 1 -- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbca01449d0 msgr2=0x7fbca014a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:09.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca50b9700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbca01449d0 0x7fbca014a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:09.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca50b9700 1 -- 172.21.15.38:0/3477778859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90009550 con 0x7fbca00b8d90 2023-07-11T00:01:09.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca50b9700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbca00b8d90 0x7fbca01485b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbc90014040 tx=0x7fbc90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbc95ffb700 1 -- 172.21.15.38:0/3477778859 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90004510 con 0x7fbca00b8d90 2023-07-11T00:01:09.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbc95ffb700 1 -- 172.21.15.38:0/3477778859 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9001e070 con 0x7fbca00b8d90 2023-07-11T00:01:09.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbca731d700 1 -- 172.21.15.38:0/3477778859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca01e3000 con 0x7fbca00b8d90 2023-07-11T00:01:09.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.894+0000 7fbc95ffb700 1 -- 172.21.15.38:0/3477778859 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc900038e0 con 0x7fbca00b8d90 2023-07-11T00:01:09.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.895+0000 7fbca731d700 1 -- 172.21.15.38:0/3477778859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca01e3d40 con 0x7fbca00b8d90 2023-07-11T00:01:09.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.896+0000 7fbca731d700 1 -- 172.21.15.38:0/3477778859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca01e3520 con 0x7fbca00b8d90 2023-07-11T00:01:09.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.900+0000 7fbc95ffb700 1 -- 172.21.15.38:0/3477778859 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc90003a40 con 0x7fbca00b8d90 2023-07-11T00:01:09.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.900+0000 7fbc95ffb700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbc8406ace0 0x7fbc8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:09.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.900+0000 7fbc95ffb700 1 -- 172.21.15.38:0/3477778859 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc9008ab00 con 0x7fbca00b8d90 2023-07-11T00:01:09.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.901+0000 7fbca48b8700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbc8406ace0 0x7fbc8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:09.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.901+0000 7fbca48b8700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbc8406ace0 0x7fbc8406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbca014da60 tx=0x7fbc9c009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:09.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:09.904+0000 7fbc95ffb700 1 -- 172.21.15.38:0/3477778859 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbc90055ba0 con 0x7fbca00b8d90 2023-07-11T00:01:10.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.148+0000 7fbca731d700 1 -- 172.21.15.38:0/3477778859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbca0074360 con 0x7fbca00b8d90 2023-07-11T00:01:10.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.148+0000 7fbc95ffb700 1 -- 172.21.15.38:0/3477778859 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbc900591c0 con 0x7fbca00b8d90 2023-07-11T00:01:10.150 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-11T00:01:10.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.150+0000 7fbca731d700 1 -- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbc8406ace0 msgr2=0x7fbc8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:10.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.150+0000 7fbca731d700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbc8406ace0 0x7fbc8406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbca014da60 tx=0x7fbc9c009210 comp rx=0 tx=0).stop 2023-07-11T00:01:10.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.150+0000 7fbca731d700 1 -- 172.21.15.38:0/3477778859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbca00b8d90 msgr2=0x7fbca01485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:10.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.150+0000 7fbca731d700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbca00b8d90 0x7fbca01485b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbc90014040 tx=0x7fbc90004750 comp rx=0 tx=0).stop 2023-07-11T00:01:10.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.150+0000 7fbca731d700 1 -- 172.21.15.38:0/3477778859 shutdown_connections 2023-07-11T00:01:10.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.150+0000 7fbca731d700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbc8406ace0 0x7fbc8406d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:10.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.150+0000 7fbca731d700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbca01449d0 0x7fbca014a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:10.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.150+0000 7fbca731d700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbca00b8d90 0x7fbca01485b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:10.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.150+0000 7fbca731d700 1 --2- 172.21.15.38:0/3477778859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbca00bc810 0x7fbca01e3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:10.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.150+0000 7fbca731d700 1 -- 172.21.15.38:0/3477778859 >> 172.21.15.38:0/3477778859 conn(0x7fbca00c0860 msgr2=0x7fbca00be8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:10.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.151+0000 7fbca731d700 1 -- 172.21.15.38:0/3477778859 shutdown_connections 2023-07-11T00:01:10.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:10.151+0000 7fbca731d700 1 -- 172.21.15.38:0/3477778859 wait complete. 2023-07-11T00:01:10.164 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-11T00:01:10.164 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-11T00:01:10.165 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-07-11T00:01:10.165 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-11T00:01:10.165 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-11T00:01:10.165 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-11T00:01:10.166 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-11T00:01:10.166 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-11T00:01:10.166 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-11T00:01:10.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:10.167 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-07-11T00:01:10.218 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-11T00:01:10.218 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-11T00:01:10.218 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-07-11T00:01:10.218 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:01:10.218 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-07-11T00:01:10.219 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:01:10.219 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:01:10.219 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:01:10.219 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-07-11T00:01:10.219 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:01:10.219 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:01:10.219 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-07-11T00:01:10.220 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-11T00:01:10.220 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:01:10.220 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-11T00:01:10.220 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-07-11T00:01:10.220 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-11T00:01:10.220 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42273sec preferred_lft 42273sec 2023-07-11T00:01:10.220 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-07-11T00:01:10.220 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:01:10.221 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-11T00:01:10.221 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 02:80:64:13:36:5b brd ff:ff:ff:ff:ff:ff 2023-07-11T00:01:10.221 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-11T00:01:10.221 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:01:10.221 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::b0a1:81ff:fecf:97a9/64 scope link 2023-07-11T00:01:10.221 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:01:10.221 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-11T00:01:10.222 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 02:80:64:13:36:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-11T00:01:10.222 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::80:64ff:fe13:365b/64 scope link 2023-07-11T00:01:10.222 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-07-11T00:01:10.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:10.223 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-11T00:01:10.294 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-07-11T00:01:10.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:10.297 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-07-11T00:01:10.346 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-07-11T00:01:10.346 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-11T00:01:10.346 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-11T00:01:10.346 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-11T00:01:10.347 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-11T00:01:10.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:10.348 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-07-11T00:01:10.348 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-07-11T00:01:10.349 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-11T00:01:10.349 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-11T00:01:10.349 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-11T00:01:10.350 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-07-11T00:01:10.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:10.515 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-07-11T00:01:10.560 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-11T00:01:10.562 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-11T00:01:10.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:10.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2023-07-11T00:01:10.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:01:10.632 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-11T00:01:10.677 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-11T00:01:10.677 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-11T00:01:10.678 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-11T00:01:10.761 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-11T00:01:10.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:10.762 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:01:10.905 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:01:10.906 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:01:10.906 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-07-11T00:01:10.921 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:01:10.921 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:01:10.922 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-07-11T00:01:10.922 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.70:3300,172.21.15.70:3301" 2023-07-11T00:01:10.922 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:01:10.943 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-11T00:01:10.944 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-11T00:01:10.944 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-07-11T00:01:10.944 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.70:3300,172.21.15.70:3301" 2023-07-11T00:01:10.944 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-11T00:01:10.944 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.38:6789,172.21.15.70:6789,172.21.15.70:6790" 2023-07-11T00:01:10.944 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.38:6789,172.21.15.70:6789,172.21.15.70:6790:/ 2023-07-11T00:01:10.944 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=712aa6bd-5b82-40dc-8d7c-7e66131fef83" will pass to kernel 2023-07-11T00:01:10.949 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-11T00:01:10.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:10.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-11T00:01:11.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:11.020 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-11T00:01:11.128 INFO:teuthology.orchestra.run.smithi131.stdout:client5032 2023-07-11T00:01:11.129 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-11T00:01:11.129 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:01:11.174 DEBUG:teuthology.orchestra.run.smithi131:> mktemp -d --suffix=xfstests-dev 2023-07-11T00:01:11.259 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.ESeo9raKdcxfstests-dev 2023-07-11T00:01:11.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:11.260 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.ESeo9raKdcxfstests-dev) 2023-07-11T00:01:11.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:11.372 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.ESeo9raKdcxfstests-dev) 2023-07-11T00:01:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:Cloning into '/tmp/tmp.ESeo9raKdcxfstests-dev'... 2023-07-11T00:01:12.371 DEBUG:teuthology.orchestra.run.smithi131:> mktemp -d --suffix=xfsprogs-dev 2023-07-11T00:01:12.417 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.a2sTs4EWApxfsprogs-dev 2023-07-11T00:01:12.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:12.418 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.a2sTs4EWApxfsprogs-dev) 2023-07-11T00:01:12.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:12.530 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.a2sTs4EWApxfsprogs-dev) 2023-07-11T00:01:12.581 INFO:teuthology.orchestra.run.smithi131.stderr:Cloning into '/tmp/tmp.a2sTs4EWApxfsprogs-dev'... 2023-07-11T00:01:13.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:13.117 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-07-11T00:01:13.172 DEBUG:teuthology.orchestra.run.smithi131:> mktemp -d --suffix=test 2023-07-11T00:01:13.217 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.GoAWdcZ1qltest 2023-07-11T00:01:13.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:01:13.218 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-07-11T00:01:13.306 DEBUG:teuthology.orchestra.run.smithi131:> mktemp -d --suffix=scratch 2023-07-11T00:01:13.350 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.kKNWXFcnThscratch 2023-07-11T00:01:13.351 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-07-11T00:01:13.352 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel 2023-07-11T00:01:14.457 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:04:18 ago on Mon 10 Jul 2023 11:56:56 PM UTC. 2023-07-11T00:01:15.665 INFO:teuthology.orchestra.run.smithi131.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-07-11T00:01:15.666 INFO:teuthology.orchestra.run.smithi131.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-07-11T00:01:15.667 INFO:teuthology.orchestra.run.smithi131.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-07-11T00:01:15.668 INFO:teuthology.orchestra.run.smithi131.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-07-11T00:01:15.669 INFO:teuthology.orchestra.run.smithi131.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-07-11T00:01:15.671 INFO:teuthology.orchestra.run.smithi131.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-07-11T00:01:15.673 INFO:teuthology.orchestra.run.smithi131.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-07-11T00:01:15.673 INFO:teuthology.orchestra.run.smithi131.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-07-11T00:01:15.675 INFO:teuthology.orchestra.run.smithi131.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-07-11T00:01:15.676 INFO:teuthology.orchestra.run.smithi131.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-07-11T00:01:15.677 INFO:teuthology.orchestra.run.smithi131.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-07-11T00:01:15.678 INFO:teuthology.orchestra.run.smithi131.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-07-11T00:01:15.679 INFO:teuthology.orchestra.run.smithi131.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-07-11T00:01:15.681 INFO:teuthology.orchestra.run.smithi131.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-07-11T00:01:15.681 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsdump-3.1.8-6.el8.x86_64 is already installed. 2023-07-11T00:01:15.682 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-07-11T00:01:15.683 INFO:teuthology.orchestra.run.smithi131.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-11T00:01:15.684 INFO:teuthology.orchestra.run.smithi131.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-11T00:01:15.685 INFO:teuthology.orchestra.run.smithi131.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-07-11T00:01:15.686 INFO:teuthology.orchestra.run.smithi131.stdout:Package libuuid-devel-2.32.1-42.el8.x86_64 is already installed. 2023-07-11T00:01:15.687 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-devel-5.0.0-12.el8.x86_64 is already installed. 2023-07-11T00:01:15.689 INFO:teuthology.orchestra.run.smithi131.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-07-11T00:01:15.693 INFO:teuthology.orchestra.run.smithi131.stdout:Package gettext-0.19.8.1-17.el8.x86_64 is already installed. 2023-07-11T00:01:15.700 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-07-11T00:01:15.877 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-07-11T00:01:15.880 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================== 2023-07-11T00:01:15.880 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2023-07-11T00:01:15.880 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================== 2023-07-11T00:01:15.881 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2023-07-11T00:01:15.881 INFO:teuthology.orchestra.run.smithi131.stdout: device-mapper-devel x86_64 8:1.02.181-9.el8 powertools 284 k 2023-07-11T00:01:15.881 INFO:teuthology.orchestra.run.smithi131.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-07-11T00:01:15.881 INFO:teuthology.orchestra.run.smithi131.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-07-11T00:01:15.881 INFO:teuthology.orchestra.run.smithi131.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-07-11T00:01:15.881 INFO:teuthology.orchestra.run.smithi131.stdout: inih-devel x86_64 56-1.el8 epel 13 k 2023-07-11T00:01:15.881 INFO:teuthology.orchestra.run.smithi131.stdout: libblkid-devel x86_64 2.32.1-42.el8 baseos 87 k 2023-07-11T00:01:15.882 INFO:teuthology.orchestra.run.smithi131.stdout: libedit-devel x86_64 3.1-23.20170329cvs.el8 powertools 44 k 2023-07-11T00:01:15.882 INFO:teuthology.orchestra.run.smithi131.stdout: libicu-devel x86_64 60.3-2.el8_1 baseos 922 k 2023-07-11T00:01:15.882 INFO:teuthology.orchestra.run.smithi131.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-07-11T00:01:15.882 INFO:teuthology.orchestra.run.smithi131.stdout: userspace-rcu-devel x86_64 0.10.1-4.el8 powertools 84 k 2023-07-11T00:01:15.882 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2023-07-11T00:01:15.882 INFO:teuthology.orchestra.run.smithi131.stdout: cpp x86_64 8.5.0-20.el8 baseos 10 M 2023-07-11T00:01:15.882 INFO:teuthology.orchestra.run.smithi131.stdout: gcc x86_64 8.5.0-20.el8 baseos 24 M 2023-07-11T00:01:15.882 INFO:teuthology.orchestra.run.smithi131.stdout: gcc-gdb-plugin x86_64 8.5.0-20.el8 appstream 121 k 2023-07-11T00:01:15.883 INFO:teuthology.orchestra.run.smithi131.stdout: gcc-plugin-annobin x86_64 8.5.0-20.el8 baseos 36 k 2023-07-11T00:01:15.883 INFO:teuthology.orchestra.run.smithi131.stdout: libgcc x86_64 8.5.0-20.el8 baseos 81 k 2023-07-11T00:01:15.883 INFO:teuthology.orchestra.run.smithi131.stdout: libgomp x86_64 8.5.0-20.el8 baseos 208 k 2023-07-11T00:01:15.883 INFO:teuthology.orchestra.run.smithi131.stdout: sqlite x86_64 3.26.0-18.el8 baseos 668 k 2023-07-11T00:01:15.883 INFO:teuthology.orchestra.run.smithi131.stdout: sqlite-libs x86_64 3.26.0-18.el8 baseos 581 k 2023-07-11T00:01:15.883 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2023-07-11T00:01:15.883 INFO:teuthology.orchestra.run.smithi131.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-07-11T00:01:15.884 INFO:teuthology.orchestra.run.smithi131.stdout: inih x86_64 56-1.el8 epel 27 k 2023-07-11T00:01:15.884 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-07-11T00:01:15.884 INFO:teuthology.orchestra.run.smithi131.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-07-11T00:01:15.884 INFO:teuthology.orchestra.run.smithi131.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-07-11T00:01:15.884 INFO:teuthology.orchestra.run.smithi131.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-07-11T00:01:15.884 INFO:teuthology.orchestra.run.smithi131.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-07-11T00:01:15.884 INFO:teuthology.orchestra.run.smithi131.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-07-11T00:01:15.885 INFO:teuthology.orchestra.run.smithi131.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-07-11T00:01:15.885 INFO:teuthology.orchestra.run.smithi131.stdout: systemd-devel x86_64 239-75.el8 baseos 511 k 2023-07-11T00:01:15.885 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2023-07-11T00:01:15.885 INFO:teuthology.orchestra.run.smithi131.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-07-11T00:01:15.885 INFO:teuthology.orchestra.run.smithi131.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-07-11T00:01:15.885 INFO:teuthology.orchestra.run.smithi131.stdout:Enabling module streams: 2023-07-11T00:01:15.885 INFO:teuthology.orchestra.run.smithi131.stdout: python27 2.7 2023-07-11T00:01:15.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-11T00:01:15.886 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-07-11T00:01:15.886 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================== 2023-07-11T00:01:15.886 INFO:teuthology.orchestra.run.smithi131.stdout:Install 22 Packages 2023-07-11T00:01:15.886 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 8 Packages 2023-07-11T00:01:15.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-11T00:01:15.887 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 49 M 2023-07-11T00:01:15.887 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-07-11T00:01:16.281 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:01:16.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:01:16.290 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:01:16.629 INFO:teuthology.orchestra.run.smithi131.stdout:(1/30): libpmemblk-1.6.1-1.el8.x86_64.rpm 901 kB/s | 92 kB 00:00 2023-07-11T00:01:16.654 INFO:teuthology.orchestra.run.smithi131.stdout:(2/30): python2-2.7.18-12.module_el8+299+aa6e9a 870 kB/s | 110 kB 00:00 2023-07-11T00:01:16.721 INFO:teuthology.orchestra.run.smithi131.stdout:(3/30): fio-3.19-4.el8.x86_64.rpm 2.7 MB/s | 538 kB 00:00 2023-07-11T00:01:16.805 INFO:teuthology.orchestra.run.smithi131.stdout:(4/30): python2-pip-wheel-9.0.3-19.module_el8+2 10 MB/s | 892 kB 00:00 2023-07-11T00:01:16.880 INFO:teuthology.orchestra.run.smithi131.stdout:(5/30): python2-setuptools-39.0.1-13.module_el8 9.1 MB/s | 702 kB 00:00 2023-07-11T00:01:16.922 INFO:teuthology.orchestra.run.smithi131.stdout:(6/30): python2-setuptools-wheel-39.0.1-13.modu 6.8 MB/s | 287 kB 00:00 2023-07-11T00:01:16.964 INFO:teuthology.orchestra.run.smithi131.stdout:(7/30): python2-wheel-wheel-0.31.1-3.module_el8 1.1 MB/s | 44 kB 00:00 2023-07-11T00:01:17.098 INFO:teuthology.orchestra.run.smithi131.stdout:(8/30): python2-libs-2.7.18-12.module_el8+299+a 14 MB/s | 6.5 MB 00:00 2023-07-11T00:01:17.140 INFO:teuthology.orchestra.run.smithi131.stdout:(9/30): python2-pip-9.0.3-19.module_el8+299+aa6 3.7 MB/s | 1.8 MB 00:00 2023-07-11T00:01:17.165 INFO:teuthology.orchestra.run.smithi131.stdout:(10/30): daxctl-libs-71.1-7.el8.x86_64.rpm 210 kB/s | 42 kB 00:00 2023-07-11T00:01:17.274 INFO:teuthology.orchestra.run.smithi131.stdout:(11/30): libblkid-devel-2.32.1-42.el8.x86_64.rp 654 kB/s | 87 kB 00:00 2023-07-11T00:01:17.366 INFO:teuthology.orchestra.run.smithi131.stdout:(12/30): ndctl-libs-71.1-7.el8.x86_64.rpm 876 kB/s | 80 kB 00:00 2023-07-11T00:01:17.424 INFO:teuthology.orchestra.run.smithi131.stdout:(13/30): dump-0.4-0.36.b46.el8.x86_64.rpm 504 kB/s | 164 kB 00:00 2023-07-11T00:01:17.449 INFO:teuthology.orchestra.run.smithi131.stdout:(14/30): rmt-1.5.3-13.el8.x86_64.rpm 618 kB/s | 51 kB 00:00 2023-07-11T00:01:17.534 INFO:teuthology.orchestra.run.smithi131.stdout:(15/30): libicu-devel-60.3-2.el8_1.x86_64.rpm 2.4 MB/s | 922 kB 00:00 2023-07-11T00:01:17.717 INFO:teuthology.orchestra.run.smithi131.stdout:(16/30): systemd-devel-239-75.el8.x86_64.rpm 1.7 MB/s | 511 kB 00:00 2023-07-11T00:01:17.884 INFO:teuthology.orchestra.run.smithi131.stdout:(17/30): libedit-devel-3.1-23.20170329cvs.el8.x 126 kB/s | 44 kB 00:00 2023-07-11T00:01:18.042 INFO:teuthology.orchestra.run.smithi131.stdout:(18/30): device-mapper-devel-1.02.181-9.el8.x86 480 kB/s | 284 kB 00:00 2023-07-11T00:01:18.068 INFO:teuthology.orchestra.run.smithi131.stdout:(19/30): userspace-rcu-devel-0.10.1-4.el8.x86_6 240 kB/s | 84 kB 00:00 2023-07-11T00:01:18.093 INFO:teuthology.orchestra.run.smithi131.stdout:(20/30): indent-2.2.13-2.el8.x86_64.rpm 895 kB/s | 187 kB 00:00 2023-07-11T00:01:18.143 INFO:teuthology.orchestra.run.smithi131.stdout:(21/30): inih-devel-56-1.el8.x86_64.rpm 176 kB/s | 13 kB 00:00 2023-07-11T00:01:18.177 INFO:teuthology.orchestra.run.smithi131.stdout:(22/30): inih-56-1.el8.x86_64.rpm 203 kB/s | 27 kB 00:00 2023-07-11T00:01:18.202 INFO:teuthology.orchestra.run.smithi131.stdout:(23/30): gcc-gdb-plugin-8.5.0-20.el8.x86_64.rpm 1.1 MB/s | 121 kB 00:00 2023-07-11T00:01:18.336 INFO:teuthology.orchestra.run.smithi131.stdout:(24/30): gcc-plugin-annobin-8.5.0-20.el8.x86_64 268 kB/s | 36 kB 00:00 2023-07-11T00:01:18.461 INFO:teuthology.orchestra.run.smithi131.stdout:(25/30): libgcc-8.5.0-20.el8.x86_64.rpm 653 kB/s | 81 kB 00:00 2023-07-11T00:01:18.636 INFO:teuthology.orchestra.run.smithi131.stdout:(26/30): libgomp-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 208 kB 00:00 2023-07-11T00:01:18.912 INFO:teuthology.orchestra.run.smithi131.stdout:(27/30): sqlite-3.26.0-18.el8.x86_64.rpm 2.4 MB/s | 668 kB 00:00 2023-07-11T00:01:19.079 INFO:teuthology.orchestra.run.smithi131.stdout:(28/30): sqlite-libs-3.26.0-18.el8.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2023-07-11T00:01:19.529 INFO:teuthology.orchestra.run.smithi131.stdout:(29/30): cpp-8.5.0-20.el8.x86_64.rpm 7.5 MB/s | 10 MB 00:01 2023-07-11T00:01:20.529 INFO:teuthology.orchestra.run.smithi131.stdout:(30/30): gcc-8.5.0-20.el8.x86_64.rpm 10 MB/s | 24 MB 00:02 2023-07-11T00:01:20.530 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-07-11T00:01:20.530 INFO:teuthology.orchestra.run.smithi131.stdout:Total 11 MB/s | 49 MB 00:04 2023-07-11T00:01:21.358 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-07-11T00:01:21.479 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-07-11T00:01:21.480 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-07-11T00:01:21.934 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-07-11T00:01:21.939 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-07-11T00:01:23.407 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-07-11T00:01:23.552 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libgcc-8.5.0-20.el8.x86_64 1/38 2023-07-11T00:01:23.677 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libgcc-8.5.0-20.el8.x86_64 1/38 2023-07-11T00:01:23.850 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : sqlite-libs-3.26.0-18.el8.x86_64 2/38 2023-07-11T00:01:24.060 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 3/38 2023-07-11T00:01:24.153 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 3/38 2023-07-11T00:01:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 4/38 2023-07-11T00:01:24.404 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 4/38 2023-07-11T00:01:24.535 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 5/38 2023-07-11T00:01:24.608 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 5/38 2023-07-11T00:01:24.791 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : inih-56-1.el8.x86_64 6/38 2023-07-11T00:01:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libgomp-8.5.0-20.el8.x86_64 7/38 2023-07-11T00:01:25.917 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libgomp-8.5.0-20.el8.x86_64 7/38 2023-07-11T00:01:26.201 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : cpp-8.5.0-20.el8.x86_64 8/38 2023-07-11T00:01:27.922 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cpp-8.5.0-20.el8.x86_64 8/38 2023-07-11T00:01:28.159 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : gcc-8.5.0-20.el8.x86_64 9/38 2023-07-11T00:01:28.482 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: gcc-8.5.0-20.el8.x86_64 9/38 2023-07-11T00:01:28.701 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : systemd-devel-239-75.el8.x86_64 10/38 2023-07-11T00:01:28.864 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 11/38 2023-07-11T00:01:28.998 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 12/38 2023-07-11T00:01:30.410 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 13/38 2023-07-11T00:01:31.143 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 14/38 2023-07-11T00:01:31.542 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 15/38 2023-07-11T00:01:31.766 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 16/38 2023-07-11T00:01:31.970 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 17/38 2023-07-11T00:01:32.018 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 17/38 2023-07-11T00:01:32.224 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 18/38 2023-07-11T00:01:32.416 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : device-mapper-devel-8:1.02.181-9.el8.x86_64 19/38 2023-07-11T00:01:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : gcc-gdb-plugin-8.5.0-20.el8.x86_64 20/38 2023-07-11T00:01:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-20.el8.x86_64 20/38 2023-07-11T00:01:32.818 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : gcc-plugin-annobin-8.5.0-20.el8.x86_64 21/38 2023-07-11T00:01:32.860 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-20.el8.x86_64 21/38 2023-07-11T00:01:33.099 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : inih-devel-56-1.el8.x86_64 22/38 2023-07-11T00:01:33.375 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fio-3.19-4.el8.x86_64 23/38 2023-07-11T00:01:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : sqlite-3.26.0-18.el8.x86_64 24/38 2023-07-11T00:01:34.184 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libicu-devel-60.3-2.el8_1.x86_64 25/38 2023-07-11T00:01:34.465 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : indent-2.2.13-2.el8.x86_64 26/38 2023-07-11T00:01:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : userspace-rcu-devel-0.10.1-4.el8.x86_64 27/38 2023-07-11T00:01:34.837 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libedit-devel-3.1-23.20170329cvs.el8.x86_64 28/38 2023-07-11T00:01:34.971 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libblkid-devel-2.32.1-42.el8.x86_64 29/38 2023-07-11T00:01:35.126 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 30/38 2023-07-11T00:01:35.127 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : gcc-gdb-plugin-8.5.0-19.el8.x86_64 31/38 2023-07-11T00:01:35.368 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-19.el8.x86_64 31/38 2023-07-11T00:01:35.369 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : gcc-plugin-annobin-8.5.0-19.el8.x86_64 32/38 2023-07-11T00:01:35.518 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-19.el8.x86_64 32/38 2023-07-11T00:01:35.538 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: gcc-8.5.0-19.el8.x86_64 33/38 2023-07-11T00:01:35.743 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : gcc-8.5.0-19.el8.x86_64 33/38 2023-07-11T00:01:35.893 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : sqlite-3.26.0-17.el8.x86_64 34/38 2023-07-11T00:01:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : sqlite-libs-3.26.0-17.el8.x86_64 35/38 2023-07-11T00:01:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cpp-8.5.0-19.el8.x86_64 36/38 2023-07-11T00:01:36.185 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : cpp-8.5.0-19.el8.x86_64 36/38 2023-07-11T00:01:36.185 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libgcc-8.5.0-19.el8.x86_64 37/38 2023-07-11T00:01:36.393 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libgcc-8.5.0-19.el8.x86_64 37/38 2023-07-11T00:01:36.408 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 38/38 2023-07-11T00:01:36.408 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libgomp-8.5.0-19.el8.x86_64 38/38 2023-07-11T00:01:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 38/38 2023-07-11T00:01:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fio-3.19-4.el8.x86_64 1/38 2023-07-11T00:01:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/38 2023-07-11T00:01:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/38 2023-07-11T00:01:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/38 2023-07-11T00:01:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/38 2023-07-11T00:01:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/38 2023-07-11T00:01:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/38 2023-07-11T00:01:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/38 2023-07-11T00:01:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/38 2023-07-11T00:01:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 10/38 2023-07-11T00:01:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/38 2023-07-11T00:01:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libblkid-devel-2.32.1-42.el8.x86_64 12/38 2023-07-11T00:01:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libicu-devel-60.3-2.el8_1.x86_64 13/38 2023-07-11T00:01:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 14/38 2023-07-11T00:01:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 15/38 2023-07-11T00:01:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : systemd-devel-239-75.el8.x86_64 16/38 2023-07-11T00:01:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : device-mapper-devel-8:1.02.181-9.el8.x86_64 17/38 2023-07-11T00:01:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libedit-devel-3.1-23.20170329cvs.el8.x86_64 18/38 2023-07-11T00:01:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : userspace-rcu-devel-0.10.1-4.el8.x86_64 19/38 2023-07-11T00:01:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : indent-2.2.13-2.el8.x86_64 20/38 2023-07-11T00:01:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : inih-56-1.el8.x86_64 21/38 2023-07-11T00:01:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : inih-devel-56-1.el8.x86_64 22/38 2023-07-11T00:01:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gcc-gdb-plugin-8.5.0-20.el8.x86_64 23/38 2023-07-11T00:01:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gcc-gdb-plugin-8.5.0-19.el8.x86_64 24/38 2023-07-11T00:01:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cpp-8.5.0-20.el8.x86_64 25/38 2023-07-11T00:01:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cpp-8.5.0-19.el8.x86_64 26/38 2023-07-11T00:01:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gcc-8.5.0-20.el8.x86_64 27/38 2023-07-11T00:01:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gcc-8.5.0-19.el8.x86_64 28/38 2023-07-11T00:01:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gcc-plugin-annobin-8.5.0-20.el8.x86_64 29/38 2023-07-11T00:01:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gcc-plugin-annobin-8.5.0-19.el8.x86_64 30/38 2023-07-11T00:01:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgcc-8.5.0-20.el8.x86_64 31/38 2023-07-11T00:01:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgcc-8.5.0-19.el8.x86_64 32/38 2023-07-11T00:01:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgomp-8.5.0-20.el8.x86_64 33/38 2023-07-11T00:01:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgomp-8.5.0-19.el8.x86_64 34/38 2023-07-11T00:01:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : sqlite-3.26.0-18.el8.x86_64 35/38 2023-07-11T00:01:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 36/38 2023-07-11T00:01:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : sqlite-libs-3.26.0-18.el8.x86_64 37/38 2023-07-11T00:01:38.200 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 38/38 2023-07-11T00:01:38.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-11T00:01:38.200 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2023-07-11T00:01:38.200 INFO:teuthology.orchestra.run.smithi131.stdout: cpp-8.5.0-20.el8.x86_64 gcc-8.5.0-20.el8.x86_64 2023-07-11T00:01:38.200 INFO:teuthology.orchestra.run.smithi131.stdout: gcc-gdb-plugin-8.5.0-20.el8.x86_64 gcc-plugin-annobin-8.5.0-20.el8.x86_64 2023-07-11T00:01:38.201 INFO:teuthology.orchestra.run.smithi131.stdout: libgcc-8.5.0-20.el8.x86_64 libgomp-8.5.0-20.el8.x86_64 2023-07-11T00:01:38.201 INFO:teuthology.orchestra.run.smithi131.stdout: sqlite-3.26.0-18.el8.x86_64 sqlite-libs-3.26.0-18.el8.x86_64 2023-07-11T00:01:38.201 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2023-07-11T00:01:38.201 INFO:teuthology.orchestra.run.smithi131.stdout: daxctl-libs-71.1-7.el8.x86_64 2023-07-11T00:01:38.201 INFO:teuthology.orchestra.run.smithi131.stdout: device-mapper-devel-8:1.02.181-9.el8.x86_64 2023-07-11T00:01:38.201 INFO:teuthology.orchestra.run.smithi131.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-07-11T00:01:38.201 INFO:teuthology.orchestra.run.smithi131.stdout: fio-3.19-4.el8.x86_64 2023-07-11T00:01:38.202 INFO:teuthology.orchestra.run.smithi131.stdout: indent-2.2.13-2.el8.x86_64 2023-07-11T00:01:38.202 INFO:teuthology.orchestra.run.smithi131.stdout: inih-56-1.el8.x86_64 2023-07-11T00:01:38.202 INFO:teuthology.orchestra.run.smithi131.stdout: inih-devel-56-1.el8.x86_64 2023-07-11T00:01:38.202 INFO:teuthology.orchestra.run.smithi131.stdout: libblkid-devel-2.32.1-42.el8.x86_64 2023-07-11T00:01:38.202 INFO:teuthology.orchestra.run.smithi131.stdout: libedit-devel-3.1-23.20170329cvs.el8.x86_64 2023-07-11T00:01:38.202 INFO:teuthology.orchestra.run.smithi131.stdout: libicu-devel-60.3-2.el8_1.x86_64 2023-07-11T00:01:38.202 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-07-11T00:01:38.203 INFO:teuthology.orchestra.run.smithi131.stdout: ndctl-libs-71.1-7.el8.x86_64 2023-07-11T00:01:38.203 INFO:teuthology.orchestra.run.smithi131.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-07-11T00:01:38.203 INFO:teuthology.orchestra.run.smithi131.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-07-11T00:01:38.203 INFO:teuthology.orchestra.run.smithi131.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-07-11T00:01:38.203 INFO:teuthology.orchestra.run.smithi131.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-07-11T00:01:38.203 INFO:teuthology.orchestra.run.smithi131.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-07-11T00:01:38.203 INFO:teuthology.orchestra.run.smithi131.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-07-11T00:01:38.204 INFO:teuthology.orchestra.run.smithi131.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-07-11T00:01:38.204 INFO:teuthology.orchestra.run.smithi131.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-07-11T00:01:38.204 INFO:teuthology.orchestra.run.smithi131.stdout: systemd-devel-239-75.el8.x86_64 2023-07-11T00:01:38.204 INFO:teuthology.orchestra.run.smithi131.stdout: userspace-rcu-devel-0.10.1-4.el8.x86_64 2023-07-11T00:01:38.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-11T00:01:38.204 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-07-11T00:01:38.410 DEBUG:teuthology.orchestra.run.smithi131:> sudo useradd -m fsgqa 2023-07-11T00:01:38.481 INFO:teuthology.orchestra.run.smithi131.stderr:useradd: user 'fsgqa' already exists 2023-07-11T00:01:38.484 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-11T00:01:38.484 DEBUG:teuthology.orchestra.run.smithi131:> sudo groupadd fsgqa 2023-07-11T00:01:38.553 INFO:teuthology.orchestra.run.smithi131.stderr:groupadd: group 'fsgqa' already exists 2023-07-11T00:01:38.556 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-11T00:01:38.557 DEBUG:teuthology.orchestra.run.smithi131:> sudo useradd fsgqa2 2023-07-11T00:01:39.176 DEBUG:teuthology.orchestra.run.smithi131:> sudo useradd 123456-fsgqa 2023-07-11T00:01:39.807 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-11T00:01:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.945+0000 7fa158a50700 1 Processor -- start 2023-07-11T00:01:39.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.945+0000 7fa158a50700 1 -- start start 2023-07-11T00:01:39.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.945+0000 7fa158a50700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa1540b8d90 0x7fa15406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:39.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa158a50700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1540b8620 con 0x7fa1541449d0 2023-07-11T00:01:39.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa158a50700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1540b8900 con 0x7fa1540bc810 2023-07-11T00:01:39.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa158a50700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1540b97a0 con 0x7fa1540b8d90 2023-07-11T00:01:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa152d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa1540b8d90 0x7fa15406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa15259c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa1541449d0 0x7fa15414db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44528/0 (socket says 172.21.15.38:44528) 2023-07-11T00:01:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa15259c700 1 -- 172.21.15.38:0/1462274751 learned_addr learned my addr 172.21.15.38:0/1462274751 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:01:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa152d9d700 1 -- 172.21.15.38:0/1462274751 >> v1:172.21.15.70:6789/0 conn(0x7fa1540bc810 legacy=0x7fa1540ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa152d9d700 1 -- 172.21.15.38:0/1462274751 >> v1:172.21.15.38:6789/0 conn(0x7fa1541449d0 legacy=0x7fa15414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:39.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa152d9d700 1 -- 172.21.15.38:0/1462274751 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1540bac40 con 0x7fa1540b8d90 2023-07-11T00:01:39.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa15159a700 1 -- 172.21.15.38:0/1462274751 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632728034 0 0) 0x7fa1540b8620 con 0x7fa1541449d0 2023-07-11T00:01:39.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa152d9d700 1 --2- 172.21.15.38:0/1462274751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1540b8d90 0x7fa15406ade0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009d90 tx=0x7fa14c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194a41114ec31f27 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:39.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa15159a700 1 -- 172.21.15.38:0/1462274751 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c00e070 con 0x7fa1540b8d90 2023-07-11T00:01:39.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa15159a700 1 -- 172.21.15.38:0/1462274751 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c00bbd0 con 0x7fa1540b8d90 2023-07-11T00:01:39.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.946+0000 7fa15159a700 1 -- 172.21.15.38:0/1462274751 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c012430 con 0x7fa1540b8d90 2023-07-11T00:01:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.947+0000 7fa158a50700 1 -- 172.21.15.38:0/1462274751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1540b8d90 msgr2=0x7fa15406ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.947+0000 7fa158a50700 1 --2- 172.21.15.38:0/1462274751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1540b8d90 0x7fa15406ade0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009d90 tx=0x7fa14c00b330 comp rx=0 tx=0).stop 2023-07-11T00:01:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.947+0000 7fa158a50700 1 -- 172.21.15.38:0/1462274751 shutdown_connections 2023-07-11T00:01:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.947+0000 7fa158a50700 1 --2- 172.21.15.38:0/1462274751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1540b8d90 0x7fa15406ade0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.947+0000 7fa158a50700 1 -- 172.21.15.38:0/1462274751 >> 172.21.15.38:0/1462274751 conn(0x7fa1540c0860 msgr2=0x7fa1540c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.947+0000 7fa158a50700 1 -- 172.21.15.38:0/1462274751 shutdown_connections 2023-07-11T00:01:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.947+0000 7fa158a50700 1 -- 172.21.15.38:0/1462274751 wait complete. 2023-07-11T00:01:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.948+0000 7fa158a50700 1 Processor -- start 2023-07-11T00:01:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.948+0000 7fa158a50700 1 -- start start 2023-07-11T00:01:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa158a50700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1540b8d90 0x7fa1541450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa158a50700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1540bc810 0x7fa1541467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa158a50700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1541449d0 0x7fa154147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa158a50700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa154145610 con 0x7fa1541449d0 2023-07-11T00:01:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa158a50700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa154147e90 con 0x7fa1540bc810 2023-07-11T00:01:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa158a50700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa154145880 con 0x7fa1540b8d90 2023-07-11T00:01:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa152d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1541449d0 0x7fa154147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa152d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1541449d0 0x7fa154147430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33956/0 (socket says 172.21.15.38:33956) 2023-07-11T00:01:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa152d9d700 1 -- 172.21.15.38:0/167030713 learned_addr learned my addr 172.21.15.38:0/167030713 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa151d9b700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1540bc810 0x7fa1541467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa15259c700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1540b8d90 0x7fa1541450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa152d9d700 1 -- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1540b8d90 msgr2=0x7fa1541450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa152d9d700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1540b8d90 0x7fa1541450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa152d9d700 1 -- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1540bc810 msgr2=0x7fa1541467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa152d9d700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1540bc810 0x7fa1541467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa152d9d700 1 -- 172.21.15.38:0/167030713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c009a70 con 0x7fa1541449d0 2023-07-11T00:01:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa151d9b700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1540bc810 0x7fa1541467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:01:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa15259c700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1540b8d90 0x7fa1541450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:01:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.949+0000 7fa152d9d700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1541449d0 0x7fa154147430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa14c014040 tx=0x7fa14c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.950+0000 7fa142ffd700 1 -- 172.21.15.38:0/167030713 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c01b810 con 0x7fa1541449d0 2023-07-11T00:01:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.950+0000 7fa142ffd700 1 -- 172.21.15.38:0/167030713 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c020070 con 0x7fa1541449d0 2023-07-11T00:01:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.950+0000 7fa158a50700 1 -- 172.21.15.38:0/167030713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1541462d0 con 0x7fa1541449d0 2023-07-11T00:01:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.950+0000 7fa142ffd700 1 -- 172.21.15.38:0/167030713 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c01bbb0 con 0x7fa1541449d0 2023-07-11T00:01:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.950+0000 7fa158a50700 1 -- 172.21.15.38:0/167030713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa154146d30 con 0x7fa1541449d0 2023-07-11T00:01:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.951+0000 7fa158a50700 1 -- 172.21.15.38:0/167030713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1540c1190 con 0x7fa1541449d0 2023-07-11T00:01:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.951+0000 7fa142ffd700 1 -- 172.21.15.38:0/167030713 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa14c01bd10 con 0x7fa1541449d0 2023-07-11T00:01:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.951+0000 7fa142ffd700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa13406ace0 0x7fa13406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.952+0000 7fa142ffd700 1 -- 172.21.15.38:0/167030713 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa14c022070 con 0x7fa1541449d0 2023-07-11T00:01:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.952+0000 7fa15259c700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa13406ace0 0x7fa13406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.952+0000 7fa15259c700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa13406ace0 0x7fa13406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa144000f60 tx=0x7fa144007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:39.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:39.956+0000 7fa142ffd700 1 -- 172.21.15.38:0/167030713 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa14c05a600 con 0x7fa1541449d0 2023-07-11T00:01:40.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.239+0000 7fa158a50700 1 -- 172.21.15.38:0/167030713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa1541464c0 con 0x7fa1541449d0 2023-07-11T00:01:40.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.239+0000 7fa142ffd700 1 -- 172.21.15.38:0/167030713 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7fa14c05a190 con 0x7fa1541449d0 2023-07-11T00:01:40.242 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:01:40.242 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":1,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","modified":"2023-07-10T23:59:17.751926Z","created":"2023-07-10T23:59:17.751926Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3301","nonce":0},{"type":"v1","addr":"172.21.15.70:6790","nonce":0}]},"addr":"172.21.15.70:6790/0","public_addr":"172.21.15.70:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-11T00:01:40.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 -- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa13406ace0 msgr2=0x7fa13406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:40.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa13406ace0 0x7fa13406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa144000f60 tx=0x7fa144007ce0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 -- 172.21.15.38:0/167030713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1541449d0 msgr2=0x7fa154147430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:40.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1541449d0 0x7fa154147430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa14c014040 tx=0x7fa14c004ad0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 -- 172.21.15.38:0/167030713 shutdown_connections 2023-07-11T00:01:40.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fa13406ace0 0x7fa13406d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1541449d0 0x7fa154147430 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1540b8d90 0x7fa1541450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 --2- 172.21.15.38:0/167030713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1540bc810 0x7fa1541467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 -- 172.21.15.38:0/167030713 >> 172.21.15.38:0/167030713 conn(0x7fa1540c0860 msgr2=0x7fa1540bef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:40.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 -- 172.21.15.38:0/167030713 shutdown_connections 2023-07-11T00:01:40.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.241+0000 7fa158a50700 1 -- 172.21.15.38:0/167030713 wait complete. 2023-07-11T00:01:40.246 INFO:teuthology.orchestra.run.smithi038.stderr:dumped monmap epoch 1 2023-07-11T00:01:40.256 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-07-11T00:01:40.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.380+0000 7fe3dd4d4700 1 Processor -- start 2023-07-11T00:01:40.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.380+0000 7fe3dd4d4700 1 -- start start 2023-07-11T00:01:40.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3dd4d4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3d8070560 0x7fe3d806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:40.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3dd4d4700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe3d81473e0 0x7fe3d8147880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:40.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3dd4d4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3d8140fc0 0x7fe3d8141410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:40.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3dd4d4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d814b910 con 0x7fe3d8070560 2023-07-11T00:01:40.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3dd4d4700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d814b480 con 0x7fe3d81473e0 2023-07-11T00:01:40.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3dd4d4700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d814ab50 con 0x7fe3d8140fc0 2023-07-11T00:01:40.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3d6ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3d8070560 0x7fe3d806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:40.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3d6ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3d8070560 0x7fe3d806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47124/0 (socket says 172.21.15.38:47124) 2023-07-11T00:01:40.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3d6ffd700 1 -- 172.21.15.38:0/1850475878 learned_addr learned my addr 172.21.15.38:0/1850475878 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:40.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3d67fc700 1 --2- 172.21.15.38:0/1850475878 >> v2:172.21.15.70:3300/0 conn(0x7fe3d81473e0 0x7fe3d8147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:40.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3d77fe700 1 --2- 172.21.15.38:0/1850475878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3d8140fc0 0x7fe3d8141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:40.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3d6ffd700 1 -- 172.21.15.38:0/1850475878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3d8140fc0 msgr2=0x7fe3d8141410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:40.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3d6ffd700 1 --2- 172.21.15.38:0/1850475878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3d8140fc0 0x7fe3d8141410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3d6ffd700 1 -- 172.21.15.38:0/1850475878 >> v2:172.21.15.70:3300/0 conn(0x7fe3d81473e0 msgr2=0x7fe3d8147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:01:40.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3d6ffd700 1 --2- 172.21.15.38:0/1850475878 >> v2:172.21.15.70:3300/0 conn(0x7fe3d81473e0 0x7fe3d8147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3d6ffd700 1 -- 172.21.15.38:0/1850475878 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d814ae30 con 0x7fe3d8070560 2023-07-11T00:01:40.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.381+0000 7fe3d77fe700 1 --2- 172.21.15.38:0/1850475878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3d8140fc0 0x7fe3d8141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-11T00:01:40.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3d6ffd700 1 --2- 172.21.15.38:0/1850475878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d8070560 0x7fe3d806f5e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe3d806f3e0 tx=0x7fe3cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f87c06e14b7527 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:40.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3d5ffb700 1 -- 172.21.15.38:0/1850475878 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00b870 con 0x7fe3d8070560 2023-07-11T00:01:40.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3d5ffb700 1 -- 172.21.15.38:0/1850475878 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00b9d0 con 0x7fe3d8070560 2023-07-11T00:01:40.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3d5ffb700 1 -- 172.21.15.38:0/1850475878 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00bd60 con 0x7fe3d8070560 2023-07-11T00:01:40.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1850475878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d8070560 msgr2=0x7fe3d806f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:40.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3dd4d4700 1 --2- 172.21.15.38:0/1850475878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d8070560 0x7fe3d806f5e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe3d806f3e0 tx=0x7fe3cc009bd0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1850475878 shutdown_connections 2023-07-11T00:01:40.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3dd4d4700 1 --2- 172.21.15.38:0/1850475878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3d8140fc0 0x7fe3d8141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3dd4d4700 1 --2- 172.21.15.38:0/1850475878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d8070560 0x7fe3d806f5e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3dd4d4700 1 --2- 172.21.15.38:0/1850475878 >> v2:172.21.15.70:3300/0 conn(0x7fe3d81473e0 0x7fe3d8147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1850475878 >> 172.21.15.38:0/1850475878 conn(0x7fe3d806d0e0 msgr2=0x7fe3d806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:40.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1850475878 shutdown_connections 2023-07-11T00:01:40.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.382+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1850475878 wait complete. 2023-07-11T00:01:40.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.384+0000 7fe3dd4d4700 1 Processor -- start 2023-07-11T00:01:40.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.384+0000 7fe3dd4d4700 1 -- start start 2023-07-11T00:01:40.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3dd4d4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d8070560 0x7fe3d80bd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:40.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3dd4d4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3d8140fc0 0x7fe3d80bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:40.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3dd4d4700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3d81473e0 0x7fe3d81def70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:40.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3dd4d4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d813ab40 con 0x7fe3d8070560 2023-07-11T00:01:40.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3dd4d4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d814a200 con 0x7fe3d8140fc0 2023-07-11T00:01:40.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3dd4d4700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80bbb00 con 0x7fe3d81473e0 2023-07-11T00:01:40.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3d6ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d8070560 0x7fe3d80bd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:40.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3d6ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d8070560 0x7fe3d80bd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47134/0 (socket says 172.21.15.38:47134) 2023-07-11T00:01:40.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3d6ffd700 1 -- 172.21.15.38:0/1452229740 learned_addr learned my addr 172.21.15.38:0/1452229740 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:01:40.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3d67fc700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3d8140fc0 0x7fe3d80bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:40.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3d6ffd700 1 -- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3d81473e0 msgr2=0x7fe3d81def70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:40.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3d77fe700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3d81473e0 0x7fe3d81def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:40.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3d6ffd700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3d81473e0 0x7fe3d81def70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3d6ffd700 1 -- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3d8140fc0 msgr2=0x7fe3d80bb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:40.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3d6ffd700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3d8140fc0 0x7fe3d80bb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3d6ffd700 1 -- 172.21.15.38:0/1452229740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc009550 con 0x7fe3d8070560 2023-07-11T00:01:40.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.385+0000 7fe3d6ffd700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d8070560 0x7fe3d80bd730 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009fd0 tx=0x7fe3cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:40.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.386+0000 7fe3bf7fe700 1 -- 172.21.15.38:0/1452229740 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc004540 con 0x7fe3d8070560 2023-07-11T00:01:40.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.386+0000 7fe3bf7fe700 1 -- 172.21.15.38:0/1452229740 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc0036a0 con 0x7fe3d8070560 2023-07-11T00:01:40.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.386+0000 7fe3bf7fe700 1 -- 172.21.15.38:0/1452229740 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc003a50 con 0x7fe3d8070560 2023-07-11T00:01:40.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.386+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1452229740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d80bde40 con 0x7fe3d8070560 2023-07-11T00:01:40.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.386+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1452229740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d813b3a0 con 0x7fe3d8070560 2023-07-11T00:01:40.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.387+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1452229740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d8074360 con 0x7fe3d8070560 2023-07-11T00:01:40.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.387+0000 7fe3bf7fe700 1 -- 172.21.15.38:0/1452229740 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3cc021070 con 0x7fe3d8070560 2023-07-11T00:01:40.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.387+0000 7fe3bf7fe700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe3c406ace0 0x7fe3c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:01:40.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.388+0000 7fe3bf7fe700 1 -- 172.21.15.38:0/1452229740 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3cc08aaf0 con 0x7fe3d8070560 2023-07-11T00:01:40.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.388+0000 7fe3d67fc700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe3c406ace0 0x7fe3c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:01:40.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.388+0000 7fe3d67fc700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe3c406ace0 0x7fe3c406d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8144a00 tx=0x7fe3c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:01:40.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.392+0000 7fe3bf7fe700 1 -- 172.21.15.38:0/1452229740 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe3cc055c30 con 0x7fe3d8070560 2023-07-11T00:01:40.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.667+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1452229740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fe3d80b7e60 con 0x7fe3d8070560 2023-07-11T00:01:40.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.667+0000 7fe3bf7fe700 1 -- 172.21.15.38:0/1452229740 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7fe3cc0150a0 con 0x7fe3d8070560 2023-07-11T00:01:40.670 INFO:teuthology.orchestra.run.smithi038.stdout:[client.admin] 2023-07-11T00:01:40.670 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBWm6xkpB9DARAAb1EeiWTaX/KaKrt6QktY8A== 2023-07-11T00:01:40.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.669+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe3c406ace0 msgr2=0x7fe3c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:40.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.669+0000 7fe3dd4d4700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe3c406ace0 0x7fe3c406d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8144a00 tx=0x7fe3c8008040 comp rx=0 tx=0).stop 2023-07-11T00:01:40.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.669+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1452229740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d8070560 msgr2=0x7fe3d80bd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:01:40.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.669+0000 7fe3dd4d4700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d8070560 0x7fe3d80bd730 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009fd0 tx=0x7fe3cc004750 comp rx=0 tx=0).stop 2023-07-11T00:01:40.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.669+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1452229740 shutdown_connections 2023-07-11T00:01:40.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.669+0000 7fe3dd4d4700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fe3c406ace0 0x7fe3c406d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.669+0000 7fe3dd4d4700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3d81473e0 0x7fe3d81def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.669+0000 7fe3dd4d4700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d8070560 0x7fe3d80bd730 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.669+0000 7fe3dd4d4700 1 --2- 172.21.15.38:0/1452229740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3d8140fc0 0x7fe3d80bb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:01:40.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.669+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1452229740 >> 172.21.15.38:0/1452229740 conn(0x7fe3d806d0e0 msgr2=0x7fe3d8069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:01:40.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.670+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1452229740 shutdown_connections 2023-07-11T00:01:40.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:01:40.670+0000 7fe3dd4d4700 1 -- 172.21.15.38:0/1452229740 wait complete. 2023-07-11T00:01:40.685 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-11T00:01:40.686 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/tmp/tmp.ESeo9raKdcxfstests-dev/local.config 2023-07-11T00:01:40.756 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.38:6789:/test export TEST_DIR=/tmp/tmp.GoAWdcZ1qltest export SCRATCH_DEV=172.21.15.38:6789:/scratch export SCRATCH_MNT=/tmp/tmp.kKNWXFcnThscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBWm6xkpB9DARAAb1EeiWTaX/KaKrt6QktY8A==" 2023-07-11T00:01:40.756 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-11T00:01:40.757 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/tmp/tmp.ESeo9raKdcxfstests-dev/ceph.exclude 2023-07-11T00:01:40.865 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.ESeo9raKdcxfstests-dev && exec sudo make) 2023-07-11T00:01:40.988 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize -cfi 2023-07-11T00:01:41.470 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: putting auxiliary files in '.'. 2023-07-11T00:01:41.471 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './config.guess' 2023-07-11T00:01:41.480 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './config.sub' 2023-07-11T00:01:41.490 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './install-sh' 2023-07-11T00:01:41.501 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './ltmain.sh' 2023-07-11T00:01:41.563 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-11T00:01:41.564 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-11T00:01:41.577 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-11T00:01:41.590 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-11T00:01:41.604 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-11T00:01:41.617 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-11T00:01:41.633 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-11T00:01:41.636 INFO:teuthology.orchestra.run.smithi131.stdout:cp include/install-sh . 2023-07-11T00:01:41.639 INFO:teuthology.orchestra.run.smithi131.stdout:aclocal -I m4 2023-07-11T00:01:43.291 INFO:teuthology.orchestra.run.smithi131.stdout:autoheader 2023-07-11T00:01:43.937 INFO:teuthology.orchestra.run.smithi131.stdout:autoconf 2023-07-11T00:01:44.146 INFO:teuthology.orchestra.run.smithi131.stdout:./configure \ 2023-07-11T00:01:44.146 INFO:teuthology.orchestra.run.smithi131.stdout: --libexecdir=/usr/lib \ 2023-07-11T00:01:44.147 INFO:teuthology.orchestra.run.smithi131.stdout: --exec_prefix=/var/lib 2023-07-11T00:01:44.638 INFO:teuthology.orchestra.run.smithi131.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-11T00:01:44.638 INFO:teuthology.orchestra.run.smithi131.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-11T00:01:44.642 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to print strings... printf 2023-07-11T00:01:44.642 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc... gcc 2023-07-11T00:01:44.873 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether the C compiler works... yes 2023-07-11T00:01:44.873 INFO:teuthology.orchestra.run.smithi131.stdout:checking for C compiler default output file name... a.out 2023-07-11T00:01:44.925 INFO:teuthology.orchestra.run.smithi131.stdout:checking for suffix of executables... 2023-07-11T00:01:44.994 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether we are cross compiling... no 2023-07-11T00:01:45.032 INFO:teuthology.orchestra.run.smithi131.stdout:checking for suffix of object files... o 2023-07-11T00:01:45.066 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether we are using the GNU C compiler... yes 2023-07-11T00:01:45.100 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether gcc accepts -g... yes 2023-07-11T00:01:45.148 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-11T00:01:45.155 INFO:teuthology.orchestra.run.smithi131.stdout:checking for a sed that does not truncate output... /bin/sed 2023-07-11T00:01:45.160 INFO:teuthology.orchestra.run.smithi131.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-07-11T00:01:45.163 INFO:teuthology.orchestra.run.smithi131.stdout:checking for egrep... /bin/grep -E 2023-07-11T00:01:45.166 INFO:teuthology.orchestra.run.smithi131.stdout:checking for fgrep... /bin/grep -F 2023-07-11T00:01:45.174 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ld used by gcc... /bin/ld 2023-07-11T00:01:45.178 INFO:teuthology.orchestra.run.smithi131.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-07-11T00:01:45.191 INFO:teuthology.orchestra.run.smithi131.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-07-11T00:01:45.231 INFO:teuthology.orchestra.run.smithi131.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-07-11T00:01:45.232 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether ln -s works... yes 2023-07-11T00:01:45.247 INFO:teuthology.orchestra.run.smithi131.stdout:checking the maximum length of command line arguments... 1572864 2023-07-11T00:01:45.253 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-11T00:01:45.253 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-11T00:01:45.253 INFO:teuthology.orchestra.run.smithi131.stdout:checking for /bin/ld option to reload object files... -r 2023-07-11T00:01:45.253 INFO:teuthology.orchestra.run.smithi131.stdout:checking for objdump... objdump 2023-07-11T00:01:45.254 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to recognize dependent libraries... pass_all 2023-07-11T00:01:45.255 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dlltool... no 2023-07-11T00:01:45.255 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-11T00:01:45.255 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ar... ar 2023-07-11T00:01:45.307 INFO:teuthology.orchestra.run.smithi131.stdout:checking for archiver @FILE support... @ 2023-07-11T00:01:45.307 INFO:teuthology.orchestra.run.smithi131.stdout:checking for strip... strip 2023-07-11T00:01:45.308 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ranlib... ranlib 2023-07-11T00:01:45.308 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gawk... gawk 2023-07-11T00:01:45.416 INFO:teuthology.orchestra.run.smithi131.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-07-11T00:01:45.419 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sysroot... no 2023-07-11T00:01:45.426 INFO:teuthology.orchestra.run.smithi131.stdout:checking for a working dd... /bin/dd 2023-07-11T00:01:45.433 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-07-11T00:01:45.462 INFO:teuthology.orchestra.run.smithi131.stdout:checking for mt... no 2023-07-11T00:01:45.467 INFO:teuthology.orchestra.run.smithi131.stdout:checking if : is a manifest tool... no 2023-07-11T00:01:45.523 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to run the C preprocessor... gcc -E 2023-07-11T00:01:45.750 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ANSI C header files... yes 2023-07-11T00:01:45.793 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/types.h... yes 2023-07-11T00:01:45.857 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/stat.h... yes 2023-07-11T00:01:45.908 INFO:teuthology.orchestra.run.smithi131.stdout:checking for stdlib.h... yes 2023-07-11T00:01:45.961 INFO:teuthology.orchestra.run.smithi131.stdout:checking for string.h... yes 2023-07-11T00:01:46.014 INFO:teuthology.orchestra.run.smithi131.stdout:checking for memory.h... yes 2023-07-11T00:01:46.067 INFO:teuthology.orchestra.run.smithi131.stdout:checking for strings.h... yes 2023-07-11T00:01:46.123 INFO:teuthology.orchestra.run.smithi131.stdout:checking for inttypes.h... yes 2023-07-11T00:01:46.176 INFO:teuthology.orchestra.run.smithi131.stdout:checking for stdint.h... yes 2023-07-11T00:01:46.234 INFO:teuthology.orchestra.run.smithi131.stdout:checking for unistd.h... yes 2023-07-11T00:01:46.294 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dlfcn.h... yes 2023-07-11T00:01:46.302 INFO:teuthology.orchestra.run.smithi131.stdout:checking for objdir... .libs 2023-07-11T00:01:46.437 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-11T00:01:46.437 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-11T00:01:46.473 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:01:46.474 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-11T00:01:46.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:01:46.479 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:01:46.516 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc static flag -static works... no 2023-07-11T00:01:46.571 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc supports -c -o file.o... yes 2023-07-11T00:01:46.571 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-11T00:01:46.586 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-11T00:01:46.635 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether -lc should be explicitly linked in... no 2023-07-11T00:01:46.734 INFO:teuthology.orchestra.run.smithi131.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-11T00:01:46.734 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to hardcode library paths into programs... immediate 2023-07-11T00:01:46.744 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether stripping libraries is possible... yes 2023-07-11T00:01:46.744 INFO:teuthology.orchestra.run.smithi131.stdout:checking if libtool supports shared libraries... yes 2023-07-11T00:01:46.745 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether to build shared libraries... yes 2023-07-11T00:01:46.745 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether to build static libraries... yes 2023-07-11T00:01:46.756 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc... (cached) gcc 2023-07-11T00:01:46.794 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-11T00:01:46.794 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-11T00:01:46.794 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-11T00:01:46.795 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gmake... /usr/bin/gmake 2023-07-11T00:01:46.795 INFO:teuthology.orchestra.run.smithi131.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-07-11T00:01:46.796 INFO:teuthology.orchestra.run.smithi131.stdout:checking for tar... /bin/tar 2023-07-11T00:01:46.796 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gzip... /bin/gzip 2023-07-11T00:01:46.812 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether gcc -MM is supported... yes 2023-07-11T00:01:46.813 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sort... /bin/sort 2023-07-11T00:01:46.813 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether ln -s works... yes 2023-07-11T00:01:46.813 INFO:teuthology.orchestra.run.smithi131.stdout:checking for rpm... /bin/rpm 2023-07-11T00:01:46.821 INFO:teuthology.orchestra.run.smithi131.stdout:checking for rpmbuild... no 2023-07-11T00:01:46.874 INFO:teuthology.orchestra.run.smithi131.stdout:checking assert.h usability... yes 2023-07-11T00:01:46.890 INFO:teuthology.orchestra.run.smithi131.stdout:checking assert.h presence... yes 2023-07-11T00:01:46.890 INFO:teuthology.orchestra.run.smithi131.stdout:checking for assert.h... yes 2023-07-11T00:01:46.946 INFO:teuthology.orchestra.run.smithi131.stdout:checking bstring.h usability... no 2023-07-11T00:01:46.971 INFO:teuthology.orchestra.run.smithi131.stdout:checking bstring.h presence... no 2023-07-11T00:01:46.971 INFO:teuthology.orchestra.run.smithi131.stdout:checking for bstring.h... no 2023-07-11T00:01:47.020 INFO:teuthology.orchestra.run.smithi131.stdout:checking libgen.h usability... yes 2023-07-11T00:01:47.036 INFO:teuthology.orchestra.run.smithi131.stdout:checking libgen.h presence... yes 2023-07-11T00:01:47.036 INFO:teuthology.orchestra.run.smithi131.stdout:checking for libgen.h... yes 2023-07-11T00:01:47.094 INFO:teuthology.orchestra.run.smithi131.stdout:checking dirent.h usability... yes 2023-07-11T00:01:47.111 INFO:teuthology.orchestra.run.smithi131.stdout:checking dirent.h presence... yes 2023-07-11T00:01:47.111 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dirent.h... yes 2023-07-11T00:01:47.190 INFO:teuthology.orchestra.run.smithi131.stdout:checking errno.h usability... yes 2023-07-11T00:01:47.206 INFO:teuthology.orchestra.run.smithi131.stdout:checking errno.h presence... yes 2023-07-11T00:01:47.207 INFO:teuthology.orchestra.run.smithi131.stdout:checking for errno.h... yes 2023-07-11T00:01:47.266 INFO:teuthology.orchestra.run.smithi131.stdout:checking malloc.h usability... yes 2023-07-11T00:01:47.284 INFO:teuthology.orchestra.run.smithi131.stdout:checking malloc.h presence... yes 2023-07-11T00:01:47.284 INFO:teuthology.orchestra.run.smithi131.stdout:checking for malloc.h... yes 2023-07-11T00:01:47.340 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid.h usability... no 2023-07-11T00:01:47.364 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid.h presence... no 2023-07-11T00:01:47.364 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid.h... no 2023-07-11T00:01:47.424 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid/uuid.h usability... yes 2023-07-11T00:01:47.443 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid/uuid.h presence... yes 2023-07-11T00:01:47.443 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid/uuid.h... yes 2023-07-11T00:01:47.500 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/uuid.h usability... no 2023-07-11T00:01:47.524 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/uuid.h presence... no 2023-07-11T00:01:47.524 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/uuid.h... no 2023-07-11T00:01:47.578 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/file.h usability... yes 2023-07-11T00:01:47.595 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/file.h presence... yes 2023-07-11T00:01:47.595 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/file.h... yes 2023-07-11T00:01:47.653 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fcntl.h usability... yes 2023-07-11T00:01:47.670 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fcntl.h presence... yes 2023-07-11T00:01:47.671 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/fcntl.h... yes 2023-07-11T00:01:47.726 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/syssgi.h usability... no 2023-07-11T00:01:47.749 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/syssgi.h presence... no 2023-07-11T00:01:47.750 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/syssgi.h... no 2023-07-11T00:01:47.845 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/param.h usability... yes 2023-07-11T00:01:47.866 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/param.h presence... yes 2023-07-11T00:01:47.866 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/param.h... yes 2023-07-11T00:01:47.880 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/stat.h... (cached) yes 2023-07-11T00:01:47.946 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/statvfs.h usability... yes 2023-07-11T00:01:47.962 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/statvfs.h presence... yes 2023-07-11T00:01:47.963 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/statvfs.h... yes 2023-07-11T00:01:48.019 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/time.h usability... yes 2023-07-11T00:01:48.036 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/time.h presence... yes 2023-07-11T00:01:48.036 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/time.h... yes 2023-07-11T00:01:48.105 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/ioctl.h usability... yes 2023-07-11T00:01:48.122 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/ioctl.h presence... yes 2023-07-11T00:01:48.122 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/ioctl.h... yes 2023-07-11T00:01:48.182 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/wait.h usability... yes 2023-07-11T00:01:48.201 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/wait.h presence... yes 2023-07-11T00:01:48.202 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/wait.h... yes 2023-07-11T00:01:48.215 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/types.h... (cached) yes 2023-07-11T00:01:48.229 INFO:teuthology.orchestra.run.smithi131.stdout:checking for strings.h... (cached) yes 2023-07-11T00:01:48.287 INFO:teuthology.orchestra.run.smithi131.stdout:checking err.h usability... yes 2023-07-11T00:01:48.302 INFO:teuthology.orchestra.run.smithi131.stdout:checking err.h presence... yes 2023-07-11T00:01:48.303 INFO:teuthology.orchestra.run.smithi131.stdout:checking for err.h... yes 2023-07-11T00:01:48.360 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/falloc.h usability... yes 2023-07-11T00:01:48.376 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/falloc.h presence... yes 2023-07-11T00:01:48.376 INFO:teuthology.orchestra.run.smithi131.stdout:checking for linux/falloc.h... yes 2023-07-11T00:01:48.432 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-07-11T00:01:48.456 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-07-11T00:01:48.457 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/fs/xfs_fsops.h... no 2023-07-11T00:01:48.505 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fs/xfs_itable.h usability... no 2023-07-11T00:01:48.529 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/fs/xfs_itable.h presence... no 2023-07-11T00:01:48.529 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/fs/xfs_itable.h... no 2023-07-11T00:01:48.577 INFO:teuthology.orchestra.run.smithi131.stdout:checking xfs/platform_defs.h usability... no 2023-07-11T00:01:48.601 INFO:teuthology.orchestra.run.smithi131.stdout:checking xfs/platform_defs.h presence... no 2023-07-11T00:01:48.601 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/platform_defs.h... no 2023-07-11T00:01:48.649 INFO:teuthology.orchestra.run.smithi131.stdout:checking btrfs/ioctl.h usability... no 2023-07-11T00:01:48.673 INFO:teuthology.orchestra.run.smithi131.stdout:checking btrfs/ioctl.h presence... no 2023-07-11T00:01:48.673 INFO:teuthology.orchestra.run.smithi131.stdout:checking for btrfs/ioctl.h... no 2023-07-11T00:01:48.722 INFO:teuthology.orchestra.run.smithi131.stdout:checking cifs/ioctl.h usability... no 2023-07-11T00:01:48.746 INFO:teuthology.orchestra.run.smithi131.stdout:checking cifs/ioctl.h presence... no 2023-07-11T00:01:48.746 INFO:teuthology.orchestra.run.smithi131.stdout:checking for cifs/ioctl.h... no 2023-07-11T00:01:48.797 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/mman.h usability... yes 2023-07-11T00:01:48.814 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/mman.h presence... yes 2023-07-11T00:01:48.814 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/mman.h... yes 2023-07-11T00:01:48.851 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/xfs_log_format.h... no 2023-07-11T00:01:48.918 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid_compare... no 2023-07-11T00:01:48.975 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid_compare in -luuid... yes 2023-07-11T00:01:49.051 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/xfs.h... yes 2023-07-11T00:01:49.083 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/libxfs.h... no 2023-07-11T00:01:49.121 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether xlog_assign_lsn is declared... no 2023-07-11T00:01:49.173 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/xqm.h... yes 2023-07-11T00:01:49.252 INFO:teuthology.orchestra.run.smithi131.stdout:checking xfsctl from xfs/xfs.h... ok 2023-07-11T00:01:49.298 INFO:teuthology.orchestra.run.smithi131.stdout:checking xfs/handle.h usability... yes 2023-07-11T00:01:49.313 INFO:teuthology.orchestra.run.smithi131.stdout:checking xfs/handle.h presence... yes 2023-07-11T00:01:49.314 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xfs/handle.h... yes 2023-07-11T00:01:49.372 INFO:teuthology.orchestra.run.smithi131.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-07-11T00:01:49.420 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/acl.h usability... yes 2023-07-11T00:01:49.438 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/acl.h presence... yes 2023-07-11T00:01:49.439 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/acl.h... yes 2023-07-11T00:01:49.494 INFO:teuthology.orchestra.run.smithi131.stdout:checking acl/libacl.h usability... yes 2023-07-11T00:01:49.511 INFO:teuthology.orchestra.run.smithi131.stdout:checking acl/libacl.h presence... yes 2023-07-11T00:01:49.512 INFO:teuthology.orchestra.run.smithi131.stdout:checking for acl/libacl.h... yes 2023-07-11T00:01:49.572 INFO:teuthology.orchestra.run.smithi131.stdout:checking for acl_init in -lacl... yes 2023-07-11T00:01:49.616 INFO:teuthology.orchestra.run.smithi131.stdout:checking gdbm-ndbm.h usability... no 2023-07-11T00:01:49.640 INFO:teuthology.orchestra.run.smithi131.stdout:checking gdbm-ndbm.h presence... no 2023-07-11T00:01:49.641 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gdbm-ndbm.h... no 2023-07-11T00:01:49.683 INFO:teuthology.orchestra.run.smithi131.stdout:checking gdbm/ndbm.h usability... no 2023-07-11T00:01:49.707 INFO:teuthology.orchestra.run.smithi131.stdout:checking gdbm/ndbm.h presence... no 2023-07-11T00:01:49.707 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gdbm/ndbm.h... no 2023-07-11T00:01:49.749 INFO:teuthology.orchestra.run.smithi131.stdout:checking ndbm.h usability... no 2023-07-11T00:01:49.773 INFO:teuthology.orchestra.run.smithi131.stdout:checking ndbm.h presence... no 2023-07-11T00:01:49.773 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ndbm.h... no 2023-07-11T00:01:49.820 INFO:teuthology.orchestra.run.smithi131.stdout:checking libaio.h usability... yes 2023-07-11T00:01:49.842 INFO:teuthology.orchestra.run.smithi131.stdout:checking libaio.h presence... yes 2023-07-11T00:01:49.843 INFO:teuthology.orchestra.run.smithi131.stdout:checking for libaio.h... yes 2023-07-11T00:01:49.887 INFO:teuthology.orchestra.run.smithi131.stdout:checking liburing.h usability... no 2023-07-11T00:01:49.911 INFO:teuthology.orchestra.run.smithi131.stdout:checking liburing.h presence... no 2023-07-11T00:01:49.911 INFO:teuthology.orchestra.run.smithi131.stdout:checking for liburing.h... no 2023-07-11T00:01:49.954 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/capability.h usability... no 2023-07-11T00:01:49.978 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/capability.h presence... no 2023-07-11T00:01:49.978 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/capability.h... no 2023-07-11T00:01:50.022 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/fiemap.h usability... yes 2023-07-11T00:01:50.038 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/fiemap.h presence... yes 2023-07-11T00:01:50.038 INFO:teuthology.orchestra.run.smithi131.stdout:checking for linux/fiemap.h... yes 2023-07-11T00:01:50.099 INFO:teuthology.orchestra.run.smithi131.stdout:checking for fallocate... yes 2023-07-11T00:01:50.160 INFO:teuthology.orchestra.run.smithi131.stdout:checking for open_by_handle_at... yes 2023-07-11T00:01:50.207 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/prctl.h usability... yes 2023-07-11T00:01:50.224 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/prctl.h presence... yes 2023-07-11T00:01:50.224 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/prctl.h... yes 2023-07-11T00:01:50.270 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/fs.h usability... yes 2023-07-11T00:01:50.287 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/fs.h presence... yes 2023-07-11T00:01:50.287 INFO:teuthology.orchestra.run.smithi131.stdout:checking for linux/fs.h... yes 2023-07-11T00:01:50.330 INFO:teuthology.orchestra.run.smithi131.stdout:checking btrfsutil.h usability... no 2023-07-11T00:01:50.354 INFO:teuthology.orchestra.run.smithi131.stdout:checking btrfsutil.h presence... no 2023-07-11T00:01:50.354 INFO:teuthology.orchestra.run.smithi131.stdout:checking for btrfsutil.h... no 2023-07-11T00:01:50.416 INFO:teuthology.orchestra.run.smithi131.stdout:checking for copy_file_range... yes 2023-07-11T00:01:50.479 INFO:teuthology.orchestra.run.smithi131.stdout:checking for SEEK_DATA... yes 2023-07-11T00:01:50.559 INFO:teuthology.orchestra.run.smithi131.stdout:checking for BMV_OF_SHARED... yes 2023-07-11T00:01:50.624 INFO:teuthology.orchestra.run.smithi131.stdout:checking for nftw... yes 2023-07-11T00:01:50.686 INFO:teuthology.orchestra.run.smithi131.stdout:checking for RLIMIT_NOFILE... yes 2023-07-11T00:01:50.724 INFO:teuthology.orchestra.run.smithi131.stdout:checking for FIEXCHANGE_RANGE... no 2023-07-11T00:01:50.785 INFO:teuthology.orchestra.run.smithi131.stdout:checking for renameat2... yes 2023-07-11T00:01:50.846 INFO:teuthology.orchestra.run.smithi131.stdout:checking for reallocarray... yes 2023-07-11T00:01:50.879 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct mount_attr... no 2023-07-11T00:01:50.956 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_qgroup_limit... yes 2023-07-11T00:01:51.029 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-07-11T00:01:51.102 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-07-11T00:01:51.175 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-07-11T00:01:51.249 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-07-11T00:01:51.321 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-07-11T00:01:51.394 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-07-11T00:01:51.448 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/btrfs.h usability... yes 2023-07-11T00:01:51.464 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/btrfs.h presence... yes 2023-07-11T00:01:51.465 INFO:teuthology.orchestra.run.smithi131.stdout:checking for linux/btrfs.h... yes 2023-07-11T00:01:51.526 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/btrfs_tree.h usability... yes 2023-07-11T00:01:51.543 INFO:teuthology.orchestra.run.smithi131.stdout:checking linux/btrfs_tree.h presence... yes 2023-07-11T00:01:51.543 INFO:teuthology.orchestra.run.smithi131.stdout:checking for linux/btrfs_tree.h... yes 2023-07-11T00:01:51.616 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-07-11T00:01:51.645 INFO:teuthology.orchestra.run.smithi131.stdout:configure: creating ./config.status 2023-07-11T00:01:52.540 INFO:teuthology.orchestra.run.smithi131.stdout:config.status: creating include/builddefs 2023-07-11T00:01:52.569 INFO:teuthology.orchestra.run.smithi131.stdout:config.status: creating include/config.h 2023-07-11T00:01:52.591 INFO:teuthology.orchestra.run.smithi131.stdout:config.status: executing libtool commands 2023-07-11T00:01:52.669 INFO:teuthology.orchestra.run.smithi131.stdout:Building include 2023-07-11T00:01:52.676 INFO:teuthology.orchestra.run.smithi131.stdout:Building lib 2023-07-11T00:01:52.683 INFO:teuthology.orchestra.run.smithi131.stdout: [LTDEP] 2023-07-11T00:01:52.895 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dataascii.lo 2023-07-11T00:01:53.097 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] databin.lo 2023-07-11T00:01:53.330 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] datapid.lo 2023-07-11T00:01:53.517 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] file_lock.lo 2023-07-11T00:01:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] forker.lo 2023-07-11T00:01:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] pattern.lo 2023-07-11T00:01:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] open_flags.lo 2023-07-11T00:01:54.398 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] random_range.lo 2023-07-11T00:01:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] string_to_tokens.lo 2023-07-11T00:01:54.889 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] str_to_bytes.lo 2023-07-11T00:01:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] tlibio.lo 2023-07-11T00:01:55.425 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] write_log.lo 2023-07-11T00:01:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] random.lo 2023-07-11T00:01:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] 2023-07-11T00:01:56.099 INFO:teuthology.orchestra.run.smithi131.stdout:Building ltp 2023-07-11T00:01:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2023-07-11T00:01:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] doio 2023-07-11T00:01:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsstress 2023-07-11T00:01:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsx 2023-07-11T00:01:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] growfiles 2023-07-11T00:01:59.939 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] iogen 2023-07-11T00:02:00.387 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-stress 2023-07-11T00:02:00.894 INFO:teuthology.orchestra.run.smithi131.stdout:Building src 2023-07-11T00:02:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2023-07-11T00:02:03.307 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2023-07-11T00:02:03.356 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2023-07-11T00:02:03.373 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2023-07-11T00:02:03.712 INFO:teuthology.orchestra.run.smithi131.stdout: [DEP] 2023-07-11T00:02:03.752 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dirstress 2023-07-11T00:02:04.088 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fill 2023-07-11T00:02:04.340 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fill2 2023-07-11T00:02:04.669 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] getpagesize 2023-07-11T00:02:04.903 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] holes 2023-07-11T00:02:05.197 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] lstat64 2023-07-11T00:02:05.478 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] nametest 2023-07-11T00:02:05.814 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] permname 2023-07-11T00:02:06.112 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] randholes 2023-07-11T00:02:06.459 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] runas 2023-07-11T00:02:06.736 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] truncfile 2023-07-11T00:02:07.015 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] usemem 2023-07-11T00:02:07.265 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mmapcat 2023-07-11T00:02:07.512 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] append_reader 2023-07-11T00:02:07.763 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] append_writer 2023-07-11T00:02:08.014 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dirperf 2023-07-11T00:02:08.335 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] metaperf 2023-07-11T00:02:08.684 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] devzero 2023-07-11T00:02:08.960 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] feature 2023-07-11T00:02:09.275 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] alloc 2023-07-11T00:02:09.585 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fault 2023-07-11T00:02:09.850 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fstest 2023-07-11T00:02:10.186 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_access_root 2023-07-11T00:02:10.439 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] godown 2023-07-11T00:02:10.710 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] resvtest 2023-07-11T00:02:10.996 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] writemod 2023-07-11T00:02:11.240 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] writev_on_pagefault 2023-07-11T00:02:11.498 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] makeextents 2023-07-11T00:02:11.779 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] itrash 2023-07-11T00:02:12.033 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] rename 2023-07-11T00:02:12.269 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] multi_open_unlink 2023-07-11T00:02:12.533 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] unwritten_sync 2023-07-11T00:02:12.813 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] genhashnames 2023-07-11T00:02:13.098 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_holes 2023-07-11T00:02:13.344 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_writev 2023-07-11T00:02:13.590 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_truncate_cmtime 2023-07-11T00:02:13.848 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dirhash_collide 2023-07-11T00:02:14.128 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_rename_overwrite 2023-07-11T00:02:14.368 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] holetest 2023-07-11T00:02:14.683 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_truncate_self 2023-07-11T00:02:14.921 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] af_unix 2023-07-11T00:02:15.173 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_stale_pmd 2023-07-11T00:02:15.424 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_cow_race 2023-07-11T00:02:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_fallocate 2023-07-11T00:02:15.940 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsync-err 2023-07-11T00:02:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_write_ro 2023-07-11T00:02:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_ext4_dax_journal_corruption 2023-07-11T00:02:16.588 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:02:16.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:02:16.594 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:02:16.736 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_ext4_dax_inline_corruption 2023-07-11T00:02:16.990 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_ofd_locks 2023-07-11T00:02:17.289 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_collision 2023-07-11T00:02:17.585 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mmap-write-concurrent 2023-07-11T00:02:17.854 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_get_file_time 2023-07-11T00:02:18.100 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_create_short_dirs 2023-07-11T00:02:18.365 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_create_long_dirs 2023-07-11T00:02:18.627 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_enospc 2023-07-11T00:02:18.912 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_writev_overlap 2023-07-11T00:02:19.181 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] checkpoint_journal 2023-07-11T00:02:19.433 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mmap-rw-fault 2023-07-11T00:02:19.720 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] allocstale 2023-07-11T00:02:19.988 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_cow_memory_failure 2023-07-11T00:02:20.258 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fake-dump-rootino 2023-07-11T00:02:20.508 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dio-buf-fault 2023-07-11T00:02:20.762 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfsctl 2023-07-11T00:02:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bstat 2023-07-11T00:02:21.357 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mtab 2023-07-11T00:02:21.642 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] getdevicesize 2023-07-11T00:02:21.882 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] preallo_rw_pattern_reader 2023-07-11T00:02:22.143 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] preallo_rw_pattern_writer 2023-07-11T00:02:22.404 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] ftrunc 2023-07-11T00:02:22.651 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] trunc 2023-07-11T00:02:22.911 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fs_perms 2023-07-11T00:02:23.175 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] testx 2023-07-11T00:02:23.404 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] looptest 2023-07-11T00:02:23.693 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] locktest 2023-07-11T00:02:24.092 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] unwritten_mmap 2023-07-11T00:02:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bulkstat_unlink_test 2023-07-11T00:02:24.656 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] deduperace 2023-07-11T00:02:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bulkstat_unlink_test_modified 2023-07-11T00:02:25.247 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_dir_offset 2023-07-11T00:02:25.495 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_futimens 2023-07-11T00:02:25.735 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_immutable 2023-07-11T00:02:26.417 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] stale_handle 2023-07-11T00:02:26.689 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] pwrite_mmap_blocked 2023-07-11T00:02:26.944 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_dir_offset2 2023-07-11T00:02:27.235 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] seek_sanity_test 2023-07-11T00:02:27.738 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] seek_copy_test 2023-07-11T00:02:28.014 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_readdir_1 2023-07-11T00:02:28.261 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_readdir_2 2023-07-11T00:02:28.512 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsync-tester 2023-07-11T00:02:28.857 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] nsexec 2023-07-11T00:02:29.132 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] cloner 2023-07-11T00:02:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] renameat2 2023-07-11T00:02:29.677 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_getcwd 2023-07-11T00:02:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] e4compact 2023-07-11T00:02:30.236 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] test-nextquota 2023-07-11T00:02:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] punch-alternating 2023-07-11T00:02:30.780 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] attr-list-by-handle-cursor-test 2023-07-11T00:02:31.049 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] listxattr 2023-07-11T00:02:31.295 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dio-interleaved 2023-07-11T00:02:31.554 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_dir_type 2023-07-11T00:02:31.810 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dio-invalidate-cache 2023-07-11T00:02:32.112 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] stat_test 2023-07-11T00:02:32.503 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_encrypted_d_revalidate 2023-07-11T00:02:32.768 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] attr_replace_test 2023-07-11T00:02:33.031 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] swapon 2023-07-11T00:02:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mkswap 2023-07-11T00:02:33.547 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_attr_corruption 2023-07-11T00:02:33.796 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_open_tmpfiles 2023-07-11T00:02:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fscrypt-crypt-util 2023-07-11T00:02:34.786 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bulkstat_null_ocount 2023-07-11T00:02:35.047 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] splice-test 2023-07-11T00:02:35.327 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] chprojid_fail 2023-07-11T00:02:35.592 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] detached_mounts_propagation 2023-07-11T00:02:35.879 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] ext4_resize 2023-07-11T00:02:36.126 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_readdir_3 2023-07-11T00:02:36.419 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] splice2pipe 2023-07-11T00:02:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] uuid_ioctl 2023-07-11T00:02:36.935 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fiemap-tester 2023-07-11T00:02:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_stripealign 2023-07-11T00:02:37.552 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] open_by_handle 2023-07-11T00:02:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] t_mmap_dio 2023-07-11T00:02:38.168 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfsfind 2023-07-11T00:02:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fssum 2023-07-11T00:02:38.988 INFO:teuthology.orchestra.run.smithi131.stdout:Building log-writes 2023-07-11T00:02:38.997 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] replay-log 2023-07-11T00:02:39.407 INFO:teuthology.orchestra.run.smithi131.stdout:Building perf 2023-07-11T00:02:39.414 INFO:teuthology.orchestra.run.smithi131.stdout:Building aio-dio-regress 2023-07-11T00:02:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-append-write-fallocate-race 2023-07-11T00:02:39.700 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-fcntl-race 2023-07-11T00:02:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-subblock-eof-read 2023-07-11T00:02:40.216 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-append-write-read-race 2023-07-11T00:02:40.492 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-invalidate-readahead 2023-07-11T00:02:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-hole-filling-race 2023-07-11T00:02:41.014 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-07-11T00:02:41.252 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-last-ref-held-by-io 2023-07-11T00:02:41.528 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-cycle-write 2023-07-11T00:02:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-extend-stat 2023-07-11T00:02:42.084 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-07-11T00:02:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-invalidate-failure 2023-07-11T00:02:42.583 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aiodio_sparse2 2023-07-11T00:02:42.899 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aiocp 2023-07-11T00:02:43.224 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-cow-race 2023-07-11T00:02:43.483 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-write-verify 2023-07-11T00:02:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] aio-dio-eof-race 2023-07-11T00:02:44.062 INFO:teuthology.orchestra.run.smithi131.stdout:Building vfs 2023-07-11T00:02:44.072 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] vfstest 2023-07-11T00:02:46.050 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mount-idmapped 2023-07-11T00:02:46.536 INFO:teuthology.orchestra.run.smithi131.stdout:Building m4 2023-07-11T00:02:46.543 INFO:teuthology.orchestra.run.smithi131.stdout:Building common 2023-07-11T00:02:46.550 INFO:teuthology.orchestra.run.smithi131.stdout:Building tests 2023-07-11T00:02:46.560 INFO:teuthology.orchestra.run.smithi131.stdout:Building perf 2023-07-11T00:02:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/perf/group.list 2023-07-11T00:02:46.600 INFO:teuthology.orchestra.run.smithi131.stdout:Building ext4 2023-07-11T00:02:46.610 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/ext4/group.list 2023-07-11T00:02:46.688 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:02:46.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:02:46.694 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:02:46.703 INFO:teuthology.orchestra.run.smithi131.stdout:Building ocfs2 2023-07-11T00:02:46.714 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/ocfs2/group.list 2023-07-11T00:02:46.748 INFO:teuthology.orchestra.run.smithi131.stdout:Building overlay 2023-07-11T00:02:46.759 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/overlay/group.list 2023-07-11T00:02:46.856 INFO:teuthology.orchestra.run.smithi131.stdout:Building cifs 2023-07-11T00:02:46.866 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/cifs/group.list 2023-07-11T00:02:46.898 INFO:teuthology.orchestra.run.smithi131.stdout:Building generic 2023-07-11T00:02:46.909 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/generic/group.list 2023-07-11T00:02:47.152 INFO:teuthology.orchestra.run.smithi131.stdout:Building shared 2023-07-11T00:02:47.162 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/shared/group.list 2023-07-11T00:02:47.205 INFO:teuthology.orchestra.run.smithi131.stdout:Building nfs 2023-07-11T00:02:47.215 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/nfs/group.list 2023-07-11T00:02:47.251 INFO:teuthology.orchestra.run.smithi131.stdout:Building f2fs 2023-07-11T00:02:47.261 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/f2fs/group.list 2023-07-11T00:02:47.304 INFO:teuthology.orchestra.run.smithi131.stdout:Building udf 2023-07-11T00:02:47.314 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/udf/group.list 2023-07-11T00:02:47.343 INFO:teuthology.orchestra.run.smithi131.stdout:Building ceph 2023-07-11T00:02:47.352 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/ceph/group.list 2023-07-11T00:02:47.389 INFO:teuthology.orchestra.run.smithi131.stdout:Building xfs 2023-07-11T00:02:47.401 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/xfs/group.list 2023-07-11T00:02:47.646 INFO:teuthology.orchestra.run.smithi131.stdout:Building btrfs 2023-07-11T00:02:47.657 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/btrfs/group.list 2023-07-11T00:02:47.805 INFO:teuthology.orchestra.run.smithi131.stdout:Building tmpfs 2023-07-11T00:02:47.814 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/tmpfs/group.list 2023-07-11T00:02:47.848 INFO:teuthology.orchestra.run.smithi131.stdout:Building selftest 2023-07-11T00:02:47.858 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/selftest/group.list 2023-07-11T00:02:47.892 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.ESeo9raKdcxfstests-dev && exec sudo make install) 2023-07-11T00:02:47.983 INFO:teuthology.orchestra.run.smithi131.stdout:Building include 2023-07-11T00:02:47.990 INFO:teuthology.orchestra.run.smithi131.stdout:Building lib 2023-07-11T00:02:47.998 INFO:teuthology.orchestra.run.smithi131.stdout:Building ltp 2023-07-11T00:02:48.006 INFO:teuthology.orchestra.run.smithi131.stdout:Building src 2023-07-11T00:02:48.067 INFO:teuthology.orchestra.run.smithi131.stdout:Building log-writes 2023-07-11T00:02:48.074 INFO:teuthology.orchestra.run.smithi131.stdout:Building perf 2023-07-11T00:02:48.081 INFO:teuthology.orchestra.run.smithi131.stdout:Building aio-dio-regress 2023-07-11T00:02:48.089 INFO:teuthology.orchestra.run.smithi131.stdout:Building vfs 2023-07-11T00:02:48.097 INFO:teuthology.orchestra.run.smithi131.stdout:Building m4 2023-07-11T00:02:48.104 INFO:teuthology.orchestra.run.smithi131.stdout:Building common 2023-07-11T00:02:48.111 INFO:teuthology.orchestra.run.smithi131.stdout:Building tests 2023-07-11T00:02:48.121 INFO:teuthology.orchestra.run.smithi131.stdout:Building perf 2023-07-11T00:02:48.131 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/perf/group.list 2023-07-11T00:02:48.161 INFO:teuthology.orchestra.run.smithi131.stdout:Building ext4 2023-07-11T00:02:48.171 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/ext4/group.list 2023-07-11T00:02:48.264 INFO:teuthology.orchestra.run.smithi131.stdout:Building ocfs2 2023-07-11T00:02:48.275 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/ocfs2/group.list 2023-07-11T00:02:48.308 INFO:teuthology.orchestra.run.smithi131.stdout:Building overlay 2023-07-11T00:02:48.318 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/overlay/group.list 2023-07-11T00:02:48.413 INFO:teuthology.orchestra.run.smithi131.stdout:Building cifs 2023-07-11T00:02:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/cifs/group.list 2023-07-11T00:02:48.454 INFO:teuthology.orchestra.run.smithi131.stdout:Building generic 2023-07-11T00:02:48.466 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/generic/group.list 2023-07-11T00:02:48.703 INFO:teuthology.orchestra.run.smithi131.stdout:Building shared 2023-07-11T00:02:48.712 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/shared/group.list 2023-07-11T00:02:48.756 INFO:teuthology.orchestra.run.smithi131.stdout:Building nfs 2023-07-11T00:02:48.765 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/nfs/group.list 2023-07-11T00:02:48.802 INFO:teuthology.orchestra.run.smithi131.stdout:Building f2fs 2023-07-11T00:02:48.812 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/f2fs/group.list 2023-07-11T00:02:48.855 INFO:teuthology.orchestra.run.smithi131.stdout:Building udf 2023-07-11T00:02:48.865 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/udf/group.list 2023-07-11T00:02:48.893 INFO:teuthology.orchestra.run.smithi131.stdout:Building ceph 2023-07-11T00:02:48.903 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/ceph/group.list 2023-07-11T00:02:48.940 INFO:teuthology.orchestra.run.smithi131.stdout:Building xfs 2023-07-11T00:02:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/xfs/group.list 2023-07-11T00:02:49.191 INFO:teuthology.orchestra.run.smithi131.stdout:Building btrfs 2023-07-11T00:02:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/btrfs/group.list 2023-07-11T00:02:49.348 INFO:teuthology.orchestra.run.smithi131.stdout:Building tmpfs 2023-07-11T00:02:49.357 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/tmpfs/group.list 2023-07-11T00:02:49.391 INFO:teuthology.orchestra.run.smithi131.stdout:Building selftest 2023-07-11T00:02:49.401 INFO:teuthology.orchestra.run.smithi131.stdout: [GROUP] /tmp/tmp.ESeo9raKdcxfstests-dev/tests/selftest/group.list 2023-07-11T00:02:49.432 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-07-11T00:02:49.434 INFO:teuthology.orchestra.run.smithi131.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-11T00:02:49.435 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-07-11T00:02:49.438 INFO:teuthology.orchestra.run.smithi131.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-11T00:02:49.438 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-07-11T00:02:49.441 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-07-11T00:02:49.465 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-07-11T00:02:49.640 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-07-11T00:02:49.664 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-07-11T00:02:49.693 INFO:teuthology.orchestra.run.smithi131.stdout:Building log-writes 2023-07-11T00:02:49.700 INFO:teuthology.orchestra.run.smithi131.stdout:Building perf 2023-07-11T00:02:49.707 INFO:teuthology.orchestra.run.smithi131.stdout:Building aio-dio-regress 2023-07-11T00:02:49.715 INFO:teuthology.orchestra.run.smithi131.stdout:Building vfs 2023-07-11T00:02:49.721 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake -C log-writes install 2023-07-11T00:02:49.724 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-07-11T00:02:49.747 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-07-11T00:02:49.770 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake -C perf install 2023-07-11T00:02:49.773 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-07-11T00:02:49.795 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-07-11T00:02:49.855 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-07-11T00:02:49.858 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-07-11T00:02:49.881 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-07-11T00:02:50.022 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake -C vfs install 2023-07-11T00:02:50.024 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-07-11T00:02:50.047 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-07-11T00:02:50.079 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-07-11T00:02:50.103 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-07-11T00:02:53.075 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-07-11T00:02:53.293 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-07-11T00:02:53.349 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-07-11T00:02:53.351 INFO:teuthology.orchestra.run.smithi131.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-11T00:02:53.352 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-07-11T00:02:53.354 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-07-11T00:02:53.377 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-07-11T00:02:53.726 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-07-11T00:02:53.729 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/btrfs/ install 2023-07-11T00:02:53.733 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-07-11T00:02:53.756 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 299 /var/lib/xfstests/tests/btrfs 2023-07-11T00:02:55.894 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-07-11T00:02:55.917 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 036.out 275.out 016.out 175.out 240.out 180.out 069.out 282.out 015.out 280.out 140.out 056.out 008.out 004.out 199.out 233.out 194.out 234.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 137.out 125.out 078.out 152.out 003.out 264.out 243.out 192.out 148.out 075.out 178.out 284.out 052.out 256.out 207.out 228.out 128.out 028.out 183.out 225.out 094.out 046.out 273.out 090.out 251.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 232.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 288.out 242.out 187.out 024.out 220.out 153.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 084.out 129.out 029.out 229.out 103.out 254.out 111.out 011.out 155.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 276.out 114.out 138.out 095.out 038.out 145.out 160.out 091.out 081.out 071.out 061.out 085.out 265.out 200.out 100.out 025.out 258.out 286.out 269.out 039.out 196.out 098.out 080.out 070.out 060.out 208.out 106.out 009.out 167.out 217.out 120.out 191.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 241.out 235.out 253.out 257.out 124.out 035.out 172.out 278.out 058.out 262.out 169.out 042.out 193.out 097.out 271.out 283.out 236.out 186.out 053.out 133.out 164.out 154.out 239.out 189.out 037.out 139.out 267.out 141.out 214.out 014.out 223.out 086.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 291.out 185.out 067.out 088.out 285.out 209.out 123.out 044.out 201.out 019.out 001.out 287.out 142.out 237.out 151.out 231.out 163.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 073.out 099.out 082.out 030.out 203.out 063.out 055.out 076.out 245.out 122.out 074.out 222.out 159.out 249.out 022.out 289.out 174.out 006.out 045.out 281.out 290.out 299.out 224.out 181.out 149.out 064.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 150.out 049.out 226.out 126.out 165.out 026.out 021.out 077.out 221.out 087.out /var/lib/xfstests/tests/btrfs 2023-07-11T00:02:58.057 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/ceph/ install 2023-07-11T00:02:58.059 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-07-11T00:02:58.082 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-07-11T00:02:58.135 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-07-11T00:02:58.158 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-07-11T00:02:58.210 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/cifs/ install 2023-07-11T00:02:58.213 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-07-11T00:02:58.236 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-07-11T00:02:58.259 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-07-11T00:02:58.282 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-07-11T00:02:58.305 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/ext4/ install 2023-07-11T00:02:58.308 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-07-11T00:02:58.331 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-07-11T00:02:58.835 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-07-11T00:02:58.859 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-07-11T00:02:59.391 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/f2fs/ install 2023-07-11T00:02:59.393 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-07-11T00:02:59.417 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-07-11T00:02:59.447 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-07-11T00:02:59.470 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-07-11T00:02:59.502 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/generic/ install 2023-07-11T00:02:59.506 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-07-11T00:02:59.530 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-07-11T00:03:04.848 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-07-11T00:03:04.872 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 310.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 243.out 592.out 282.out 272.out 728.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 120.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 655.out 591.out 064.out 471.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 295.out 390.out 497.out 160.out 691.out 274.out 061.out 239.out 457.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 309.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 012.out 634.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 566.out 433.out 704.out 108.out 504.out 404.out 304.out 104.out 175.out 297.out 393.out 333.out 599.out 476.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 352.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 480.out 436.out 544.out 169.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 376.out 724.out 206.out 663.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 142.out 715.out 279.out 222.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 682.out 472.out 684.out 674.out 550.out 052.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 487.out 688.out 643.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 030.out 244.out 128.out 385.out 005.out 336.out 579.out 236.out 405.out 667.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 505.out 305.out 105.out 263.out 144.out 291.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 548.out 560.out 166.out 707.out 461.out 381.out 445.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 150.out 613.out 326.out 082.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 485.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 173.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 729.out 378.out 004.out 458.out 062.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 280.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 301.out 431.out 635.out 288.out 722.out 331.out 377.out 713.out 535.out 513.out 554.out 622.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 534.out 427.out 210.out 449.out 327.out 330.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 532.out 245.out 522.out 422.out 624.out 322.out 394.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 565.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 167.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 111.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 110.out 010.out 001.out 141.out 495.out 048.out 665.out 589.out 095.out 581.out 697.out 145.out 641.out 464.out 491.out 081.out 075.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 259.out 090.out 080.out 708.out 608.out 508.out 409.out 307.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 531.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out 452.out 096.out /var/lib/xfstests/tests/generic 2023-07-11T00:03:10.239 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/nfs/ install 2023-07-11T00:03:10.241 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-07-11T00:03:10.264 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-07-11T00:03:10.287 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-07-11T00:03:10.310 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-07-11T00:03:10.333 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/ocfs2/ install 2023-07-11T00:03:10.336 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-07-11T00:03:10.359 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-07-11T00:03:10.382 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-07-11T00:03:10.405 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-07-11T00:03:10.428 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/overlay/ install 2023-07-11T00:03:10.431 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-07-11T00:03:10.454 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-07-11T00:03:11.165 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-07-11T00:03:11.188 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-07-11T00:03:11.902 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/perf/ install 2023-07-11T00:03:11.905 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-07-11T00:03:11.928 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-07-11T00:03:11.951 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-07-11T00:03:11.975 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-07-11T00:03:11.998 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/selftest/ install 2023-07-11T00:03:12.001 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-07-11T00:03:12.024 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-07-11T00:03:12.082 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-07-11T00:03:12.106 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-07-11T00:03:12.165 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/shared/ install 2023-07-11T00:03:12.168 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-07-11T00:03:12.191 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-07-11T00:03:12.228 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-07-11T00:03:12.251 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-07-11T00:03:12.289 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/tmpfs/ install 2023-07-11T00:03:12.292 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-07-11T00:03:12.315 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-07-11T00:03:12.339 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-07-11T00:03:12.362 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-07-11T00:03:12.385 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/udf/ install 2023-07-11T00:03:12.388 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-07-11T00:03:12.410 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-07-11T00:03:12.434 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-07-11T00:03:12.457 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-07-11T00:03:12.480 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ESeo9raKdcxfstests-dev/tests/xfs/ install 2023-07-11T00:03:12.486 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-07-11T00:03:12.509 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-07-11T00:03:16.788 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:03:16.791 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:03:16.794 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:03:17.520 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-07-11T00:03:17.543 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 363.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 383.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 219.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 725.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 388.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out /var/lib/xfstests/tests/xfs 2023-07-11T00:03:22.613 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-07-11T00:03:22.636 INFO:teuthology.orchestra.run.smithi131.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-07-11T00:03:22.659 INFO:teuthology.orchestra.run.smithi131.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-07-11T00:03:22.682 INFO:teuthology.orchestra.run.smithi131.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-07-11T00:03:22.709 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.a2sTs4EWApxfsprogs-dev && exec sudo make) 2023-07-11T00:03:22.787 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize -c -i -f 2023-07-11T00:03:23.069 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-07-11T00:03:23.069 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './config.guess' 2023-07-11T00:03:23.078 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './config.sub' 2023-07-11T00:03:23.089 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './install-sh' 2023-07-11T00:03:23.099 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file './ltmain.sh' 2023-07-11T00:03:23.160 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-11T00:03:23.160 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-11T00:03:23.173 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-11T00:03:23.185 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-11T00:03:23.198 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-11T00:03:23.210 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-11T00:03:23.227 INFO:teuthology.orchestra.run.smithi131.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-11T00:03:23.230 INFO:teuthology.orchestra.run.smithi131.stdout:cp include/install-sh . 2023-07-11T00:03:23.232 INFO:teuthology.orchestra.run.smithi131.stdout:aclocal -I m4 2023-07-11T00:03:24.483 INFO:teuthology.orchestra.run.smithi131.stdout:autoconf 2023-07-11T00:03:24.906 INFO:teuthology.orchestra.run.smithi131.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-07-11T00:03:25.042 INFO:teuthology.orchestra.run.smithi131.stdout:configure: loading site script /usr/share/config.site 2023-07-11T00:03:25.073 INFO:teuthology.orchestra.run.smithi131.stdout:checking for a BSD-compatible install... /bin/install -c 2023-07-11T00:03:25.169 INFO:teuthology.orchestra.run.smithi131.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-11T00:03:25.170 INFO:teuthology.orchestra.run.smithi131.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-11T00:03:25.173 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to print strings... printf 2023-07-11T00:03:25.174 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc... gcc 2023-07-11T00:03:25.265 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether the C compiler works... yes 2023-07-11T00:03:25.266 INFO:teuthology.orchestra.run.smithi131.stdout:checking for C compiler default output file name... a.out 2023-07-11T00:03:25.316 INFO:teuthology.orchestra.run.smithi131.stdout:checking for suffix of executables... 2023-07-11T00:03:25.372 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether we are cross compiling... no 2023-07-11T00:03:25.410 INFO:teuthology.orchestra.run.smithi131.stdout:checking for suffix of object files... o 2023-07-11T00:03:25.444 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether we are using the GNU C compiler... yes 2023-07-11T00:03:25.478 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether gcc accepts -g... yes 2023-07-11T00:03:25.525 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-11T00:03:25.532 INFO:teuthology.orchestra.run.smithi131.stdout:checking for a sed that does not truncate output... /bin/sed 2023-07-11T00:03:25.537 INFO:teuthology.orchestra.run.smithi131.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-07-11T00:03:25.540 INFO:teuthology.orchestra.run.smithi131.stdout:checking for egrep... /bin/grep -E 2023-07-11T00:03:25.543 INFO:teuthology.orchestra.run.smithi131.stdout:checking for fgrep... /bin/grep -F 2023-07-11T00:03:25.552 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ld used by gcc... /bin/ld 2023-07-11T00:03:25.556 INFO:teuthology.orchestra.run.smithi131.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-07-11T00:03:25.560 INFO:teuthology.orchestra.run.smithi131.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-07-11T00:03:25.600 INFO:teuthology.orchestra.run.smithi131.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-07-11T00:03:25.600 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether ln -s works... yes 2023-07-11T00:03:25.607 INFO:teuthology.orchestra.run.smithi131.stdout:checking the maximum length of command line arguments... 1572864 2023-07-11T00:03:25.613 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-11T00:03:25.613 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-11T00:03:25.613 INFO:teuthology.orchestra.run.smithi131.stdout:checking for /bin/ld option to reload object files... -r 2023-07-11T00:03:25.614 INFO:teuthology.orchestra.run.smithi131.stdout:checking for objdump... objdump 2023-07-11T00:03:25.614 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to recognize dependent libraries... pass_all 2023-07-11T00:03:25.615 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dlltool... no 2023-07-11T00:03:25.615 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-11T00:03:25.615 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ar... ar 2023-07-11T00:03:25.661 INFO:teuthology.orchestra.run.smithi131.stdout:checking for archiver @FILE support... @ 2023-07-11T00:03:25.662 INFO:teuthology.orchestra.run.smithi131.stdout:checking for strip... strip 2023-07-11T00:03:25.662 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ranlib... ranlib 2023-07-11T00:03:25.663 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gawk... gawk 2023-07-11T00:03:25.773 INFO:teuthology.orchestra.run.smithi131.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-07-11T00:03:25.776 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sysroot... no 2023-07-11T00:03:25.783 INFO:teuthology.orchestra.run.smithi131.stdout:checking for a working dd... /bin/dd 2023-07-11T00:03:25.790 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-07-11T00:03:25.819 INFO:teuthology.orchestra.run.smithi131.stdout:checking for mt... no 2023-07-11T00:03:25.825 INFO:teuthology.orchestra.run.smithi131.stdout:checking if : is a manifest tool... no 2023-07-11T00:03:25.866 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to run the C preprocessor... gcc -E 2023-07-11T00:03:26.055 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ANSI C header files... yes 2023-07-11T00:03:26.098 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/types.h... yes 2023-07-11T00:03:26.150 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/stat.h... yes 2023-07-11T00:03:26.202 INFO:teuthology.orchestra.run.smithi131.stdout:checking for stdlib.h... yes 2023-07-11T00:03:26.255 INFO:teuthology.orchestra.run.smithi131.stdout:checking for string.h... yes 2023-07-11T00:03:26.308 INFO:teuthology.orchestra.run.smithi131.stdout:checking for memory.h... yes 2023-07-11T00:03:26.361 INFO:teuthology.orchestra.run.smithi131.stdout:checking for strings.h... yes 2023-07-11T00:03:26.415 INFO:teuthology.orchestra.run.smithi131.stdout:checking for inttypes.h... yes 2023-07-11T00:03:26.469 INFO:teuthology.orchestra.run.smithi131.stdout:checking for stdint.h... yes 2023-07-11T00:03:26.525 INFO:teuthology.orchestra.run.smithi131.stdout:checking for unistd.h... yes 2023-07-11T00:03:26.576 INFO:teuthology.orchestra.run.smithi131.stdout:checking for dlfcn.h... yes 2023-07-11T00:03:26.584 INFO:teuthology.orchestra.run.smithi131.stdout:checking for objdir... .libs 2023-07-11T00:03:26.718 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-11T00:03:26.718 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-11T00:03:26.757 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-11T00:03:26.795 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc static flag -static works... no 2023-07-11T00:03:26.848 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc supports -c -o file.o... yes 2023-07-11T00:03:26.849 INFO:teuthology.orchestra.run.smithi131.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-11T00:03:26.863 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-11T00:03:26.912 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether -lc should be explicitly linked in... no 2023-07-11T00:03:27.002 INFO:teuthology.orchestra.run.smithi131.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-11T00:03:27.002 INFO:teuthology.orchestra.run.smithi131.stdout:checking how to hardcode library paths into programs... immediate 2023-07-11T00:03:27.005 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether stripping libraries is possible... yes 2023-07-11T00:03:27.005 INFO:teuthology.orchestra.run.smithi131.stdout:checking if libtool supports shared libraries... yes 2023-07-11T00:03:27.005 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether to build shared libraries... yes 2023-07-11T00:03:27.005 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether to build static libraries... yes 2023-07-11T00:03:27.006 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc... (cached) gcc 2023-07-11T00:03:27.044 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-11T00:03:27.044 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-11T00:03:27.044 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-11T00:03:27.057 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc... (cached) gcc 2023-07-11T00:03:27.096 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-11T00:03:27.096 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-11T00:03:27.096 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-11T00:03:27.104 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc... (cached) gcc 2023-07-11T00:03:27.143 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-11T00:03:27.143 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-11T00:03:27.143 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-11T00:03:27.144 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gmake... /bin/gmake 2023-07-11T00:03:27.144 INFO:teuthology.orchestra.run.smithi131.stdout:checking for tar... /bin/tar 2023-07-11T00:03:27.144 INFO:teuthology.orchestra.run.smithi131.stdout:checking for gzip... /bin/gzip 2023-07-11T00:03:27.161 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether gcc -MM is supported... yes 2023-07-11T00:03:27.161 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sort... /bin/sort 2023-07-11T00:03:27.161 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether ln -s works... yes 2023-07-11T00:03:27.162 INFO:teuthology.orchestra.run.smithi131.stdout:checking for msgfmt... /bin/msgfmt 2023-07-11T00:03:27.162 INFO:teuthology.orchestra.run.smithi131.stdout:checking for msgmerge... /bin/msgmerge 2023-07-11T00:03:27.162 INFO:teuthology.orchestra.run.smithi131.stdout:checking for xgettext... /bin/xgettext 2023-07-11T00:03:27.163 INFO:teuthology.orchestra.run.smithi131.stdout:checking for rpm... /bin/rpm 2023-07-11T00:03:27.169 INFO:teuthology.orchestra.run.smithi131.stdout:checking for rpmbuild... no 2023-07-11T00:03:27.217 INFO:teuthology.orchestra.run.smithi131.stdout:checking ini.h usability... yes 2023-07-11T00:03:27.235 INFO:teuthology.orchestra.run.smithi131.stdout:checking ini.h presence... yes 2023-07-11T00:03:27.235 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ini.h... yes 2023-07-11T00:03:27.294 INFO:teuthology.orchestra.run.smithi131.stdout:checking for ini_parse in -linih... yes 2023-07-11T00:03:27.344 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid.h usability... no 2023-07-11T00:03:27.369 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid.h presence... no 2023-07-11T00:03:27.369 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid.h... no 2023-07-11T00:03:27.417 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/uuid.h usability... no 2023-07-11T00:03:27.441 INFO:teuthology.orchestra.run.smithi131.stdout:checking sys/uuid.h presence... no 2023-07-11T00:03:27.442 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sys/uuid.h... no 2023-07-11T00:03:27.491 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid/uuid.h usability... yes 2023-07-11T00:03:27.510 INFO:teuthology.orchestra.run.smithi131.stdout:checking uuid/uuid.h presence... yes 2023-07-11T00:03:27.510 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid/uuid.h... yes 2023-07-11T00:03:27.585 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid_compare... no 2023-07-11T00:03:27.642 INFO:teuthology.orchestra.run.smithi131.stdout:checking for uuid_compare in -luuid... yes 2023-07-11T00:03:27.690 INFO:teuthology.orchestra.run.smithi131.stdout:checking pthread.h usability... yes 2023-07-11T00:03:27.709 INFO:teuthology.orchestra.run.smithi131.stdout:checking pthread.h presence... yes 2023-07-11T00:03:27.710 INFO:teuthology.orchestra.run.smithi131.stdout:checking for pthread.h... yes 2023-07-11T00:03:27.769 INFO:teuthology.orchestra.run.smithi131.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-07-11T00:03:27.822 INFO:teuthology.orchestra.run.smithi131.stdout:checking urcu.h usability... yes 2023-07-11T00:03:27.847 INFO:teuthology.orchestra.run.smithi131.stdout:checking urcu.h presence... yes 2023-07-11T00:03:27.847 INFO:teuthology.orchestra.run.smithi131.stdout:checking for urcu.h... yes 2023-07-11T00:03:27.898 INFO:teuthology.orchestra.run.smithi131.stdout:checking for liburcu... yes 2023-07-11T00:03:27.937 INFO:teuthology.orchestra.run.smithi131.stdout:checking for fadvise ... yes 2023-07-11T00:03:27.975 INFO:teuthology.orchestra.run.smithi131.stdout:checking for madvise ... yes 2023-07-11T00:03:28.014 INFO:teuthology.orchestra.run.smithi131.stdout:checking for mincore ... yes 2023-07-11T00:03:28.054 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sendfile ... yes 2023-07-11T00:03:28.095 INFO:teuthology.orchestra.run.smithi131.stdout:checking for getmntent ... yes 2023-07-11T00:03:28.155 INFO:teuthology.orchestra.run.smithi131.stdout:checking for fallocate... yes 2023-07-11T00:03:28.217 INFO:teuthology.orchestra.run.smithi131.stdout:checking for fiemap... yes 2023-07-11T00:03:28.279 INFO:teuthology.orchestra.run.smithi131.stdout:checking for pwritev2... yes 2023-07-11T00:03:28.340 INFO:teuthology.orchestra.run.smithi131.stdout:checking for preadv... yes 2023-07-11T00:03:28.403 INFO:teuthology.orchestra.run.smithi131.stdout:checking for copy_file_range... yes 2023-07-11T00:03:28.463 INFO:teuthology.orchestra.run.smithi131.stdout:checking for sync_file_range... yes 2023-07-11T00:03:28.525 INFO:teuthology.orchestra.run.smithi131.stdout:checking for syncfs... yes 2023-07-11T00:03:28.570 INFO:teuthology.orchestra.run.smithi131.stdout:checking mntent.h usability... yes 2023-07-11T00:03:28.586 INFO:teuthology.orchestra.run.smithi131.stdout:checking mntent.h presence... yes 2023-07-11T00:03:28.586 INFO:teuthology.orchestra.run.smithi131.stdout:checking for mntent.h... yes 2023-07-11T00:03:28.629 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether fls is declared... no 2023-07-11T00:03:28.688 INFO:teuthology.orchestra.run.smithi131.stdout:checking for readdir... yes 2023-07-11T00:03:28.738 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether fsetxattr is declared... yes 2023-07-11T00:03:28.785 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether mremap is declared... yes 2023-07-11T00:03:28.854 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct fsxattr... yes 2023-07-11T00:03:28.892 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-07-11T00:03:28.924 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct fscrypt_add_key_arg... no 2023-07-11T00:03:28.989 INFO:teuthology.orchestra.run.smithi131.stdout:checking for GETFSMAP... yes 2023-07-11T00:03:29.060 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct statfs... yes 2023-07-11T00:03:29.098 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct statfs.f_flags... yes 2023-07-11T00:03:29.134 INFO:teuthology.orchestra.run.smithi131.stdout:checking for MAP_SYNC... yes 2023-07-11T00:03:29.269 INFO:teuthology.orchestra.run.smithi131.stdout:checking for library containing dm_task_create... -ldevmapper 2023-07-11T00:03:29.308 INFO:teuthology.orchestra.run.smithi131.stdout:checking for mallinfo ... yes 2023-07-11T00:03:29.342 INFO:teuthology.orchestra.run.smithi131.stdout:checking for mallinfo2 ... no 2023-07-11T00:03:29.387 INFO:teuthology.orchestra.run.smithi131.stdout:checking attr/attributes.h usability... yes 2023-07-11T00:03:29.404 INFO:teuthology.orchestra.run.smithi131.stdout:checking attr/attributes.h presence... yes 2023-07-11T00:03:29.404 INFO:teuthology.orchestra.run.smithi131.stdout:checking for attr/attributes.h... yes 2023-07-11T00:03:29.445 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct attrlist_cursor... yes 2023-07-11T00:03:29.447 INFO:teuthology.orchestra.run.smithi131.stdout:checking for pkg-config... /bin/pkg-config 2023-07-11T00:03:29.462 INFO:teuthology.orchestra.run.smithi131.stdout:checking pkg-config is at least version 0.9.0... yes 2023-07-11T00:03:29.475 INFO:teuthology.orchestra.run.smithi131.stdout:checking for libicu... yes 2023-07-11T00:03:29.525 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether openat is declared... yes 2023-07-11T00:03:29.578 INFO:teuthology.orchestra.run.smithi131.stdout:checking whether fstatat is declared... yes 2023-07-11T00:03:29.624 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct sg_io_hdr ... yes 2023-07-11T00:03:29.665 INFO:teuthology.orchestra.run.smithi131.stdout:checking for struct hd_geometry ... yes 2023-07-11T00:03:29.687 INFO:teuthology.orchestra.run.smithi131.stdout:checking for systemd... yes 2023-07-11T00:03:29.689 INFO:teuthology.orchestra.run.smithi131.stdout:checking for systemd system unit dir... /usr/lib/systemd/system 2023-07-11T00:03:29.690 INFO:teuthology.orchestra.run.smithi131.stdout:checking for system crontab dir... /etc/cron.d 2023-07-11T00:03:29.825 INFO:teuthology.orchestra.run.smithi131.stdout:checking for library containing blkid_probe_all... -lblkid 2023-07-11T00:03:29.892 INFO:teuthology.orchestra.run.smithi131.stdout:checking for blkid_probe_get_topology... yes 2023-07-11T00:03:29.983 INFO:teuthology.orchestra.run.smithi131.stdout:checking size of long... 8 2023-07-11T00:03:30.074 INFO:teuthology.orchestra.run.smithi131.stdout:checking size of char *... 8 2023-07-11T00:03:30.105 INFO:teuthology.orchestra.run.smithi131.stdout:checking for umode_t... no 2023-07-11T00:03:30.187 INFO:teuthology.orchestra.run.smithi131.stdout:checking for atomic64_t support in liburcu... yes 2023-07-11T00:03:30.219 INFO:teuthology.orchestra.run.smithi131.stdout:configure: creating ./config.status 2023-07-11T00:03:31.136 INFO:teuthology.orchestra.run.smithi131.stdout:config.status: creating include/builddefs 2023-07-11T00:03:31.163 INFO:teuthology.orchestra.run.smithi131.stdout:config.status: creating include/platform_defs.h 2023-07-11T00:03:31.184 INFO:teuthology.orchestra.run.smithi131.stdout:config.status: executing libtool commands 2023-07-11T00:03:31.273 INFO:teuthology.orchestra.run.smithi131.stdout: [HEADERS] include 2023-07-11T00:03:31.289 INFO:teuthology.orchestra.run.smithi131.stdout: [HEADERS] libxfs 2023-07-11T00:03:31.316 INFO:teuthology.orchestra.run.smithi131.stdout:Building include 2023-07-11T00:03:31.326 INFO:teuthology.orchestra.run.smithi131.stdout: [LN] disk 2023-07-11T00:03:31.330 INFO:teuthology.orchestra.run.smithi131.stdout:Building libfrog 2023-07-11T00:03:31.336 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] gen_crc32table 2023-07-11T00:03:31.408 INFO:teuthology.orchestra.run.smithi131.stdout: [GENERATE] crc32table.h 2023-07-11T00:03:31.912 INFO:teuthology.orchestra.run.smithi131.stdout: [TEST] CRC32 2023-07-11T00:03:32.088 INFO:teuthology.orchestra.run.smithi131.stdout:CRC_LE_BITS = 64 2023-07-11T00:03:32.089 INFO:teuthology.orchestra.run.smithi131.stdout:crc32c: tests passed, 225944 bytes in 57 usec 2023-07-11T00:03:32.092 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] avl64.lo 2023-07-11T00:03:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bitmap.lo 2023-07-11T00:03:33.138 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bulkstat.lo 2023-07-11T00:03:33.652 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] convert.lo 2023-07-11T00:03:34.123 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] crc32.lo 2023-07-11T00:03:34.481 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsgeom.lo 2023-07-11T00:03:34.927 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] list_sort.lo 2023-07-11T00:03:35.275 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] linux.lo 2023-07-11T00:03:35.729 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] logging.lo 2023-07-11T00:03:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] paths.lo 2023-07-11T00:03:36.574 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] projects.lo 2023-07-11T00:03:37.004 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] ptvar.lo 2023-07-11T00:03:37.388 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] radix-tree.lo 2023-07-11T00:03:38.025 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] randbytes.lo 2023-07-11T00:03:38.373 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] scrub.lo 2023-07-11T00:03:38.714 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] util.lo 2023-07-11T00:03:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] workqueue.lo 2023-07-11T00:03:39.477 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] libfrog.la 2023-07-11T00:03:39.615 INFO:teuthology.orchestra.run.smithi131.stdout:Building libxfs 2023-07-11T00:03:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] cache.lo 2023-07-11T00:03:41.966 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] defer_item.lo 2023-07-11T00:03:42.508 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] init.lo 2023-07-11T00:03:43.324 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] kmem.lo 2023-07-11T00:03:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] logitem.lo 2023-07-11T00:03:44.175 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] rdwr.lo 2023-07-11T00:03:45.107 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] topology.lo 2023-07-11T00:03:45.610 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] trans.lo 2023-07-11T00:03:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] util.lo 2023-07-11T00:03:46.845 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_ag.lo 2023-07-11T00:03:46.886 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:03:46.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:03:46.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:03:47.749 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_ag_resv.lo 2023-07-11T00:03:48.237 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_alloc.lo 2023-07-11T00:03:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_alloc_btree.lo 2023-07-11T00:03:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_attr.lo 2023-07-11T00:03:51.065 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_attr_leaf.lo 2023-07-11T00:03:52.535 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_attr_remote.lo 2023-07-11T00:03:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_bit.lo 2023-07-11T00:03:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_bmap.lo 2023-07-11T00:03:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_bmap_btree.lo 2023-07-11T00:03:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_btree.lo 2023-07-11T00:03:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_btree_staging.lo 2023-07-11T00:03:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_da_btree.lo 2023-07-11T00:04:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_defer.lo 2023-07-11T00:04:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_dir2.lo 2023-07-11T00:04:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_dir2_block.lo 2023-07-11T00:04:03.286 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_dir2_data.lo 2023-07-11T00:04:04.195 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_dir2_leaf.lo 2023-07-11T00:04:05.222 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_dir2_node.lo 2023-07-11T00:04:06.362 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_dir2_sf.lo 2023-07-11T00:04:07.246 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_dquot_buf.lo 2023-07-11T00:04:07.762 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_ialloc.lo 2023-07-11T00:04:09.124 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_iext_tree.lo 2023-07-11T00:04:09.978 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_inode_buf.lo 2023-07-11T00:04:10.752 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_inode_fork.lo 2023-07-11T00:04:11.498 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_ialloc_btree.lo 2023-07-11T00:04:12.142 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_log_rlimit.lo 2023-07-11T00:04:12.588 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_refcount.lo 2023-07-11T00:04:13.497 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_refcount_btree.lo 2023-07-11T00:04:14.074 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_rmap.lo 2023-07-11T00:04:15.265 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_rmap_btree.lo 2023-07-11T00:04:15.904 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_rtbitmap.lo 2023-07-11T00:04:16.637 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_sb.lo 2023-07-11T00:04:16.996 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:04:16.999 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:04:17.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:04:17.553 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_symlink_remote.lo 2023-07-11T00:04:18.049 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_trans_inode.lo 2023-07-11T00:04:18.493 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_trans_resv.lo 2023-07-11T00:04:19.191 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_types.lo 2023-07-11T00:04:19.677 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] libxfs.la 2023-07-11T00:04:19.952 INFO:teuthology.orchestra.run.smithi131.stdout:Building libxlog 2023-07-11T00:04:20.050 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_log_recover.lo 2023-07-11T00:04:20.954 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] util.lo 2023-07-11T00:04:21.451 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] libxlog.la 2023-07-11T00:04:21.570 INFO:teuthology.orchestra.run.smithi131.stdout:Building libxcmd 2023-07-11T00:04:21.709 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] command.lo 2023-07-11T00:04:22.171 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] input.lo 2023-07-11T00:04:22.608 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] help.lo 2023-07-11T00:04:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] quit.lo 2023-07-11T00:04:23.335 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] libxcmd.la 2023-07-11T00:04:23.455 INFO:teuthology.orchestra.run.smithi131.stdout:Building libhandle 2023-07-11T00:04:23.539 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] handle.lo 2023-07-11T00:04:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] jdm.lo 2023-07-11T00:04:24.426 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] libhandle.la 2023-07-11T00:04:24.583 INFO:teuthology.orchestra.run.smithi131.stdout:Building copy 2023-07-11T00:04:24.642 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_copy.o 2023-07-11T00:04:25.082 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_copy 2023-07-11T00:04:25.304 INFO:teuthology.orchestra.run.smithi131.stdout:Building db 2023-07-11T00:04:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] addr.o 2023-07-11T00:04:27.482 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] agf.o 2023-07-11T00:04:27.598 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] agfl.o 2023-07-11T00:04:27.717 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] agi.o 2023-07-11T00:04:27.834 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] attr.o 2023-07-11T00:04:28.048 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] attrshort.o 2023-07-11T00:04:28.183 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bit.o 2023-07-11T00:04:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] block.o 2023-07-11T00:04:28.473 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bmap.o 2023-07-11T00:04:28.684 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] btblock.o 2023-07-11T00:04:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bmroot.o 2023-07-11T00:04:29.004 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] check.o 2023-07-11T00:04:30.710 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] command.o 2023-07-11T00:04:30.835 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] crc.o 2023-07-11T00:04:30.968 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] debug.o 2023-07-11T00:04:31.076 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dir2.o 2023-07-11T00:04:31.384 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dir2sf.o 2023-07-11T00:04:31.538 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dquot.o 2023-07-11T00:04:31.668 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] echo.o 2023-07-11T00:04:31.775 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] faddr.o 2023-07-11T00:04:31.966 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] field.o 2023-07-11T00:04:32.094 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] flist.o 2023-07-11T00:04:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fprint.o 2023-07-11T00:04:32.462 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] frag.o 2023-07-11T00:04:32.707 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] freesp.o 2023-07-11T00:04:32.913 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] hash.o 2023-07-11T00:04:33.020 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] help.o 2023-07-11T00:04:33.136 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] init.o 2023-07-11T00:04:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] inode.o 2023-07-11T00:04:33.562 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] input.o 2023-07-11T00:04:33.714 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] io.o 2023-07-11T00:04:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] logformat.o 2023-07-11T00:04:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] malloc.o 2023-07-11T00:04:34.174 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] metadump.o 2023-07-11T00:04:34.975 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] output.o 2023-07-11T00:04:35.096 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] print.o 2023-07-11T00:04:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] quit.o 2023-07-11T00:04:35.368 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] sb.o 2023-07-11T00:04:35.646 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] sig.o 2023-07-11T00:04:35.755 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] strvec.o 2023-07-11T00:04:35.876 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] text.o 2023-07-11T00:04:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] type.o 2023-07-11T00:04:36.131 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] write.o 2023-07-11T00:04:36.371 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] attrset.o 2023-07-11T00:04:36.512 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] symlink.o 2023-07-11T00:04:36.625 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsmap.o 2023-07-11T00:04:36.762 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fuzz.o 2023-07-11T00:04:36.937 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] btdump.o 2023-07-11T00:04:37.123 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] btheight.o 2023-07-11T00:04:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] convert.o 2023-07-11T00:04:37.448 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] info.o 2023-07-11T00:04:37.578 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] namei.o 2023-07-11T00:04:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] timelimit.o 2023-07-11T00:04:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_db 2023-07-11T00:04:38.219 INFO:teuthology.orchestra.run.smithi131.stdout:Building estimate 2023-07-11T00:04:38.278 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_estimate.o 2023-07-11T00:04:38.425 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_estimate 2023-07-11T00:04:38.524 INFO:teuthology.orchestra.run.smithi131.stdout:Building fsck 2023-07-11T00:04:38.532 INFO:teuthology.orchestra.run.smithi131.stdout:Building fsr 2023-07-11T00:04:38.592 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_fsr.o 2023-07-11T00:04:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_fsr 2023-07-11T00:04:39.147 INFO:teuthology.orchestra.run.smithi131.stdout:Building growfs 2023-07-11T00:04:39.206 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_growfs.o 2023-07-11T00:04:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_growfs 2023-07-11T00:04:39.601 INFO:teuthology.orchestra.run.smithi131.stdout:Building io 2023-07-11T00:04:41.026 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] init.o 2023-07-11T00:04:41.139 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] attr.o 2023-07-11T00:04:41.283 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bmap.o 2023-07-11T00:04:41.461 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bulkstat.o 2023-07-11T00:04:41.620 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] crc32cselftest.o 2023-07-11T00:04:41.708 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] cowextsize.o 2023-07-11T00:04:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] encrypt.o 2023-07-11T00:04:42.023 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] file.o 2023-07-11T00:04:42.124 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] freeze.o 2023-07-11T00:04:42.212 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsuuid.o 2023-07-11T00:04:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsync.o 2023-07-11T00:04:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] getrusage.o 2023-07-11T00:04:42.498 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] imap.o 2023-07-11T00:04:42.588 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] inject.o 2023-07-11T00:04:42.687 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] label.o 2023-07-11T00:04:42.802 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] link.o 2023-07-11T00:04:42.885 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mmap.o 2023-07-11T00:04:43.086 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] open.o 2023-07-11T00:04:43.348 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] parent.o 2023-07-11T00:04:43.501 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] pread.o 2023-07-11T00:04:43.673 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] prealloc.o 2023-07-11T00:04:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] pwrite.o 2023-07-11T00:04:43.964 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] reflink.o 2023-07-11T00:04:44.092 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] resblks.o 2023-07-11T00:04:44.178 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] scrub.o 2023-07-11T00:04:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] seek.o 2023-07-11T00:04:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] shutdown.o 2023-07-11T00:04:44.495 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] stat.o 2023-07-11T00:04:44.688 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] swapext.o 2023-07-11T00:04:44.778 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] sync.o 2023-07-11T00:04:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] truncate.o 2023-07-11T00:04:44.941 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] utimes.o 2023-07-11T00:04:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fadvise.o 2023-07-11T00:04:45.118 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] madvise.o 2023-07-11T00:04:45.209 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] mincore.o 2023-07-11T00:04:45.305 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] sendfile.o 2023-07-11T00:04:45.409 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fiemap.o 2023-07-11T00:04:45.557 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] copy_file_range.o 2023-07-11T00:04:45.660 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] sync_file_range.o 2023-07-11T00:04:45.751 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] readdir.o 2023-07-11T00:04:45.851 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] log_writes.o 2023-07-11T00:04:45.944 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fsmap.o 2023-07-11T00:04:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_io 2023-07-11T00:04:46.399 INFO:teuthology.orchestra.run.smithi131.stdout:Building logprint 2023-07-11T00:04:46.687 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] logprint.o 2023-07-11T00:04:46.829 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] log_copy.o 2023-07-11T00:04:46.942 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] log_dump.o 2023-07-11T00:04:47.066 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] log_misc.o 2023-07-11T00:04:47.104 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:04:47.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:04:47.109 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:04:47.549 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] log_print_all.o 2023-07-11T00:04:47.789 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] log_print_trans.o 2023-07-11T00:04:47.905 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] log_redo.o 2023-07-11T00:04:48.152 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_logprint 2023-07-11T00:04:48.370 INFO:teuthology.orchestra.run.smithi131.stdout:Building mkfs 2023-07-11T00:04:48.469 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] proto.o 2023-07-11T00:04:48.734 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_mkfs.o 2023-07-11T00:04:49.419 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] mkfs.xfs 2023-07-11T00:04:49.638 INFO:teuthology.orchestra.run.smithi131.stdout:Building quota 2023-07-11T00:04:50.032 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] init.o 2023-07-11T00:04:50.131 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] util.o 2023-07-11T00:04:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] edit.o 2023-07-11T00:04:50.474 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] free.o 2023-07-11T00:04:50.619 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] linux.o 2023-07-11T00:04:50.697 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] path.o 2023-07-11T00:04:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] project.o 2023-07-11T00:04:50.942 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] quot.o 2023-07-11T00:04:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] quota.o 2023-07-11T00:04:51.254 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] report.o 2023-07-11T00:04:51.471 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] state.o 2023-07-11T00:04:51.640 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_quota 2023-07-11T00:04:51.791 INFO:teuthology.orchestra.run.smithi131.stdout:Building mdrestore 2023-07-11T00:04:51.850 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_mdrestore.o 2023-07-11T00:04:52.013 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_mdrestore 2023-07-11T00:04:52.203 INFO:teuthology.orchestra.run.smithi131.stdout:Building repair 2023-07-11T00:04:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] agheader.o 2023-07-11T00:04:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] agbtree.o 2023-07-11T00:04:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] attr_repair.o 2023-07-11T00:04:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] avl.o 2023-07-11T00:04:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bulkload.o 2023-07-11T00:04:54.721 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] bmap.o 2023-07-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] btree.o 2023-07-11T00:04:55.190 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] da_util.o 2023-07-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dino_chunks.o 2023-07-11T00:04:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dinode.o 2023-07-11T00:04:56.525 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] dir2.o 2023-07-11T00:04:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] globals.o 2023-07-11T00:04:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] incore_bmc.o 2023-07-11T00:04:57.135 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] incore.o 2023-07-11T00:04:57.285 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] incore_ext.o 2023-07-11T00:04:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] incore_ino.o 2023-07-11T00:04:57.762 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] init.o 2023-07-11T00:04:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase1.o 2023-07-11T00:04:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase2.o 2023-07-11T00:04:58.216 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase3.o 2023-07-11T00:04:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase4.o 2023-07-11T00:04:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase5.o 2023-07-11T00:04:58.802 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase6.o 2023-07-11T00:04:59.652 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase7.o 2023-07-11T00:04:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] prefetch.o 2023-07-11T00:05:00.128 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] progress.o 2023-07-11T00:05:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] quotacheck.o 2023-07-11T00:05:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] rmap.o 2023-07-11T00:05:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] rt.o 2023-07-11T00:05:01.067 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] sb.o 2023-07-11T00:05:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] scan.o 2023-07-11T00:05:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] slab.o 2023-07-11T00:05:02.185 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] threads.o 2023-07-11T00:05:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] versions.o 2023-07-11T00:05:02.428 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_repair.o 2023-07-11T00:05:02.728 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_repair 2023-07-11T00:05:03.029 INFO:teuthology.orchestra.run.smithi131.stdout:Building rtcp 2023-07-11T00:05:03.088 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_rtcp.o 2023-07-11T00:05:03.262 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_rtcp 2023-07-11T00:05:03.381 INFO:teuthology.orchestra.run.smithi131.stdout:Building m4 2023-07-11T00:05:03.388 INFO:teuthology.orchestra.run.smithi131.stdout:Building man 2023-07-11T00:05:03.398 INFO:teuthology.orchestra.run.smithi131.stdout:Building man2 2023-07-11T00:05:03.410 INFO:teuthology.orchestra.run.smithi131.stdout:Building man3 2023-07-11T00:05:03.419 INFO:teuthology.orchestra.run.smithi131.stdout:Building man5 2023-07-11T00:05:03.429 INFO:teuthology.orchestra.run.smithi131.stdout:Building man8 2023-07-11T00:05:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: [SED] mkfs.xfs.8 2023-07-11T00:05:03.456 INFO:teuthology.orchestra.run.smithi131.stdout:Building doc 2023-07-11T00:05:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: [ZIP] CHANGES.gz 2023-07-11T00:05:03.479 INFO:teuthology.orchestra.run.smithi131.stdout:Building debian 2023-07-11T00:05:03.486 INFO:teuthology.orchestra.run.smithi131.stdout:Building spaceman 2023-07-11T00:05:03.782 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] info.o 2023-07-11T00:05:03.891 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] init.o 2023-07-11T00:05:04.016 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] file.o 2023-07-11T00:05:04.141 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] health.o 2023-07-11T00:05:04.306 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] prealloc.o 2023-07-11T00:05:04.426 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] trim.o 2023-07-11T00:05:04.552 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] freesp.o 2023-07-11T00:05:04.735 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_spaceman 2023-07-11T00:05:04.883 INFO:teuthology.orchestra.run.smithi131.stdout:Building scrub 2023-07-11T00:05:05.627 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] common.o 2023-07-11T00:05:05.765 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] counter.o 2023-07-11T00:05:05.839 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] descr.o 2023-07-11T00:05:05.928 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] disk.o 2023-07-11T00:05:06.051 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] filemap.o 2023-07-11T00:05:06.145 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] fscounters.o 2023-07-11T00:05:06.246 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] inodes.o 2023-07-11T00:05:06.395 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase1.o 2023-07-11T00:05:06.508 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase2.o 2023-07-11T00:05:06.616 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase3.o 2023-07-11T00:05:06.736 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase4.o 2023-07-11T00:05:06.838 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase5.o 2023-07-11T00:05:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase6.o 2023-07-11T00:05:07.162 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] phase7.o 2023-07-11T00:05:07.282 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] progress.o 2023-07-11T00:05:07.391 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] read_verify.o 2023-07-11T00:05:07.518 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] repair.o 2023-07-11T00:05:07.642 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] scrub.o 2023-07-11T00:05:07.846 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] spacemap.o 2023-07-11T00:05:07.965 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] vfs.o 2023-07-11T00:05:08.087 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] xfs_scrub.o 2023-07-11T00:05:08.280 INFO:teuthology.orchestra.run.smithi131.stdout: [CC] unicrash.o 2023-07-11T00:05:08.461 INFO:teuthology.orchestra.run.smithi131.stdout: [LD] xfs_scrub 2023-07-11T00:05:08.831 INFO:teuthology.orchestra.run.smithi131.stdout: [SED] xfs_scrub_all 2023-07-11T00:05:08.839 INFO:teuthology.orchestra.run.smithi131.stdout: [SED] xfs_scrub@.service 2023-07-11T00:05:08.847 INFO:teuthology.orchestra.run.smithi131.stdout: [SED] xfs_scrub_all.service 2023-07-11T00:05:08.854 INFO:teuthology.orchestra.run.smithi131.stdout: [SED] xfs_scrub_fail@.service 2023-07-11T00:05:08.861 INFO:teuthology.orchestra.run.smithi131.stdout: [SED] xfs_scrub_all.cron 2023-07-11T00:05:08.868 INFO:teuthology.orchestra.run.smithi131.stdout:Building po 2023-07-11T00:05:08.896 INFO:teuthology.orchestra.run.smithi131.stdout: [GETTXT] xfsprogs.pot 2023-07-11T00:05:09.112 INFO:teuthology.orchestra.run.smithi131.stdout: [MSGFMT] pl.mo 2023-07-11T00:05:09.167 INFO:teuthology.orchestra.run.smithi131.stderr:3104 translated messages. 2023-07-11T00:05:09.170 INFO:teuthology.orchestra.run.smithi131.stdout: [MSGFMT] de.mo 2023-07-11T00:05:09.205 INFO:teuthology.orchestra.run.smithi131.stderr:2345 translated messages. 2023-07-11T00:05:09.206 INFO:teuthology.orchestra.run.smithi131.stdout:gmake[2]: Nothing to be done for 'include'. 2023-07-11T00:05:09.210 DEBUG:teuthology.orchestra.run.smithi131:> (cd /tmp/tmp.a2sTs4EWApxfsprogs-dev && exec sudo make install) 2023-07-11T00:05:09.292 INFO:teuthology.orchestra.run.smithi131.stdout:Installing libfrog-install 2023-07-11T00:05:09.742 INFO:teuthology.orchestra.run.smithi131.stdout:Installing libxfs-install 2023-07-11T00:05:11.434 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-07-11T00:05:11.459 INFO:teuthology.orchestra.run.smithi131.stdout:Installing libxlog-install 2023-07-11T00:05:11.552 INFO:teuthology.orchestra.run.smithi131.stdout:Installing libxcmd-install 2023-07-11T00:05:11.687 INFO:teuthology.orchestra.run.smithi131.stdout:Installing libhandle-install 2023-07-11T00:05:11.764 INFO:teuthology.orchestra.run.smithi131.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib64; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib64; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib64 2023-07-11T00:05:11.933 INFO:teuthology.orchestra.run.smithi131.stdout:Installing copy-install 2023-07-11T00:05:11.985 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:12.008 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-07-11T00:05:12.075 INFO:teuthology.orchestra.run.smithi131.stdout:Installing db-install 2023-07-11T00:05:14.128 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:14.150 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-07-11T00:05:14.221 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-07-11T00:05:14.245 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-07-11T00:05:14.268 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-07-11T00:05:14.293 INFO:teuthology.orchestra.run.smithi131.stdout:Installing estimate-install 2023-07-11T00:05:14.344 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:14.367 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-07-11T00:05:14.424 INFO:teuthology.orchestra.run.smithi131.stdout:Installing fsck-install 2023-07-11T00:05:14.427 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-07-11T00:05:14.450 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-07-11T00:05:14.476 INFO:teuthology.orchestra.run.smithi131.stdout:Installing fsr-install 2023-07-11T00:05:14.529 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:14.552 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-07-11T00:05:14.610 INFO:teuthology.orchestra.run.smithi131.stdout:Installing growfs-install 2023-07-11T00:05:14.662 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:14.685 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-07-11T00:05:14.751 INFO:teuthology.orchestra.run.smithi131.stdout:Installing io-install 2023-07-11T00:05:16.165 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:16.188 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-07-11T00:05:16.246 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-07-11T00:05:16.301 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-07-11T00:05:16.356 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-07-11T00:05:16.413 INFO:teuthology.orchestra.run.smithi131.stdout:Installing logprint-install 2023-07-11T00:05:16.694 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:16.717 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-07-11T00:05:16.784 INFO:teuthology.orchestra.run.smithi131.stdout:Installing mkfs-install 2023-07-11T00:05:16.876 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-07-11T00:05:16.899 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-07-11T00:05:16.965 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-07-11T00:05:16.988 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf /usr/share/xfsprogs/mkfs 2023-07-11T00:05:17.049 INFO:teuthology.orchestra.run.smithi131.stdout:Installing quota-install 2023-07-11T00:05:17.204 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:05:17.206 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:05:17.209 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:05:17.428 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:17.451 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-07-11T00:05:17.509 INFO:teuthology.orchestra.run.smithi131.stdout:Installing mdrestore-install 2023-07-11T00:05:17.560 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:17.583 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-07-11T00:05:17.650 INFO:teuthology.orchestra.run.smithi131.stdout:Installing repair-install 2023-07-11T00:05:19.014 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-07-11T00:05:19.037 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-07-11T00:05:19.109 INFO:teuthology.orchestra.run.smithi131.stdout:Installing rtcp-install 2023-07-11T00:05:19.160 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:19.183 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-07-11T00:05:19.240 INFO:teuthology.orchestra.run.smithi131.stdout:Installing m4-install 2023-07-11T00:05:19.243 INFO:teuthology.orchestra.run.smithi131.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-11T00:05:19.245 INFO:teuthology.orchestra.run.smithi131.stdout:Installing man-install 2023-07-11T00:05:19.253 INFO:teuthology.orchestra.run.smithi131.stdout:gmake[2]: Nothing to be done for 'install'. 2023-07-11T00:05:19.258 INFO:teuthology.orchestra.run.smithi131.stdout:gmake[2]: Nothing to be done for 'install'. 2023-07-11T00:05:19.265 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-07-11T00:05:19.295 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-07-11T00:05:19.324 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-07-11T00:05:19.352 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-07-11T00:05:19.386 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-07-11T00:05:19.415 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-07-11T00:05:19.444 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-07-11T00:05:19.477 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-07-11T00:05:19.501 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-07-11T00:05:19.529 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-07-11T00:05:19.558 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-07-11T00:05:19.589 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-07-11T00:05:19.615 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-07-11T00:05:19.643 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-07-11T00:05:19.672 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-07-11T00:05:19.701 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-07-11T00:05:19.729 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-07-11T00:05:19.758 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-07-11T00:05:19.786 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-07-11T00:05:19.815 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-07-11T00:05:19.843 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-07-11T00:05:19.872 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-07-11T00:05:19.900 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-07-11T00:05:19.929 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-07-11T00:05:19.958 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-07-11T00:05:19.986 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-07-11T00:05:20.015 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-07-11T00:05:20.043 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-07-11T00:05:20.071 INFO:teuthology.orchestra.run.smithi131.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-07-11T00:05:20.098 INFO:teuthology.orchestra.run.smithi131.stdout:Installing doc-install 2023-07-11T00:05:20.101 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-07-11T00:05:20.124 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-07-11T00:05:20.156 INFO:teuthology.orchestra.run.smithi131.stdout:Installing debian-install 2023-07-11T00:05:20.159 INFO:teuthology.orchestra.run.smithi131.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-11T00:05:20.161 INFO:teuthology.orchestra.run.smithi131.stdout:Installing spaceman-install 2023-07-11T00:05:20.447 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:20.471 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-07-11T00:05:20.526 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-07-11T00:05:20.551 INFO:teuthology.orchestra.run.smithi131.stdout:Installing scrub-install 2023-07-11T00:05:21.284 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-11T00:05:21.306 INFO:teuthology.orchestra.run.smithi131.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-07-11T00:05:21.363 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-07-11T00:05:21.386 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/systemd/system 2023-07-11T00:05:21.409 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /usr/lib/systemd/system 2023-07-11T00:05:21.454 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-07-11T00:05:21.477 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib64/xfsprogs 2023-07-11T00:05:21.500 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-07-11T00:05:21.523 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib64/xfsprogs 2023-07-11T00:05:21.548 INFO:teuthology.orchestra.run.smithi131.stdout:Installing po-install 2023-07-11T00:05:21.661 INFO:teuthology.orchestra.run.smithi131.stdout:Installing include-install 2023-07-11T00:05:21.664 INFO:teuthology.orchestra.run.smithi131.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-07-11T00:05:21.687 INFO:teuthology.orchestra.run.smithi131.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-07-11T00:05:21.710 INFO:teuthology.orchestra.run.smithi131.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-07-11T00:05:21.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-11T00:05:21.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.874+0000 7f2b23bbe700 1 Processor -- start 2023-07-11T00:05:21.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.874+0000 7f2b23bbe700 1 -- start start 2023-07-11T00:05:21.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.875+0000 7f2b23bbe700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2b1c070da0 0x7f2b1c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:21.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.875+0000 7f2b23bbe700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1c070130 con 0x7f2b1c06cd00 2023-07-11T00:05:21.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.875+0000 7f2b23bbe700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1c071540 con 0x7f2b1c071910 2023-07-11T00:05:21.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.875+0000 7f2b23bbe700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1c071260 con 0x7f2b1c070da0 2023-07-11T00:05:21.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.875+0000 7f2b2215b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2b1c06cd00 0x7f2b1c1551e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41018/0 (socket says 172.21.15.38:41018) 2023-07-11T00:05:21.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.875+0000 7f2b2215b700 1 -- 172.21.15.38:0/1984295820 learned_addr learned my addr 172.21.15.38:0/1984295820 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:05:21.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.875+0000 7f2b21159700 1 --2- 172.21.15.38:0/1984295820 >> v2:172.21.15.70:3300/0 conn(0x7f2b1c070da0 0x7f2b1c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:21.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.875+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749704863 0 0) 0x7f2b1c070130 con 0x7f2b1c06cd00 2023-07-11T00:05:21.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.875+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b080035b0 con 0x7f2b1c06cd00 2023-07-11T00:05:21.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197663295 0 0) 0x7f2b1c071540 con 0x7f2b1c071910 2023-07-11T00:05:21.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b1c070130 con 0x7f2b1c071910 2023-07-11T00:05:21.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1373850120 0 0) 0x7f2b080035b0 con 0x7f2b1c06cd00 2023-07-11T00:05:21.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 >> v2:172.21.15.70:3300/0 conn(0x7f2b1c070da0 msgr2=0x7f2b1c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:05:21.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 --2- 172.21.15.38:0/1984295820 >> v2:172.21.15.70:3300/0 conn(0x7f2b1c070da0 0x7f2b1c06c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:21.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 >> v1:172.21.15.70:6789/0 conn(0x7f2b1c071910 legacy=0x7f2b1c14b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:21.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c14aa60 con 0x7f2b1c06cd00 2023-07-11T00:05:21.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f2b140019f0 con 0x7f2b1c06cd00 2023-07-11T00:05:21.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 >> v1:172.21.15.38:6789/0 conn(0x7f2b1c06cd00 legacy=0x7f2b1c1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:21.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 --2- 172.21.15.38:0/1984295820 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b08003be0 0x7f2b08003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:21.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 --2- 172.21.15.38:0/1984295820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b08004850 0x7f2b08004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:21.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 --2- 172.21.15.38:0/1984295820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b08005200 0x7f2b0800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:21.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c071260 con 0x7f2b08005200 2023-07-11T00:05:21.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0800c0e0 con 0x7f2b08004850 2023-07-11T00:05:21.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0800c270 con 0x7f2b08003be0 2023-07-11T00:05:21.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b2215b700 1 --2- 172.21.15.38:0/1984295820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b08005200 0x7f2b0800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:21.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b2195a700 1 --2- 172.21.15.38:0/1984295820 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b08003be0 0x7f2b08003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:21.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b21159700 1 --2- 172.21.15.38:0/1984295820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b08004850 0x7f2b08004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:21.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b2215b700 1 -- 172.21.15.38:0/1984295820 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b08003be0 msgr2=0x7f2b08003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:05:21.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b2215b700 1 --2- 172.21.15.38:0/1984295820 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b08003be0 0x7f2b08003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:21.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b2215b700 1 -- 172.21.15.38:0/1984295820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b08004850 msgr2=0x7f2b08004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:05:21.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b2215b700 1 --2- 172.21.15.38:0/1984295820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b08004850 0x7f2b08004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:21.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b2215b700 1 -- 172.21.15.38:0/1984295820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080035b0 con 0x7f2b08005200 2023-07-11T00:05:21.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b2215b700 1 -- 172.21.15.38:0/1984295820 reap_dead start 2023-07-11T00:05:21.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b2215b700 1 --2- 172.21.15.38:0/1984295820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b08005200 0x7f2b0800ba10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400a6c0 tx=0x7f2b08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232b04902dc5a8ff server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:05:21.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b140072d0 con 0x7f2b08005200 2023-07-11T00:05:21.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b14007450 con 0x7f2b08005200 2023-07-11T00:05:21.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.876+0000 7f2b20958700 1 -- 172.21.15.38:0/1984295820 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14007800 con 0x7f2b08005200 2023-07-11T00:05:21.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.877+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1984295820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b08005200 msgr2=0x7f2b0800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:21.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.877+0000 7f2b23bbe700 1 --2- 172.21.15.38:0/1984295820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b08005200 0x7f2b0800ba10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400a6c0 tx=0x7f2b08005880 comp rx=0 tx=0).stop 2023-07-11T00:05:21.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.877+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1984295820 shutdown_connections 2023-07-11T00:05:21.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.877+0000 7f2b23bbe700 1 --2- 172.21.15.38:0/1984295820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b08005200 0x7f2b0800ba10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:21.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.877+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1984295820 >> 172.21.15.38:0/1984295820 conn(0x7f2b1c0be670 msgr2=0x7f2b1c0bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:05:21.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.877+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1984295820 shutdown_connections 2023-07-11T00:05:21.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.877+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1984295820 wait complete. 2023-07-11T00:05:21.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.878+0000 7f2b23bbe700 1 Processor -- start 2023-07-11T00:05:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.878+0000 7f2b23bbe700 1 -- start start 2023-07-11T00:05:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b23bbe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b08005200 0x7f2b1c0b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b23bbe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c0b4970 0x7f2b1c1e31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b23bbe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b1c1e3710 0x7f2b1c143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:21.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b23bbe700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0b6080 con 0x7f2b1c0b4970 2023-07-11T00:05:21.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b23bbe700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0b3a40 con 0x7f2b1c1e3710 2023-07-11T00:05:21.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b23bbe700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0b2e90 con 0x7f2b08005200 2023-07-11T00:05:21.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b21159700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c0b4970 0x7f2b1c1e31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:21.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b21159700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c0b4970 0x7f2b1c1e31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60188/0 (socket says 172.21.15.38:60188) 2023-07-11T00:05:21.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b21159700 1 -- 172.21.15.38:0/1767128108 learned_addr learned my addr 172.21.15.38:0/1767128108 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:05:21.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b2215b700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b1c1e3710 0x7f2b1c143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:21.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b2195a700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b08005200 0x7f2b1c0b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:21.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b21159700 1 -- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b08005200 msgr2=0x7f2b1c0b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:21.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b21159700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b08005200 0x7f2b1c0b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:21.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b21159700 1 -- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b1c1e3710 msgr2=0x7f2b1c143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:21.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b21159700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b1c1e3710 0x7f2b1c143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:21.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b21159700 1 -- 172.21.15.38:0/1767128108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c1e3b80 con 0x7f2b1c0b4970 2023-07-11T00:05:21.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.879+0000 7f2b21159700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c0b4970 0x7f2b1c1e31d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2b180119a0 tx=0x7f2b18011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:05:21.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.880+0000 7f2b0e7fc700 1 -- 172.21.15.38:0/1767128108 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1800f720 con 0x7f2b1c0b4970 2023-07-11T00:05:21.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.880+0000 7f2b0e7fc700 1 -- 172.21.15.38:0/1767128108 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1800f880 con 0x7f2b1c0b4970 2023-07-11T00:05:21.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.880+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1767128108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1c0b3760 con 0x7f2b1c0b4970 2023-07-11T00:05:21.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.880+0000 7f2b0e7fc700 1 -- 172.21.15.38:0/1767128108 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1800fc10 con 0x7f2b1c0b4970 2023-07-11T00:05:21.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.880+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1767128108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c0b3360 con 0x7f2b1c0b4970 2023-07-11T00:05:21.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.881+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1767128108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c0b3550 con 0x7f2b1c0b4970 2023-07-11T00:05:21.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.881+0000 7f2b0e7fc700 1 -- 172.21.15.38:0/1767128108 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b1800fd70 con 0x7f2b1c0b4970 2023-07-11T00:05:21.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.882+0000 7f2b0e7fc700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2b0006ace0 0x7f2b0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:21.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.882+0000 7f2b0e7fc700 1 -- 172.21.15.38:0/1767128108 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f2b18089a70 con 0x7f2b1c0b4970 2023-07-11T00:05:21.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.882+0000 7f2b2195a700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2b0006ace0 0x7f2b0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:21.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.882+0000 7f2b2195a700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2b0006ace0 0x7f2b0006d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b10007fd0 tx=0x7f2b10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:05:21.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:21.887+0000 7f2b0e7fc700 1 -- 172.21.15.38:0/1767128108 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2b180584f0 con 0x7f2b1c0b4970 2023-07-11T00:05:22.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.168+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1767128108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2b1c074360 con 0x7f2b1c0b4970 2023-07-11T00:05:22.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.169+0000 7f2b0e7fc700 1 -- 172.21.15.38:0/1767128108 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f2b18022090 con 0x7f2b1c0b4970 2023-07-11T00:05:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:05:22.172 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":1,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","modified":"2023-07-10T23:59:17.751926Z","created":"2023-07-10T23:59:17.751926Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3301","nonce":0},{"type":"v1","addr":"172.21.15.70:6790","nonce":0}]},"addr":"172.21.15.70:6790/0","public_addr":"172.21.15.70:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-11T00:05:22.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.170+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2b0006ace0 msgr2=0x7f2b0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:22.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.170+0000 7f2b23bbe700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2b0006ace0 0x7f2b0006d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b10007fd0 tx=0x7f2b10009040 comp rx=0 tx=0).stop 2023-07-11T00:05:22.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.170+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1767128108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c0b4970 msgr2=0x7f2b1c1e31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:22.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.170+0000 7f2b23bbe700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c0b4970 0x7f2b1c1e31d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2b180119a0 tx=0x7f2b18011cb0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.171+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1767128108 shutdown_connections 2023-07-11T00:05:22.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.171+0000 7f2b23bbe700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f2b0006ace0 0x7f2b0006d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.171+0000 7f2b23bbe700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b1c1e3710 0x7f2b1c143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.171+0000 7f2b23bbe700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b08005200 0x7f2b1c0b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.171+0000 7f2b23bbe700 1 --2- 172.21.15.38:0/1767128108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c0b4970 0x7f2b1c1e31d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.171+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1767128108 >> 172.21.15.38:0/1767128108 conn(0x7f2b1c0be670 msgr2=0x7f2b1c144590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:05:22.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.171+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1767128108 shutdown_connections 2023-07-11T00:05:22.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.171+0000 7f2b23bbe700 1 -- 172.21.15.38:0/1767128108 wait complete. 2023-07-11T00:05:22.175 INFO:teuthology.orchestra.run.smithi038.stderr:dumped monmap epoch 1 2023-07-11T00:05:22.185 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-07-11T00:05:22.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.309+0000 7f1786576700 1 Processor -- start 2023-07-11T00:05:22.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.309+0000 7f1786576700 1 -- start start 2023-07-11T00:05:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.310+0000 7f1786576700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f178006b120 0x7f17801474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.310+0000 7f1786576700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1780071b60 0x7f1780147a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.310+0000 7f1786576700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17800b3bd0 con 0x7f17800b6430 2023-07-11T00:05:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.310+0000 7f1786576700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1780070800 con 0x7f178006b120 2023-07-11T00:05:22.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.310+0000 7f1786576700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1780141c90 con 0x7f1780071b60 2023-07-11T00:05:22.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.310+0000 7f177ffff700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f178006b120 0x7f17801474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:22.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.310+0000 7f177f7fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1780071b60 0x7f1780147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:22.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.310+0000 7f1784b13700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f17800b6430 0x7f17800b68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:37350/0 (socket says 172.21.15.38:37350) 2023-07-11T00:05:22.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.310+0000 7f177ffff700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f178006b120 0x7f17801474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:49346/0 (socket says 172.21.15.38:49346) 2023-07-11T00:05:22.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.310+0000 7f1784b13700 1 -- 172.21.15.38:0/814653249 learned_addr learned my addr 172.21.15.38:0/814653249 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:05:22.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.311+0000 7f177ffff700 1 -- 172.21.15.38:0/814653249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1780071b60 msgr2=0x7f1780147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:05:22.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.311+0000 7f177ffff700 1 --2- 172.21.15.38:0/814653249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1780071b60 0x7f1780147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.311+0000 7f177ffff700 1 -- 172.21.15.38:0/814653249 >> v1:172.21.15.70:6789/0 conn(0x7f17800b6430 legacy=0x7f17800b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:22.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.311+0000 7f177ffff700 1 -- 172.21.15.38:0/814653249 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17800714d0 con 0x7f178006b120 2023-07-11T00:05:22.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.311+0000 7f177effd700 1 -- 172.21.15.38:0/814653249 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547916430 0 0) 0x7f17800b3bd0 con 0x7f17800b6430 2023-07-11T00:05:22.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.311+0000 7f177ffff700 1 --2- 172.21.15.38:0/814653249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f178006b120 0x7f17801474f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1770009840 tx=0x7f1770009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=862a526df06c72f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:05:22.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.311+0000 7f177effd700 1 -- 172.21.15.38:0/814653249 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770011830 con 0x7f178006b120 2023-07-11T00:05:22.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.311+0000 7f177effd700 1 -- 172.21.15.38:0/814653249 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1770011990 con 0x7f178006b120 2023-07-11T00:05:22.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.311+0000 7f177effd700 1 -- 172.21.15.38:0/814653249 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770011d20 con 0x7f178006b120 2023-07-11T00:05:22.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.312+0000 7f1786576700 1 -- 172.21.15.38:0/814653249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f178006b120 msgr2=0x7f17801474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:22.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.312+0000 7f1786576700 1 --2- 172.21.15.38:0/814653249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f178006b120 0x7f17801474f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1770009840 tx=0x7f1770009b50 comp rx=0 tx=0).stop 2023-07-11T00:05:22.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.312+0000 7f1786576700 1 -- 172.21.15.38:0/814653249 shutdown_connections 2023-07-11T00:05:22.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.312+0000 7f1786576700 1 --2- 172.21.15.38:0/814653249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f178006b120 0x7f17801474f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.312+0000 7f1786576700 1 --2- 172.21.15.38:0/814653249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1780071b60 0x7f1780147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.312+0000 7f1786576700 1 -- 172.21.15.38:0/814653249 >> 172.21.15.38:0/814653249 conn(0x7f17800bd980 msgr2=0x7f17800b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:05:22.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.312+0000 7f1786576700 1 -- 172.21.15.38:0/814653249 shutdown_connections 2023-07-11T00:05:22.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.312+0000 7f1786576700 1 -- 172.21.15.38:0/814653249 wait complete. 2023-07-11T00:05:22.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.313+0000 7f1786576700 1 Processor -- start 2023-07-11T00:05:22.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.313+0000 7f1786576700 1 -- start start 2023-07-11T00:05:22.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f1786576700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f178006b120 0x7f178013e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f1786576700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1780071b60 0x7f17800b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f1786576700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17800b6430 0x7f17800b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f1786576700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17800b4410 con 0x7f1780071b60 2023-07-11T00:05:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f1786576700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178013eb90 con 0x7f178006b120 2023-07-11T00:05:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f1786576700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1780142550 con 0x7f17800b6430 2023-07-11T00:05:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1780071b60 0x7f17800b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1780071b60 0x7f17800b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60194/0 (socket says 172.21.15.38:60194) 2023-07-11T00:05:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177f7fe700 1 -- 172.21.15.38:0/1268960188 learned_addr learned my addr 172.21.15.38:0/1268960188 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:05:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177ffff700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f178006b120 0x7f178013e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f1784b13700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17800b6430 0x7f17800b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177f7fe700 1 -- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17800b6430 msgr2=0x7f17800b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177f7fe700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17800b6430 0x7f17800b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177f7fe700 1 -- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f178006b120 msgr2=0x7f178013e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177f7fe700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f178006b120 0x7f178013e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177f7fe700 1 -- 172.21.15.38:0/1268960188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17700094a0 con 0x7f1780071b60 2023-07-11T00:05:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177ffff700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f178006b120 0x7f178013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-11T00:05:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177f7fe700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1780071b60 0x7f17800b2ea0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f177400e980 tx=0x7f177400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:05:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.314+0000 7f177cff9700 1 -- 172.21.15.38:0/1268960188 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774009710 con 0x7f1780071b60 2023-07-11T00:05:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.315+0000 7f177cff9700 1 -- 172.21.15.38:0/1268960188 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177400c850 con 0x7f1780071b60 2023-07-11T00:05:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.315+0000 7f1786576700 1 -- 172.21.15.38:0/1268960188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178013dbf0 con 0x7f1780071b60 2023-07-11T00:05:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.315+0000 7f177cff9700 1 -- 172.21.15.38:0/1268960188 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400cc00 con 0x7f1780071b60 2023-07-11T00:05:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.315+0000 7f1786576700 1 -- 172.21.15.38:0/1268960188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17800b4030 con 0x7f1780071b60 2023-07-11T00:05:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.315+0000 7f1786576700 1 -- 172.21.15.38:0/1268960188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178013da50 con 0x7f1780071b60 2023-07-11T00:05:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.316+0000 7f177cff9700 1 -- 172.21.15.38:0/1268960188 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1774013470 con 0x7f1780071b60 2023-07-11T00:05:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.316+0000 7f177cff9700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f176c06ace0 0x7f176c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:05:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.316+0000 7f177cff9700 1 -- 172.21.15.38:0/1268960188 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f17740895b0 con 0x7f1780071b60 2023-07-11T00:05:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.316+0000 7f177ffff700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f176c06ace0 0x7f176c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:05:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.317+0000 7f177ffff700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f176c06ace0 0x7f176c06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1770000c00 tx=0x7f177001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:05:22.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.322+0000 7f177cff9700 1 -- 172.21.15.38:0/1268960188 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f178013da50 con 0x7f1780071b60 2023-07-11T00:05:22.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.601+0000 7f1786576700 1 -- 172.21.15.38:0/1268960188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f178013da50 con 0x7f1780071b60 2023-07-11T00:05:22.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.601+0000 7f177cff9700 1 -- 172.21.15.38:0/1268960188 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f178013da50 con 0x7f1780071b60 2023-07-11T00:05:22.604 INFO:teuthology.orchestra.run.smithi038.stdout:[client.admin] 2023-07-11T00:05:22.604 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBWm6xkpB9DARAAb1EeiWTaX/KaKrt6QktY8A== 2023-07-11T00:05:22.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 -- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f176c06ace0 msgr2=0x7f176c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:22.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f176c06ace0 0x7f176c06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1770000c00 tx=0x7f177001c040 comp rx=0 tx=0).stop 2023-07-11T00:05:22.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 -- 172.21.15.38:0/1268960188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1780071b60 msgr2=0x7f17800b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:05:22.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1780071b60 0x7f17800b2ea0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f177400e980 tx=0x7f177400ed40 comp rx=0 tx=0).stop 2023-07-11T00:05:22.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 -- 172.21.15.38:0/1268960188 shutdown_connections 2023-07-11T00:05:22.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f176c06ace0 0x7f176c06d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f17800b6430 0x7f17800b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f178006b120 0x7f178013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 --2- 172.21.15.38:0/1268960188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1780071b60 0x7f17800b2ea0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:05:22.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 -- 172.21.15.38:0/1268960188 >> 172.21.15.38:0/1268960188 conn(0x7f17800bd980 msgr2=0x7f17800b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:05:22.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 -- 172.21.15.38:0/1268960188 shutdown_connections 2023-07-11T00:05:22.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:05:22.603+0000 7f1786576700 1 -- 172.21.15.38:0/1268960188 wait complete. 2023-07-11T00:05:22.618 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-11T00:05:22.619 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/tmp/tmp.ESeo9raKdcxfstests-dev/local.config 2023-07-11T00:05:22.692 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.38:6789:/test export TEST_DIR=/tmp/tmp.GoAWdcZ1qltest export SCRATCH_DEV=172.21.15.38:6789:/scratch export SCRATCH_MNT=/tmp/tmp.kKNWXFcnThscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBWm6xkpB9DARAAb1EeiWTaX/KaKrt6QktY8A==,test_dummy_encryption" 2023-07-11T00:05:22.693 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-07-11T00:05:22.693 DEBUG:teuthology.orchestra.run.smithi131:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.ESeo9raKdcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-07-11T00:05:24.534 INFO:teuthology.orchestra.run.smithi131.stdout:FSTYP -- ceph 2023-07-11T00:05:24.547 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM -- Linux/x86_64 smithi131 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-11T00:05:24.548 INFO:teuthology.orchestra.run.smithi131.stdout:MKFS_OPTIONS -- 172.21.15.38:6789:/scratch 2023-07-11T00:05:24.551 INFO:teuthology.orchestra.run.smithi131.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBWm6xkpB9DARAAb1EeiWTaX/KaKrt6QktY8A==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.38:6789:/scratch /tmp/tmp.kKNWXFcnThscratch 2023-07-11T00:05:24.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-11T00:05:24.750 INFO:teuthology.orchestra.run.smithi131.stdout:ceph/001 [expunged] 2023-07-11T00:05:25.113 INFO:teuthology.orchestra.run.smithi131.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-11T00:05:25.469 INFO:teuthology.orchestra.run.smithi131.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-11T00:05:25.917 INFO:teuthology.orchestra.run.smithi131.stdout:ceph/004 0s 2023-07-11T00:05:26.233 INFO:teuthology.orchestra.run.smithi131.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-11T00:05:33.899 INFO:teuthology.orchestra.run.smithi131.stdout:generic/001 7s 2023-07-11T00:05:34.548 INFO:teuthology.orchestra.run.smithi131.stdout:generic/002 1s 2023-07-11T00:05:34.568 INFO:teuthology.orchestra.run.smithi131.stdout:generic/003 [expunged] 2023-07-11T00:05:34.900 INFO:teuthology.orchestra.run.smithi131.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-07-11T00:05:36.203 INFO:teuthology.orchestra.run.smithi131.stdout:generic/005 2s 2023-07-11T00:05:47.306 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:05:47.308 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:05:47.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:06:00.901 INFO:teuthology.orchestra.run.smithi131.stdout:generic/006 24s 2023-07-11T00:06:17.422 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:06:17.425 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:06:17.428 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:06:48.041 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:06:48.043 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:06:48.045 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:06:52.457 INFO:teuthology.orchestra.run.smithi131.stdout:generic/007 52s 2023-07-11T00:06:55.086 INFO:teuthology.orchestra.run.smithi131.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-11T00:06:57.045 INFO:teuthology.orchestra.run.smithi131.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-11T00:07:18.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:07:18.169 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:07:18.172 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:07:31.328 INFO:teuthology.orchestra.run.smithi131.stdout:generic/011 34s 2023-07-11T00:07:33.548 INFO:teuthology.orchestra.run.smithi131.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-11T00:07:48.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:07:48.327 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:07:48.329 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:08:18.636 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:08:18.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:08:18.640 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:08:18.681 INFO:tasks.ceph.mds.c.smithi038.stderr:2023-07-11T00:08:18.679+0000 7fbc4495e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 130949) UID: 0 2023-07-11T00:08:18.681 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-07-11T00:08:18.679+0000 7f0ef5404700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 130949) UID: 0 2023-07-11T00:10:49.704 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:10:49.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:10:49.709 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:10:49.743 INFO:tasks.ceph.mds.c.smithi038.stderr:2023-07-11T00:10:49.741+0000 7fbc4495e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 130995) UID: 0 2023-07-11T00:10:49.743 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-07-11T00:10:49.741+0000 7f0ef5404700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 130995) UID: 0 2023-07-11T00:13:55.988 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:13:55.991 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:13:55.993 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:13:56.138 INFO:tasks.ceph.mds.c.smithi038.stderr:2023-07-11T00:13:56.135+0000 7fbc4495e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 131047) UID: 0 2023-07-11T00:13:56.139 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-07-11T00:13:56.135+0000 7f0ef5404700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 131047) UID: 0 2023-07-11T00:14:08.714 INFO:teuthology.orchestra.run.smithi131.stdout:generic/013 395s 2023-07-11T00:16:36.244 INFO:teuthology.orchestra.run.smithi131.stdout:generic/014 148s 2023-07-11T00:16:36.565 INFO:teuthology.orchestra.run.smithi131.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-11T00:16:42.292 INFO:teuthology.orchestra.run.smithi131.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-11T00:16:42.773 INFO:teuthology.orchestra.run.smithi131.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-07-11T00:16:47.815 INFO:teuthology.orchestra.run.smithi131.stdout:generic/020 5s 2023-07-11T00:16:52.490 INFO:teuthology.orchestra.run.smithi131.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-11T00:16:57.286 INFO:teuthology.orchestra.run.smithi131.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-11T00:17:41.106 INFO:teuthology.orchestra.run.smithi131.stdout:generic/023 44s 2023-07-11T00:17:41.447 INFO:teuthology.orchestra.run.smithi131.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-07-11T00:17:41.794 INFO:teuthology.orchestra.run.smithi131.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-07-11T00:17:42.168 INFO:teuthology.orchestra.run.smithi131.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-07-11T00:17:47.523 INFO:teuthology.orchestra.run.smithi131.stdout:generic/028 5s 2023-07-11T00:17:48.701 INFO:teuthology.orchestra.run.smithi131.stdout:generic/029 1s 2023-07-11T00:17:59.117 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:17:59.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:17:59.122 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:18:00.045 INFO:teuthology.orchestra.run.smithi131.stdout:generic/030 12s 2023-07-11T00:18:06.055 INFO:teuthology.orchestra.run.smithi131.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-11T00:18:06.390 INFO:teuthology.orchestra.run.smithi131.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:18:13.035 INFO:teuthology.orchestra.run.smithi131.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi131.stdout:generic/034 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:18:13.806 INFO:teuthology.orchestra.run.smithi131.stdout:generic/035 0s 2023-07-11T00:18:20.900 INFO:teuthology.orchestra.run.smithi131.stdout:generic/037 7s 2023-07-11T00:18:21.324 INFO:teuthology.orchestra.run.smithi131.stdout:generic/039 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:18:21.687 INFO:teuthology.orchestra.run.smithi131.stdout:generic/040 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:18:22.044 INFO:teuthology.orchestra.run.smithi131.stdout:generic/041 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:18:22.538 INFO:teuthology.orchestra.run.smithi131.stdout:generic/042 [not run] ceph does not support shutdown 2023-07-11T00:18:23.035 INFO:teuthology.orchestra.run.smithi131.stdout:generic/050 [not run] ceph does not support shutdown 2023-07-11T00:18:23.545 INFO:teuthology.orchestra.run.smithi131.stdout:generic/052 [not run] ceph does not support shutdown 2023-07-11T00:18:24.590 INFO:teuthology.orchestra.run.smithi131.stdout:generic/053 1s 2023-07-11T00:18:25.111 INFO:teuthology.orchestra.run.smithi131.stdout:generic/056 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:18:25.373 INFO:teuthology.orchestra.run.smithi131.stdout:generic/057 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:18:29.307 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:18:29.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:18:29.312 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:18:30.090 INFO:teuthology.orchestra.run.smithi131.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-11T00:18:30.444 INFO:teuthology.orchestra.run.smithi131.stdout:generic/059 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:18:35.246 INFO:teuthology.orchestra.run.smithi131.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-11T00:18:40.419 INFO:teuthology.orchestra.run.smithi131.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-11T00:18:42.686 INFO:teuthology.orchestra.run.smithi131.stdout:generic/062 2s 2023-07-11T00:18:47.295 INFO:teuthology.orchestra.run.smithi131.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-11T00:18:47.661 INFO:teuthology.orchestra.run.smithi131.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-11T00:18:48.021 INFO:teuthology.orchestra.run.smithi131.stdout:generic/065 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:18:48.367 INFO:teuthology.orchestra.run.smithi131.stdout:generic/066 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:18:48.748 INFO:teuthology.orchestra.run.smithi131.stdout:generic/067 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:18:59.446 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:18:59.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:18:59.453 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:19:10.348 INFO:teuthology.orchestra.run.smithi131.stdout:generic/069 22s 2023-07-11T00:19:23.248 INFO:teuthology.orchestra.run.smithi131.stdout:generic/070 13s 2023-07-11T00:19:23.579 INFO:teuthology.orchestra.run.smithi131.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-11T00:19:23.924 INFO:teuthology.orchestra.run.smithi131.stdout:generic/073 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:19:23.948 INFO:teuthology.orchestra.run.smithi131.stdout:generic/075 [expunged] 2023-07-11T00:19:24.270 INFO:teuthology.orchestra.run.smithi131.stdout:generic/076 [not run] require 172.21.15.38:6789:/scratch to be local device 2023-07-11T00:19:24.616 INFO:teuthology.orchestra.run.smithi131.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-07-11T00:19:24.947 INFO:teuthology.orchestra.run.smithi131.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-07-11T00:19:27.337 INFO:teuthology.orchestra.run.smithi131.stdout:generic/080 3s 2023-07-11T00:19:27.712 INFO:teuthology.orchestra.run.smithi131.stdout:generic/081 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:19:28.046 INFO:teuthology.orchestra.run.smithi131.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-11T00:19:29.473 INFO:tasks.ceph.mds.c.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fbc3d14f700 time 2023-07-11T00:19:29.472151+0000 2023-07-11T00:19:29.474 INFO:tasks.ceph.mds.c.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-11T00:19:29.487 INFO:tasks.ceph.mds.c.smithi038.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:19:29.487 INFO:tasks.ceph.mds.c.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbc4ea27dbf] 2023-07-11T00:19:29.488 INFO:tasks.ceph.mds.c.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fbc4ea27f85] 2023-07-11T00:19:29.488 INFO:tasks.ceph.mds.c.smithi038.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x560aba359bc2] 2023-07-11T00:19:29.488 INFO:tasks.ceph.mds.c.smithi038.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x560aba341e5c] 2023-07-11T00:19:29.488 INFO:tasks.ceph.mds.c.smithi038.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x560aba34aa37] 2023-07-11T00:19:29.489 INFO:tasks.ceph.mds.c.smithi038.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x560aba34f2af] 2023-07-11T00:19:29.489 INFO:tasks.ceph.mds.c.smithi038.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x560aba1a1137] 2023-07-11T00:19:29.489 INFO:tasks.ceph.mds.c.smithi038.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x560aba1a1fe0] 2023-07-11T00:19:29.490 INFO:tasks.ceph.mds.c.smithi038.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x560aba1a3ee5] 2023-07-11T00:19:29.490 INFO:tasks.ceph.mds.c.smithi038.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x560aba22a585] 2023-07-11T00:19:29.490 INFO:tasks.ceph.mds.c.smithi038.stderr: 11: (MDSContext::complete(int)+0x5f) [0x560aba48879f] 2023-07-11T00:19:29.490 INFO:tasks.ceph.mds.c.smithi038.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x560aba488f24] 2023-07-11T00:19:29.491 INFO:tasks.ceph.mds.c.smithi038.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x560aba4892db] 2023-07-11T00:19:29.491 INFO:tasks.ceph.mds.c.smithi038.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fbc4eacb93d] 2023-07-11T00:19:29.491 INFO:tasks.ceph.mds.c.smithi038.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fbc4d7cf1ca] 2023-07-11T00:19:29.491 INFO:tasks.ceph.mds.c.smithi038.stderr: 16: clone() 2023-07-11T00:19:29.492 INFO:tasks.ceph.mds.c.smithi038.stderr:*** Caught signal (Aborted) ** 2023-07-11T00:19:29.492 INFO:tasks.ceph.mds.c.smithi038.stderr: in thread 7fbc3d14f700 thread_name:MR_Finisher 2023-07-11T00:19:29.492 INFO:tasks.ceph.mds.c.smithi038.stderr:2023-07-11T00:19:29.484+0000 7fbc3d14f700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fbc3d14f700 time 2023-07-11T00:19:29.472151+0000 2023-07-11T00:19:29.493 INFO:tasks.ceph.mds.c.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-11T00:19:29.493 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.493 INFO:tasks.ceph.mds.c.smithi038.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:19:29.493 INFO:tasks.ceph.mds.c.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbc4ea27dbf] 2023-07-11T00:19:29.494 INFO:tasks.ceph.mds.c.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fbc4ea27f85] 2023-07-11T00:19:29.494 INFO:tasks.ceph.mds.c.smithi038.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x560aba359bc2] 2023-07-11T00:19:29.494 INFO:tasks.ceph.mds.c.smithi038.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x560aba341e5c] 2023-07-11T00:19:29.495 INFO:tasks.ceph.mds.c.smithi038.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x560aba34aa37] 2023-07-11T00:19:29.495 INFO:tasks.ceph.mds.c.smithi038.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x560aba34f2af] 2023-07-11T00:19:29.495 INFO:tasks.ceph.mds.c.smithi038.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x560aba1a1137] 2023-07-11T00:19:29.495 INFO:tasks.ceph.mds.c.smithi038.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x560aba1a1fe0] 2023-07-11T00:19:29.496 INFO:tasks.ceph.mds.c.smithi038.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x560aba1a3ee5] 2023-07-11T00:19:29.496 INFO:tasks.ceph.mds.c.smithi038.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x560aba22a585] 2023-07-11T00:19:29.496 INFO:tasks.ceph.mds.c.smithi038.stderr: 11: (MDSContext::complete(int)+0x5f) [0x560aba48879f] 2023-07-11T00:19:29.497 INFO:tasks.ceph.mds.c.smithi038.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x560aba488f24] 2023-07-11T00:19:29.497 INFO:tasks.ceph.mds.c.smithi038.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x560aba4892db] 2023-07-11T00:19:29.497 INFO:tasks.ceph.mds.c.smithi038.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fbc4eacb93d] 2023-07-11T00:19:29.497 INFO:tasks.ceph.mds.c.smithi038.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fbc4d7cf1ca] 2023-07-11T00:19:29.498 INFO:tasks.ceph.mds.c.smithi038.stderr: 16: clone() 2023-07-11T00:19:29.498 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.500 INFO:tasks.ceph.mds.c.smithi038.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:19:29.500 INFO:tasks.ceph.mds.c.smithi038.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fbc4d7d9cf0] 2023-07-11T00:19:29.500 INFO:tasks.ceph.mds.c.smithi038.stderr: 2: gsignal() 2023-07-11T00:19:29.500 INFO:tasks.ceph.mds.c.smithi038.stderr: 3: abort() 2023-07-11T00:19:29.501 INFO:tasks.ceph.mds.c.smithi038.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbc4ea27e19] 2023-07-11T00:19:29.501 INFO:tasks.ceph.mds.c.smithi038.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fbc4ea27f85] 2023-07-11T00:19:29.501 INFO:tasks.ceph.mds.c.smithi038.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x560aba359bc2] 2023-07-11T00:19:29.502 INFO:tasks.ceph.mds.c.smithi038.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x560aba341e5c] 2023-07-11T00:19:29.502 INFO:tasks.ceph.mds.c.smithi038.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x560aba34aa37] 2023-07-11T00:19:29.502 INFO:tasks.ceph.mds.c.smithi038.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x560aba34f2af] 2023-07-11T00:19:29.503 INFO:tasks.ceph.mds.c.smithi038.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x560aba1a1137] 2023-07-11T00:19:29.503 INFO:tasks.ceph.mds.c.smithi038.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x560aba1a1fe0] 2023-07-11T00:19:29.503 INFO:tasks.ceph.mds.c.smithi038.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x560aba1a3ee5] 2023-07-11T00:19:29.503 INFO:tasks.ceph.mds.c.smithi038.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x560aba22a585] 2023-07-11T00:19:29.504 INFO:tasks.ceph.mds.c.smithi038.stderr: 14: (MDSContext::complete(int)+0x5f) [0x560aba48879f] 2023-07-11T00:19:29.504 INFO:tasks.ceph.mds.c.smithi038.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x560aba488f24] 2023-07-11T00:19:29.504 INFO:tasks.ceph.mds.c.smithi038.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x560aba4892db] 2023-07-11T00:19:29.505 INFO:tasks.ceph.mds.c.smithi038.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fbc4eacb93d] 2023-07-11T00:19:29.505 INFO:tasks.ceph.mds.c.smithi038.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fbc4d7cf1ca] 2023-07-11T00:19:29.505 INFO:tasks.ceph.mds.c.smithi038.stderr: 19: clone() 2023-07-11T00:19:29.505 INFO:tasks.ceph.mds.c.smithi038.stderr:2023-07-11T00:19:29.485+0000 7fbc3d14f700 -1 *** Caught signal (Aborted) ** 2023-07-11T00:19:29.506 INFO:tasks.ceph.mds.c.smithi038.stderr: in thread 7fbc3d14f700 thread_name:MR_Finisher 2023-07-11T00:19:29.506 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.506 INFO:tasks.ceph.mds.c.smithi038.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:19:29.507 INFO:tasks.ceph.mds.c.smithi038.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fbc4d7d9cf0] 2023-07-11T00:19:29.507 INFO:tasks.ceph.mds.c.smithi038.stderr: 2: gsignal() 2023-07-11T00:19:29.507 INFO:tasks.ceph.mds.c.smithi038.stderr: 3: abort() 2023-07-11T00:19:29.508 INFO:tasks.ceph.mds.c.smithi038.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbc4ea27e19] 2023-07-11T00:19:29.508 INFO:tasks.ceph.mds.c.smithi038.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fbc4ea27f85] 2023-07-11T00:19:29.508 INFO:tasks.ceph.mds.c.smithi038.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x560aba359bc2] 2023-07-11T00:19:29.508 INFO:tasks.ceph.mds.c.smithi038.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x560aba341e5c] 2023-07-11T00:19:29.509 INFO:tasks.ceph.mds.c.smithi038.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x560aba34aa37] 2023-07-11T00:19:29.509 INFO:tasks.ceph.mds.c.smithi038.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x560aba34f2af] 2023-07-11T00:19:29.510 INFO:tasks.ceph.mds.c.smithi038.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x560aba1a1137] 2023-07-11T00:19:29.510 INFO:tasks.ceph.mds.c.smithi038.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x560aba1a1fe0] 2023-07-11T00:19:29.510 INFO:tasks.ceph.mds.c.smithi038.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x560aba1a3ee5] 2023-07-11T00:19:29.510 INFO:tasks.ceph.mds.c.smithi038.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x560aba22a585] 2023-07-11T00:19:29.511 INFO:tasks.ceph.mds.c.smithi038.stderr: 14: (MDSContext::complete(int)+0x5f) [0x560aba48879f] 2023-07-11T00:19:29.511 INFO:tasks.ceph.mds.c.smithi038.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x560aba488f24] 2023-07-11T00:19:29.511 INFO:tasks.ceph.mds.c.smithi038.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x560aba4892db] 2023-07-11T00:19:29.511 INFO:tasks.ceph.mds.c.smithi038.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fbc4eacb93d] 2023-07-11T00:19:29.512 INFO:tasks.ceph.mds.c.smithi038.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fbc4d7cf1ca] 2023-07-11T00:19:29.512 INFO:tasks.ceph.mds.c.smithi038.stderr: 19: clone() 2023-07-11T00:19:29.512 INFO:tasks.ceph.mds.c.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-11T00:19:29.513 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.513 INFO:tasks.ceph.mds.c.smithi038.stderr: -1> 2023-07-11T00:19:29.484+0000 7fbc3d14f700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fbc3d14f700 time 2023-07-11T00:19:29.472151+0000 2023-07-11T00:19:29.513 INFO:tasks.ceph.mds.c.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-11T00:19:29.514 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.514 INFO:tasks.ceph.mds.c.smithi038.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:19:29.514 INFO:tasks.ceph.mds.c.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbc4ea27dbf] 2023-07-11T00:19:29.514 INFO:tasks.ceph.mds.c.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fbc4ea27f85] 2023-07-11T00:19:29.514 INFO:tasks.ceph.mds.c.smithi038.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x560aba359bc2] 2023-07-11T00:19:29.514 INFO:tasks.ceph.mds.c.smithi038.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x560aba341e5c] 2023-07-11T00:19:29.515 INFO:tasks.ceph.mds.c.smithi038.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x560aba34aa37] 2023-07-11T00:19:29.515 INFO:tasks.ceph.mds.c.smithi038.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x560aba34f2af] 2023-07-11T00:19:29.515 INFO:tasks.ceph.mds.c.smithi038.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x560aba1a1137] 2023-07-11T00:19:29.515 INFO:tasks.ceph.mds.c.smithi038.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x560aba1a1fe0] 2023-07-11T00:19:29.515 INFO:tasks.ceph.mds.c.smithi038.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x560aba1a3ee5] 2023-07-11T00:19:29.515 INFO:tasks.ceph.mds.c.smithi038.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x560aba22a585] 2023-07-11T00:19:29.516 INFO:tasks.ceph.mds.c.smithi038.stderr: 11: (MDSContext::complete(int)+0x5f) [0x560aba48879f] 2023-07-11T00:19:29.516 INFO:tasks.ceph.mds.c.smithi038.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x560aba488f24] 2023-07-11T00:19:29.516 INFO:tasks.ceph.mds.c.smithi038.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x560aba4892db] 2023-07-11T00:19:29.516 INFO:tasks.ceph.mds.c.smithi038.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fbc4eacb93d] 2023-07-11T00:19:29.516 INFO:tasks.ceph.mds.c.smithi038.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fbc4d7cf1ca] 2023-07-11T00:19:29.516 INFO:tasks.ceph.mds.c.smithi038.stderr: 16: clone() 2023-07-11T00:19:29.517 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.517 INFO:tasks.ceph.mds.c.smithi038.stderr: 0> 2023-07-11T00:19:29.485+0000 7fbc3d14f700 -1 *** Caught signal (Aborted) ** 2023-07-11T00:19:29.517 INFO:tasks.ceph.mds.c.smithi038.stderr: in thread 7fbc3d14f700 thread_name:MR_Finisher 2023-07-11T00:19:29.517 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.517 INFO:tasks.ceph.mds.c.smithi038.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:19:29.517 INFO:tasks.ceph.mds.c.smithi038.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fbc4d7d9cf0] 2023-07-11T00:19:29.517 INFO:tasks.ceph.mds.c.smithi038.stderr: 2: gsignal() 2023-07-11T00:19:29.517 INFO:tasks.ceph.mds.c.smithi038.stderr: 3: abort() 2023-07-11T00:19:29.518 INFO:tasks.ceph.mds.c.smithi038.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbc4ea27e19] 2023-07-11T00:19:29.518 INFO:tasks.ceph.mds.c.smithi038.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fbc4ea27f85] 2023-07-11T00:19:29.518 INFO:tasks.ceph.mds.c.smithi038.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x560aba359bc2] 2023-07-11T00:19:29.518 INFO:tasks.ceph.mds.c.smithi038.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x560aba341e5c] 2023-07-11T00:19:29.518 INFO:tasks.ceph.mds.c.smithi038.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x560aba34aa37] 2023-07-11T00:19:29.518 INFO:tasks.ceph.mds.c.smithi038.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x560aba34f2af] 2023-07-11T00:19:29.518 INFO:tasks.ceph.mds.c.smithi038.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x560aba1a1137] 2023-07-11T00:19:29.519 INFO:tasks.ceph.mds.c.smithi038.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x560aba1a1fe0] 2023-07-11T00:19:29.519 INFO:tasks.ceph.mds.c.smithi038.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x560aba1a3ee5] 2023-07-11T00:19:29.519 INFO:tasks.ceph.mds.c.smithi038.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x560aba22a585] 2023-07-11T00:19:29.519 INFO:tasks.ceph.mds.c.smithi038.stderr: 14: (MDSContext::complete(int)+0x5f) [0x560aba48879f] 2023-07-11T00:19:29.519 INFO:tasks.ceph.mds.c.smithi038.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x560aba488f24] 2023-07-11T00:19:29.519 INFO:tasks.ceph.mds.c.smithi038.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x560aba4892db] 2023-07-11T00:19:29.519 INFO:tasks.ceph.mds.c.smithi038.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fbc4eacb93d] 2023-07-11T00:19:29.519 INFO:tasks.ceph.mds.c.smithi038.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fbc4d7cf1ca] 2023-07-11T00:19:29.520 INFO:tasks.ceph.mds.c.smithi038.stderr: 19: clone() 2023-07-11T00:19:29.520 INFO:tasks.ceph.mds.c.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-11T00:19:29.520 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.520 INFO:tasks.ceph.mds.c.smithi038.stderr: -1> 2023-07-11T00:19:29.484+0000 7fbc3d14f700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fbc3d14f700 time 2023-07-11T00:19:29.472151+0000 2023-07-11T00:19:29.521 INFO:tasks.ceph.mds.c.smithi038.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-11T00:19:29.521 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.521 INFO:tasks.ceph.mds.c.smithi038.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:19:29.521 INFO:tasks.ceph.mds.c.smithi038.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fbc4ea27dbf] 2023-07-11T00:19:29.521 INFO:tasks.ceph.mds.c.smithi038.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fbc4ea27f85] 2023-07-11T00:19:29.521 INFO:tasks.ceph.mds.c.smithi038.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x560aba359bc2] 2023-07-11T00:19:29.521 INFO:tasks.ceph.mds.c.smithi038.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x560aba341e5c] 2023-07-11T00:19:29.522 INFO:tasks.ceph.mds.c.smithi038.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x560aba34aa37] 2023-07-11T00:19:29.522 INFO:tasks.ceph.mds.c.smithi038.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x560aba34f2af] 2023-07-11T00:19:29.522 INFO:tasks.ceph.mds.c.smithi038.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x560aba1a1137] 2023-07-11T00:19:29.522 INFO:tasks.ceph.mds.c.smithi038.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x560aba1a1fe0] 2023-07-11T00:19:29.522 INFO:tasks.ceph.mds.c.smithi038.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x560aba1a3ee5] 2023-07-11T00:19:29.522 INFO:tasks.ceph.mds.c.smithi038.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x560aba22a585] 2023-07-11T00:19:29.523 INFO:tasks.ceph.mds.c.smithi038.stderr: 11: (MDSContext::complete(int)+0x5f) [0x560aba48879f] 2023-07-11T00:19:29.523 INFO:tasks.ceph.mds.c.smithi038.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x560aba488f24] 2023-07-11T00:19:29.523 INFO:tasks.ceph.mds.c.smithi038.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x560aba4892db] 2023-07-11T00:19:29.523 INFO:tasks.ceph.mds.c.smithi038.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fbc4eacb93d] 2023-07-11T00:19:29.523 INFO:tasks.ceph.mds.c.smithi038.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fbc4d7cf1ca] 2023-07-11T00:19:29.524 INFO:tasks.ceph.mds.c.smithi038.stderr: 16: clone() 2023-07-11T00:19:29.524 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.524 INFO:tasks.ceph.mds.c.smithi038.stderr: 0> 2023-07-11T00:19:29.485+0000 7fbc3d14f700 -1 *** Caught signal (Aborted) ** 2023-07-11T00:19:29.524 INFO:tasks.ceph.mds.c.smithi038.stderr: in thread 7fbc3d14f700 thread_name:MR_Finisher 2023-07-11T00:19:29.524 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.524 INFO:tasks.ceph.mds.c.smithi038.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-11T00:19:29.525 INFO:tasks.ceph.mds.c.smithi038.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fbc4d7d9cf0] 2023-07-11T00:19:29.525 INFO:tasks.ceph.mds.c.smithi038.stderr: 2: gsignal() 2023-07-11T00:19:29.525 INFO:tasks.ceph.mds.c.smithi038.stderr: 3: abort() 2023-07-11T00:19:29.525 INFO:tasks.ceph.mds.c.smithi038.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fbc4ea27e19] 2023-07-11T00:19:29.525 INFO:tasks.ceph.mds.c.smithi038.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fbc4ea27f85] 2023-07-11T00:19:29.525 INFO:tasks.ceph.mds.c.smithi038.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x560aba359bc2] 2023-07-11T00:19:29.525 INFO:tasks.ceph.mds.c.smithi038.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x560aba341e5c] 2023-07-11T00:19:29.525 INFO:tasks.ceph.mds.c.smithi038.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x560aba34aa37] 2023-07-11T00:19:29.526 INFO:tasks.ceph.mds.c.smithi038.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x560aba34f2af] 2023-07-11T00:19:29.526 INFO:tasks.ceph.mds.c.smithi038.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x560aba1a1137] 2023-07-11T00:19:29.526 INFO:tasks.ceph.mds.c.smithi038.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x560aba1a1fe0] 2023-07-11T00:19:29.526 INFO:tasks.ceph.mds.c.smithi038.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x560aba1a3ee5] 2023-07-11T00:19:29.526 INFO:tasks.ceph.mds.c.smithi038.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x560aba22a585] 2023-07-11T00:19:29.526 INFO:tasks.ceph.mds.c.smithi038.stderr: 14: (MDSContext::complete(int)+0x5f) [0x560aba48879f] 2023-07-11T00:19:29.526 INFO:tasks.ceph.mds.c.smithi038.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x560aba488f24] 2023-07-11T00:19:29.526 INFO:tasks.ceph.mds.c.smithi038.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x560aba4892db] 2023-07-11T00:19:29.527 INFO:tasks.ceph.mds.c.smithi038.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fbc4eacb93d] 2023-07-11T00:19:29.527 INFO:tasks.ceph.mds.c.smithi038.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fbc4d7cf1ca] 2023-07-11T00:19:29.527 INFO:tasks.ceph.mds.c.smithi038.stderr: 19: clone() 2023-07-11T00:19:29.527 INFO:tasks.ceph.mds.c.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-11T00:19:29.527 INFO:tasks.ceph.mds.c.smithi038.stderr: 2023-07-11T00:19:29.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:19:29.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:19:29.556 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:19:31.065 INFO:tasks.ceph.mds.c.smithi038.stderr:daemon-helper: command crashed with signal 6 2023-07-11T00:19:34.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-07-11T00:19:40.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-07-11T00:19:47.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-07-11T00:19:53.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-07-11T00:19:57.715 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-07-11T00:19:57.713+0000 7f0ef13fc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-11T00:19:59.657 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:19:59.660 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:19:59.663 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:20:00.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~26s 2023-07-11T00:20:00.932 INFO:teuthology.orchestra.run.smithi131.stdout:generic/084 32s 2023-07-11T00:20:01.349 INFO:teuthology.orchestra.run.smithi131.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:20:01.790 INFO:teuthology.orchestra.run.smithi131.stdout:generic/087 0s 2023-07-11T00:20:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:generic/088 1s 2023-07-11T00:20:02.514 INFO:teuthology.orchestra.run.smithi131.stdout:generic/090 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:20:06.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~33s 2023-07-11T00:20:13.180 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~39s 2023-07-11T00:20:19.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~46s 2023-07-11T00:20:26.205 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~52s 2023-07-11T00:20:29.770 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:20:29.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:20:29.776 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:20:32.718 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~59s 2023-07-11T00:20:39.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~65s 2023-07-11T00:20:45.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~72s 2023-07-11T00:20:52.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~78s 2023-07-11T00:20:58.448 INFO:teuthology.orchestra.run.smithi131.stdout:generic/091 56s 2023-07-11T00:20:58.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~85s 2023-07-11T00:20:58.787 INFO:teuthology.orchestra.run.smithi131.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:20:59.171 INFO:teuthology.orchestra.run.smithi131.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-11T00:20:59.917 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:20:59.920 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:20:59.923 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:21:04.132 INFO:teuthology.orchestra.run.smithi131.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-11T00:21:04.814 INFO:teuthology.orchestra.run.smithi131.stdout:generic/097 0s 2023-07-11T00:21:05.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~91s 2023-07-11T00:21:05.833 INFO:teuthology.orchestra.run.smithi131.stdout:generic/098 1s 2023-07-11T00:21:07.055 INFO:teuthology.orchestra.run.smithi131.stdout:generic/099 2s 2023-07-11T00:21:07.400 INFO:teuthology.orchestra.run.smithi131.stdout:generic/101 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:21:07.744 INFO:teuthology.orchestra.run.smithi131.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-11T00:21:08.101 INFO:teuthology.orchestra.run.smithi131.stdout:generic/104 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:21:08.952 INFO:teuthology.orchestra.run.smithi131.stdout:generic/105 0s 2023-07-11T00:21:09.372 INFO:teuthology.orchestra.run.smithi131.stdout:generic/106 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:21:09.737 INFO:teuthology.orchestra.run.smithi131.stdout:generic/107 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:21:10.210 INFO:teuthology.orchestra.run.smithi131.stdout:generic/108 [not run] require 172.21.15.38:6789:/scratch to be valid block disk 2023-07-11T00:21:10.586 INFO:teuthology.orchestra.run.smithi131.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-07-11T00:21:10.951 INFO:teuthology.orchestra.run.smithi131.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-07-11T00:21:11.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~98s 2023-07-11T00:21:18.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~104s 2023-07-11T00:21:24.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~111s 2023-07-11T00:21:30.046 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:21:30.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:21:30.051 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:21:31.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~117s 2023-07-11T00:21:37.846 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~124s 2023-07-11T00:21:39.510 INFO:teuthology.orchestra.run.smithi131.stdout:generic/112 29s 2023-07-11T00:21:44.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~130s 2023-07-11T00:21:50.874 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~137s 2023-07-11T00:21:57.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~143s 2023-07-11T00:22:00.254 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:22:00.258 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:22:00.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:22:03.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~150s 2023-07-11T00:22:10.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~156s 2023-07-11T00:22:16.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~163s 2023-07-11T00:22:23.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~169s 2023-07-11T00:22:29.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~176s 2023-07-11T00:22:30.375 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:22:30.384 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:22:30.405 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:22:36.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~182s 2023-07-11T00:22:42.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~189s 2023-07-11T00:22:49.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~195s 2023-07-11T00:22:56.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~202s 2023-07-11T00:23:00.588 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:23:00.598 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:23:00.606 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:23:02.526 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~208s 2023-07-11T00:23:09.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~215s 2023-07-11T00:23:15.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~221s 2023-07-11T00:23:22.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~228s 2023-07-11T00:23:28.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~234s 2023-07-11T00:23:28.990 INFO:teuthology.orchestra.run.smithi131.stdout:generic/113 109s 2023-07-11T00:23:29.363 INFO:teuthology.orchestra.run.smithi131.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-07-11T00:23:29.727 INFO:teuthology.orchestra.run.smithi131.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-07-11T00:23:30.087 INFO:teuthology.orchestra.run.smithi131.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-07-11T00:23:30.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:23:30.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:23:30.789 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:23:35.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~241s 2023-07-11T00:23:36.601 INFO:teuthology.orchestra.run.smithi131.stdout:generic/117 6s 2023-07-11T00:23:37.043 INFO:teuthology.orchestra.run.smithi131.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-07-11T00:23:37.408 INFO:teuthology.orchestra.run.smithi131.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-07-11T00:23:37.735 INFO:teuthology.orchestra.run.smithi131.stdout:generic/120 [not run] atime not maintained by ceph 2023-07-11T00:23:38.107 INFO:teuthology.orchestra.run.smithi131.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-11T00:23:38.482 INFO:teuthology.orchestra.run.smithi131.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-11T00:23:39.223 INFO:teuthology.orchestra.run.smithi131.stdout:generic/123 1s 2023-07-11T00:23:41.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~248s 2023-07-11T00:23:48.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~254s 2023-07-11T00:23:54.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~261s 2023-07-11T00:24:01.093 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:24:01.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~267s 2023-07-11T00:24:01.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:24:01.191 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:24:07.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~274s 2023-07-11T00:24:14.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~280s 2023-07-11T00:24:18.244 INFO:teuthology.orchestra.run.smithi131.stdout:generic/124 39s 2023-07-11T00:24:18.836 INFO:teuthology.orchestra.run.smithi131.stdout:generic/126 0s 2023-07-11T00:24:20.178 INFO:teuthology.orchestra.run.smithi131.stdout:generic/128 2s 2023-07-11T00:24:20.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~287s 2023-07-11T00:24:27.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~293s 2023-07-11T00:24:31.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:24:31.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:24:31.795 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:24:33.718 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~300s 2023-07-11T00:24:40.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~306s 2023-07-11T00:24:40.232 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-07-11T00:24:40.232 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-11T00:24:40.232 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:24:40.285 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-11T00:24:40.286 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-11T00:24:40.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-11T00:24:41.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.132+0000 7f9a10e93700 1 Processor -- start 2023-07-11T00:24:41.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.139+0000 7f9a10e93700 1 -- start start 2023-07-11T00:24:41.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.140+0000 7f9a10e93700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9a0c0b8700 0x7f9a0c0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:41.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.140+0000 7f9a10e93700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0b46f0 con 0x7f9a0c146ee0 2023-07-11T00:24:41.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.140+0000 7f9a10e93700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0b4940 con 0x7f9a0c0b93d0 2023-07-11T00:24:41.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.140+0000 7f9a10e93700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c0b4c20 con 0x7f9a0c0b8700 2023-07-11T00:24:41.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.145+0000 7f9a0ad9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9a0c146ee0 0x7f9a0c140240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54168/0 (socket says 172.21.15.38:54168) 2023-07-11T00:24:41.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.145+0000 7f9a0ad9d700 1 -- 172.21.15.38:0/1251745198 learned_addr learned my addr 172.21.15.38:0/1251745198 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:24:41.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.147+0000 7f9a0a59c700 1 --2- 172.21.15.38:0/1251745198 >> v2:172.21.15.38:3300/0 conn(0x7f9a0c0b8700 0x7f9a0c0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:41.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.149+0000 7f9a0a59c700 1 -- 172.21.15.38:0/1251745198 >> v1:172.21.15.70:6789/0 conn(0x7f9a0c0b93d0 legacy=0x7f9a0c1467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:41.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.149+0000 7f9a0a59c700 1 -- 172.21.15.38:0/1251745198 >> v1:172.21.15.38:6789/0 conn(0x7f9a0c146ee0 legacy=0x7f9a0c140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:24:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.149+0000 7f9a0a59c700 1 -- 172.21.15.38:0/1251745198 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0b4f00 con 0x7f9a0c0b8700 2023-07-11T00:24:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.149+0000 7f9a0a59c700 1 --2- 172.21.15.38:0/1251745198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a0c0b8700 0x7f9a0c0b3b00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009d90 tx=0x7f9a0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ac7dd774451068 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:41.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.152+0000 7f9a0959a700 1 -- 172.21.15.38:0/1251745198 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400bd90 con 0x7f9a0c0b8700 2023-07-11T00:24:41.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.152+0000 7f9a0959a700 1 -- 172.21.15.38:0/1251745198 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04009e80 con 0x7f9a0c0b8700 2023-07-11T00:24:41.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.152+0000 7f9a0959a700 1 -- 172.21.15.38:0/1251745198 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04003c60 con 0x7f9a0c0b8700 2023-07-11T00:24:41.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.153+0000 7f9a10e93700 1 -- 172.21.15.38:0/1251745198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a0c0b8700 msgr2=0x7f9a0c0b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:41.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.153+0000 7f9a10e93700 1 --2- 172.21.15.38:0/1251745198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a0c0b8700 0x7f9a0c0b3b00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009d90 tx=0x7f9a0400b330 comp rx=0 tx=0).stop 2023-07-11T00:24:41.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.185+0000 7f9a10e93700 1 -- 172.21.15.38:0/1251745198 shutdown_connections 2023-07-11T00:24:41.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.185+0000 7f9a10e93700 1 --2- 172.21.15.38:0/1251745198 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a0c0b8700 0x7f9a0c0b3b00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:41.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.185+0000 7f9a10e93700 1 -- 172.21.15.38:0/1251745198 >> 172.21.15.38:0/1251745198 conn(0x7f9a0c069f30 msgr2=0x7f9a0c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:41.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.186+0000 7f9a10e93700 1 -- 172.21.15.38:0/1251745198 shutdown_connections 2023-07-11T00:24:41.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.187+0000 7f9a10e93700 1 -- 172.21.15.38:0/1251745198 wait complete. 2023-07-11T00:24:41.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.189+0000 7f9a10e93700 1 Processor -- start 2023-07-11T00:24:41.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.189+0000 7f9a10e93700 1 -- start start 2023-07-11T00:24:41.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.190+0000 7f9a10e93700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a0c0b8700 0x7f9a0c0bbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:41.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.190+0000 7f9a10e93700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a0c0b93d0 0x7f9a0c1cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:41.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.190+0000 7f9a10e93700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9a0c146ee0 0x7f9a0c1ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:41.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.190+0000 7f9a10e93700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1d03a0 con 0x7f9a0c0b93d0 2023-07-11T00:24:41.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.190+0000 7f9a10e93700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1ece30 con 0x7f9a0c0b8700 2023-07-11T00:24:41.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.190+0000 7f9a10e93700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0ba8b0 con 0x7f9a0c146ee0 2023-07-11T00:24:41.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.190+0000 7f9a0a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a0c0b8700 0x7f9a0c0bbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:41.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.190+0000 7f9a0ad9d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9a0c146ee0 0x7f9a0c1ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:41.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.190+0000 7f9a0ad9d700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9a0c146ee0 0x7f9a0c1ec8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:58324/0 (socket says 172.21.15.38:58324) 2023-07-11T00:24:41.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.190+0000 7f9a0ad9d700 1 -- 172.21.15.38:0/2902621378 learned_addr learned my addr 172.21.15.38:0/2902621378 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:24:41.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.191+0000 7f9a0a59c700 1 -- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9a0c146ee0 msgr2=0x7f9a0c1ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:41.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.191+0000 7f9a0a59c700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9a0c146ee0 0x7f9a0c1ec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:41.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.191+0000 7f9a0a59c700 1 -- 172.21.15.38:0/2902621378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a0c0b93d0 msgr2=0x7f9a0c1cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:41.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.191+0000 7f9a0a59c700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a0c0b93d0 0x7f9a0c1cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:41.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.191+0000 7f9a0a59c700 1 -- 172.21.15.38:0/2902621378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04009a70 con 0x7f9a0c0b8700 2023-07-11T00:24:41.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.192+0000 7f9a0a59c700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a0c0b8700 0x7f9a0c0bbb40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9a04017000 tx=0x7f9a04004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:41.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.209+0000 7f9a02ffd700 1 -- 172.21.15.38:0/2902621378 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0401e070 con 0x7f9a0c0b8700 2023-07-11T00:24:41.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.209+0000 7f9a02ffd700 1 -- 172.21.15.38:0/2902621378 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a040046d0 con 0x7f9a0c0b8700 2023-07-11T00:24:41.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.209+0000 7f9a02ffd700 1 -- 172.21.15.38:0/2902621378 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04010480 con 0x7f9a0c0b8700 2023-07-11T00:24:41.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.209+0000 7f9a10e93700 1 -- 172.21.15.38:0/2902621378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c0bade0 con 0x7f9a0c0b8700 2023-07-11T00:24:41.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.209+0000 7f9a10e93700 1 -- 172.21.15.38:0/2902621378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c0bb620 con 0x7f9a0c0b8700 2023-07-11T00:24:41.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.212+0000 7f9a02ffd700 1 -- 172.21.15.38:0/2902621378 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a040193f0 con 0x7f9a0c0b8700 2023-07-11T00:24:41.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.213+0000 7f9a02ffd700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f99ec06adb0 0x7f99ec06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:41.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.213+0000 7f9a02ffd700 1 -- 172.21.15.38:0/2902621378 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f9a0400e030 con 0x7f9a0c0b8700 2023-07-11T00:24:41.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.217+0000 7f9a09d9b700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f99ec06adb0 0x7f99ec06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:41.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.225+0000 7f9a09d9b700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f99ec06adb0 0x7f99ec06d260 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c1eda00 tx=0x7f99f4007a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:41.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.229+0000 7f9a10e93700 1 -- 172.21.15.38:0/2902621378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f00052f0 con 0x7f9a0c0b8700 2023-07-11T00:24:41.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.237+0000 7f9a02ffd700 1 -- 172.21.15.38:0/2902621378 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9a04055700 con 0x7f9a0c0b8700 2023-07-11T00:24:41.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.667+0000 7f9a10e93700 1 -- 172.21.15.38:0/2902621378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99f00055a0 con 0x7f9a0c0b8700 2023-07-11T00:24:41.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.673+0000 7f9a02ffd700 1 -- 172.21.15.38:0/2902621378 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18411 (secure 0 0 0) 0x7f9a04027020 con 0x7f9a0c0b8700 2023-07-11T00:24:41.677 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-11T00:24:41.677 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"fsid":"712aa6bd-5b82-40dc-8d7c-7e66131fef83","created":"2023-07-10T23:59:58.054774+0000","modified":"2023-07-11T00:19:43.065111+0000","last_up_change":"2023-07-11T00:00:08.230033+0000","last_in_change":"2023-07-11T00:00:00.584914+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-11T00:00:09.440044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-11T00:00:10.009071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-11T00:01:01.571071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-11T00:01:02.232591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a365f14-620e-4c76-9c26-d6f7631dee8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6801","nonce":724039367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6803","nonce":724039367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6807","nonce":724039367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":724039367},{"type":"v1","addr":"172.21.15.38:6805","nonce":724039367}]},"public_addr":"172.21.15.38:6801/724039367","cluster_addr":"172.21.15.38:6803/724039367","heartbeat_back_addr":"172.21.15.38:6807/724039367","heartbeat_front_addr":"172.21.15.38:6805/724039367","state":["exists","up"]},{"osd":1,"uuid":"7ce8d1a9-b7de-4180-a0d9-798243fda1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6825","nonce":415471262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6827","nonce":415471262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6831","nonce":415471262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":415471262},{"type":"v1","addr":"172.21.15.38:6829","nonce":415471262}]},"public_addr":"172.21.15.38:6825/415471262","cluster_addr":"172.21.15.38:6827/415471262","heartbeat_back_addr":"172.21.15.38:6831/415471262","heartbeat_front_addr":"172.21.15.38:6829/415471262","state":["exists","up"]},{"osd":2,"uuid":"603586a2-533a-4cc4-ab25-29e107607861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6809","nonce":3299763585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6811","nonce":3299763585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6815","nonce":3299763585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3299763585},{"type":"v1","addr":"172.21.15.38:6813","nonce":3299763585}]},"public_addr":"172.21.15.38:6809/3299763585","cluster_addr":"172.21.15.38:6811/3299763585","heartbeat_back_addr":"172.21.15.38:6815/3299763585","heartbeat_front_addr":"172.21.15.38:6813/3299763585","state":["exists","up"]},{"osd":3,"uuid":"b9d1944b-4c68-4c76-9486-538f18296624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6817","nonce":1181787803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6819","nonce":1181787803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6823","nonce":1181787803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1181787803},{"type":"v1","addr":"172.21.15.38:6821","nonce":1181787803}]},"public_addr":"172.21.15.38:6817/1181787803","cluster_addr":"172.21.15.38:6819/1181787803","heartbeat_back_addr":"172.21.15.38:6823/1181787803","heartbeat_front_addr":"172.21.15.38:6821/1181787803","state":["exists","up"]},{"osd":4,"uuid":"a61888ae-c332-4628-844e-3620e072e6bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6801","nonce":3020490369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6803","nonce":3020490369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6807","nonce":3020490369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3020490369},{"type":"v1","addr":"172.21.15.70:6805","nonce":3020490369}]},"public_addr":"172.21.15.70:6801/3020490369","cluster_addr":"172.21.15.70:6803/3020490369","heartbeat_back_addr":"172.21.15.70:6807/3020490369","heartbeat_front_addr":"172.21.15.70:6805/3020490369","state":["exists","up"]},{"osd":5,"uuid":"d39f3259-d2e0-4890-abd2-2c8cfc646fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6809","nonce":3665672607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6811","nonce":3665672607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6815","nonce":3665672607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3665672607},{"type":"v1","addr":"172.21.15.70:6813","nonce":3665672607}]},"public_addr":"172.21.15.70:6809/3665672607","cluster_addr":"172.21.15.70:6811/3665672607","heartbeat_back_addr":"172.21.15.70:6815/3665672607","heartbeat_front_addr":"172.21.15.70:6813/3665672607","state":["exists","up"]},{"osd":6,"uuid":"eac42388-4a57-46df-b091-1cbd559dd9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6825","nonce":2098956368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6827","nonce":2098956368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6831","nonce":2098956368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2098956368},{"type":"v1","addr":"172.21.15.70:6829","nonce":2098956368}]},"public_addr":"172.21.15.70:6825/2098956368","cluster_addr":"172.21.15.70:6827/2098956368","heartbeat_back_addr":"172.21.15.70:6831/2098956368","heartbeat_front_addr":"172.21.15.70:6829/2098956368","state":["exists","up"]},{"osd":7,"uuid":"e5433b75-e894-4f42-93c3-e7a15a0a2345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6817","nonce":3720879556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6819","nonce":3720879556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6823","nonce":3720879556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3720879556},{"type":"v1","addr":"172.21.15.70:6821","nonce":3720879556}]},"public_addr":"172.21.15.70:6817/3720879556","cluster_addr":"172.21.15.70:6819/3720879556","heartbeat_back_addr":"172.21.15.70:6823/3720879556","heartbeat_front_addr":"172.21.15.70:6821/3720879556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.514138+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.806652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.780908+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.795442+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.758297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.749934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.779174+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-11T00:00:05.731870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6834/2519374117":"2023-07-12T00:19:43.065054+0000","172.21.15.38:6832/2519374117":"2023-07-12T00:19:43.065054+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-11T00:24:41.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.676+0000 7f9a10e93700 1 -- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f99ec06adb0 msgr2=0x7f99ec06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:41.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.676+0000 7f9a10e93700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f99ec06adb0 0x7f99ec06d260 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c1eda00 tx=0x7f99f4007a00 comp rx=0 tx=0).stop 2023-07-11T00:24:41.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.676+0000 7f9a10e93700 1 -- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a0c0b8700 msgr2=0x7f9a0c0bbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:41.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.676+0000 7f9a10e93700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a0c0b8700 0x7f9a0c0bbb40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9a04017000 tx=0x7f9a04004ad0 comp rx=0 tx=0).stop 2023-07-11T00:24:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.687+0000 7f9a10e93700 1 -- 172.21.15.38:0/2902621378 shutdown_connections 2023-07-11T00:24:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.687+0000 7f9a10e93700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f99ec06adb0 0x7f99ec06d260 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.687+0000 7f9a10e93700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9a0c146ee0 0x7f9a0c1ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.687+0000 7f9a10e93700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a0c0b8700 0x7f9a0c0bbb40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:41.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.687+0000 7f9a10e93700 1 --2- 172.21.15.38:0/2902621378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a0c0b93d0 0x7f9a0c1cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:41.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.687+0000 7f9a10e93700 1 -- 172.21.15.38:0/2902621378 >> 172.21.15.38:0/2902621378 conn(0x7f9a0c069f30 msgr2=0x7f9a0c13ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:41.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.692+0000 7f9a10e93700 1 -- 172.21.15.38:0/2902621378 shutdown_connections 2023-07-11T00:24:41.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:41.692+0000 7f9a10e93700 1 -- 172.21.15.38:0/2902621378 wait complete. 2023-07-11T00:24:41.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-11T00:00:09.440044+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-11T00:00:10.009071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-11T00:01:01.571071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-11T00:01:02.232591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-11T00:24:41.730 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-11T00:24:42.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.050+0000 7f52fadcc700 1 Processor -- start 2023-07-11T00:24:42.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.050+0000 7f52fadcc700 1 -- start start 2023-07-11T00:24:42.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.051+0000 7f52fadcc700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f52f414beb0 0x7f52f414c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:42.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.051+0000 7f52fadcc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f414c8a0 con 0x7f52f4071b20 2023-07-11T00:24:42.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.051+0000 7f52fadcc700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f40b62f0 con 0x7f52f40b1540 2023-07-11T00:24:42.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.051+0000 7f52fadcc700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f4070fc0 con 0x7f52f414beb0 2023-07-11T00:24:42.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.052+0000 7f52f3fff700 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f52f40b1540 0x7f52f4071410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.38:51726/0 (socket says 172.21.15.38:51726) 2023-07-11T00:24:42.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.052+0000 7f52f3fff700 1 -- 172.21.15.38:0/3274618174 learned_addr learned my addr 172.21.15.38:0/3274618174 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-07-11T00:24:42.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.067+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914679392 0 0) 0x7f52f40b62f0 con 0x7f52f40b1540 2023-07-11T00:24:42.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.067+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52dc0035b0 con 0x7f52f40b1540 2023-07-11T00:24:42.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.067+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268959977 0 0) 0x7f52f414c8a0 con 0x7f52f4071b20 2023-07-11T00:24:42.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.067+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f40b62f0 con 0x7f52f4071b20 2023-07-11T00:24:42.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1882843307 0 0) 0x7f52f40b62f0 con 0x7f52f4071b20 2023-07-11T00:24:42.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 >> v2:172.21.15.70:3300/0 conn(0x7f52f414beb0 msgr2=0x7f52f414c280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:24:42.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 --2- 172.21.15.38:0/3274618174 >> v2:172.21.15.70:3300/0 conn(0x7f52f414beb0 0x7f52f414c280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:42.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 >> v1:172.21.15.70:6789/0 conn(0x7f52f40b1540 legacy=0x7f52f4071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40700c0 con 0x7f52f4071b20 2023-07-11T00:24:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3849079434 0 0) 0x7f52ec0018a0 con 0x7f52f4071b20 2023-07-11T00:24:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 >> v1:172.21.15.38:6789/0 conn(0x7f52f4071b20 legacy=0x7f52f4145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 --2- 172.21.15.38:0/3274618174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52dc004bf0 0x7f52dc004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 --2- 172.21.15.38:0/3274618174 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52dc0037f0 0x7f52dc003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 --2- 172.21.15.38:0/3274618174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc0042c0 0x7f52dc00fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:42.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4070fc0 con 0x7f52dc004bf0 2023-07-11T00:24:42.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc010670 con 0x7f52dc0042c0 2023-07-11T00:24:42.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.068+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc010830 con 0x7f52dc0037f0 2023-07-11T00:24:42.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.073+0000 7f52f9369700 1 --2- 172.21.15.38:0/3274618174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc0042c0 0x7f52dc00fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:42.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.074+0000 7f52f8b68700 1 --2- 172.21.15.38:0/3274618174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52dc004bf0 0x7f52dc004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:42.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.075+0000 7f52f3fff700 1 --2- 172.21.15.38:0/3274618174 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52dc0037f0 0x7f52dc003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:42.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.076+0000 7f52f8b68700 1 -- 172.21.15.38:0/3274618174 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52dc0037f0 msgr2=0x7f52dc003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:24:42.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.076+0000 7f52f8b68700 1 --2- 172.21.15.38:0/3274618174 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52dc0037f0 0x7f52dc003c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:42.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.076+0000 7f52f8b68700 1 -- 172.21.15.38:0/3274618174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc0042c0 msgr2=0x7f52dc00fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:24:42.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.076+0000 7f52f8b68700 1 --2- 172.21.15.38:0/3274618174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc0042c0 0x7f52dc00fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:42.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.076+0000 7f52f8b68700 1 -- 172.21.15.38:0/3274618174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40700c0 con 0x7f52dc004bf0 2023-07-11T00:24:42.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.078+0000 7f52f8b68700 1 --2- 172.21.15.38:0/3274618174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52dc004bf0 0x7f52dc004fe0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f52e8013e80 tx=0x7f52dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0fb04319bc3de5 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:42.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.078+0000 7f52f9369700 1 -- 172.21.15.38:0/3274618174 reap_dead start 2023-07-11T00:24:42.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.080+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e80138f0 con 0x7f52dc004bf0 2023-07-11T00:24:42.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.080+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e8009b40 con 0x7f52dc004bf0 2023-07-11T00:24:42.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.080+0000 7f52f37fe700 1 -- 172.21.15.38:0/3274618174 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e801b410 con 0x7f52dc004bf0 2023-07-11T00:24:42.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.081+0000 7f52fadcc700 1 -- 172.21.15.38:0/3274618174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52dc004bf0 msgr2=0x7f52dc004fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:42.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.081+0000 7f52fadcc700 1 --2- 172.21.15.38:0/3274618174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52dc004bf0 0x7f52dc004fe0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f52e8013e80 tx=0x7f52dc005880 comp rx=0 tx=0).stop 2023-07-11T00:24:42.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.084+0000 7f52fadcc700 1 -- 172.21.15.38:0/3274618174 shutdown_connections 2023-07-11T00:24:42.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.084+0000 7f52fadcc700 1 --2- 172.21.15.38:0/3274618174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52dc004bf0 0x7f52dc004fe0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:42.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.084+0000 7f52fadcc700 1 -- 172.21.15.38:0/3274618174 >> 172.21.15.38:0/3274618174 conn(0x7f52f40be670 msgr2=0x7f52f40bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:42.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.094+0000 7f52fadcc700 1 -- 172.21.15.38:0/3274618174 shutdown_connections 2023-07-11T00:24:42.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.095+0000 7f52fadcc700 1 -- 172.21.15.38:0/3274618174 wait complete. 2023-07-11T00:24:42.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.096+0000 7f52fadcc700 1 Processor -- start 2023-07-11T00:24:42.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.096+0000 7f52fadcc700 1 -- start start 2023-07-11T00:24:42.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.097+0000 7f52fadcc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc004bf0 0x7f52f4141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:42.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.097+0000 7f52fadcc700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52f413e8f0 0x7f52f413ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:42.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.097+0000 7f52fadcc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f41dec40 0x7f52f41df0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:42.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.097+0000 7f52fadcc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40b86b0 con 0x7f52f41dec40 2023-07-11T00:24:42.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.097+0000 7f52fadcc700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4141da0 con 0x7f52dc004bf0 2023-07-11T00:24:42.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.097+0000 7f52fadcc700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f413f2a0 con 0x7f52f413e8f0 2023-07-11T00:24:42.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.098+0000 7f52f8b68700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc004bf0 0x7f52f4141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:42.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.098+0000 7f52f9369700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f41dec40 0x7f52f41df0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:42.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.098+0000 7f52f9369700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f41dec40 0x7f52f41df0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42446/0 (socket says 172.21.15.38:42446) 2023-07-11T00:24:42.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.098+0000 7f52f9369700 1 -- 172.21.15.38:0/829226765 learned_addr learned my addr 172.21.15.38:0/829226765 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:24:42.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.099+0000 7f52f9369700 1 -- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52f413e8f0 msgr2=0x7f52f413ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:42.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.099+0000 7f52f9369700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52f413e8f0 0x7f52f413ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:42.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.099+0000 7f52f9369700 1 -- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc004bf0 msgr2=0x7f52f4141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.099+0000 7f52f9369700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc004bf0 0x7f52f4141860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.099+0000 7f52f9369700 1 -- 172.21.15.38:0/829226765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f41df5f0 con 0x7f52f41dec40 2023-07-11T00:24:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.099+0000 7f52f9369700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f41dec40 0x7f52f41df0b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f52f4071f80 tx=0x7f52ec00a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.099+0000 7f52f17fa700 1 -- 172.21.15.38:0/829226765 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00ac20 con 0x7f52f41dec40 2023-07-11T00:24:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.099+0000 7f52f17fa700 1 -- 172.21.15.38:0/829226765 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00ad80 con 0x7f52f41dec40 2023-07-11T00:24:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.099+0000 7f52f17fa700 1 -- 172.21.15.38:0/829226765 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec014670 con 0x7f52f41dec40 2023-07-11T00:24:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.099+0000 7f52fadcc700 1 -- 172.21.15.38:0/829226765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f4149640 con 0x7f52f41dec40 2023-07-11T00:24:42.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.099+0000 7f52fadcc700 1 -- 172.21.15.38:0/829226765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f40b82d0 con 0x7f52f41dec40 2023-07-11T00:24:42.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.100+0000 7f52fadcc700 1 -- 172.21.15.38:0/829226765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f4074360 con 0x7f52f41dec40 2023-07-11T00:24:42.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.138+0000 7f52f17fa700 1 -- 172.21.15.38:0/829226765 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52ec01d3b0 con 0x7f52f41dec40 2023-07-11T00:24:42.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.138+0000 7f52f17fa700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f52e006ace0 0x7f52e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:42.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.138+0000 7f52f17fa700 1 -- 172.21.15.38:0/829226765 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f52ec089af0 con 0x7f52f41dec40 2023-07-11T00:24:42.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.139+0000 7f52f17fa700 1 -- 172.21.15.38:0/829226765 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f52ec0b5400 con 0x7f52f41dec40 2023-07-11T00:24:42.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.160+0000 7f52f8b68700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f52e006ace0 0x7f52e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:42.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.182+0000 7f52f8b68700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f52e006ace0 0x7f52e006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52e8013fd0 tx=0x7f52e8018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.591+0000 7f52fadcc700 1 -- 172.21.15.38:0/829226765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f52f40bf490 con 0x7f52f41dec40 2023-07-11T00:24:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.592+0000 7f52f17fa700 1 -- 172.21.15.38:0/829226765 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f52ec019020 con 0x7f52f41dec40 2023-07-11T00:24:42.602 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-07-11T00:24:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.612+0000 7f52fadcc700 1 -- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f52e006ace0 msgr2=0x7f52e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.614+0000 7f52fadcc700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f52e006ace0 0x7f52e006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52e8013fd0 tx=0x7f52e8018000 comp rx=0 tx=0).stop 2023-07-11T00:24:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.615+0000 7f52fadcc700 1 -- 172.21.15.38:0/829226765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f41dec40 msgr2=0x7f52f41df0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.615+0000 7f52fadcc700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f41dec40 0x7f52f41df0b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f52f4071f80 tx=0x7f52ec00a510 comp rx=0 tx=0).stop 2023-07-11T00:24:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.624+0000 7f52fadcc700 1 -- 172.21.15.38:0/829226765 shutdown_connections 2023-07-11T00:24:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.624+0000 7f52fadcc700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f52e006ace0 0x7f52e006d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.624+0000 7f52fadcc700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f41dec40 0x7f52f41df0b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.624+0000 7f52fadcc700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc004bf0 0x7f52f4141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.624+0000 7f52fadcc700 1 --2- 172.21.15.38:0/829226765 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52f413e8f0 0x7f52f413ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.624+0000 7f52fadcc700 1 -- 172.21.15.38:0/829226765 >> 172.21.15.38:0/829226765 conn(0x7f52f40be670 msgr2=0x7f52f40bdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:42.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.627+0000 7f52fadcc700 1 -- 172.21.15.38:0/829226765 shutdown_connections 2023-07-11T00:24:42.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:42.627+0000 7f52fadcc700 1 -- 172.21.15.38:0/829226765 wait complete. 2023-07-11T00:24:42.663 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-11T00:24:43.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.039+0000 7f0c06dc1700 1 Processor -- start 2023-07-11T00:24:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.039+0000 7f0c06dc1700 1 -- start start 2023-07-11T00:24:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.039+0000 7f0c06dc1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c0006c5e0 0x7f0c000b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.040+0000 7f0c06dc1700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0c00140b00 0x7f0c00150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.040+0000 7f0c06dc1700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c00149c30 con 0x7f0c00140680 2023-07-11T00:24:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.040+0000 7f0c06dc1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c000b5850 con 0x7f0c0006c5e0 2023-07-11T00:24:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.040+0000 7f0c06dc1700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c00072540 con 0x7f0c00140b00 2023-07-11T00:24:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.040+0000 7f0c04b5d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c0006c5e0 0x7f0c000b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:43.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.040+0000 7f0c04b5d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c0006c5e0 0x7f0c000b68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42450/0 (socket says 172.21.15.38:42450) 2023-07-11T00:24:43.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.040+0000 7f0c04b5d700 1 -- 172.21.15.38:0/1077464 learned_addr learned my addr 172.21.15.38:0/1077464 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:24:43.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.040+0000 7f0c04b5d700 1 -- 172.21.15.38:0/1077464 >> v2:172.21.15.70:3300/0 conn(0x7f0c00140b00 msgr2=0x7f0c00150fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:24:43.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.040+0000 7f0c04b5d700 1 --2- 172.21.15.38:0/1077464 >> v2:172.21.15.70:3300/0 conn(0x7f0c00140b00 0x7f0c00150fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:43.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.040+0000 7f0c04b5d700 1 -- 172.21.15.38:0/1077464 >> v1:172.21.15.70:6789/0 conn(0x7f0c00140680 legacy=0x7f0c000b4be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:24:43.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.040+0000 7f0c04b5d700 1 -- 172.21.15.38:0/1077464 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c000b3db0 con 0x7f0c0006c5e0 2023-07-11T00:24:43.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.041+0000 7f0c04b5d700 1 --2- 172.21.15.38:0/1077464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c0006c5e0 0x7f0c000b68c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0c000b6350 tx=0x7f0bfc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41695052cc8cb90a server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:43.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.041+0000 7f0bf77fe700 1 -- 172.21.15.38:0/1077464 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc004030 con 0x7f0c0006c5e0 2023-07-11T00:24:43.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.041+0000 7f0bf77fe700 1 -- 172.21.15.38:0/1077464 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc004190 con 0x7f0c0006c5e0 2023-07-11T00:24:43.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.041+0000 7f0bf77fe700 1 -- 172.21.15.38:0/1077464 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc004520 con 0x7f0c0006c5e0 2023-07-11T00:24:43.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.041+0000 7f0c06dc1700 1 -- 172.21.15.38:0/1077464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c0006c5e0 msgr2=0x7f0c000b68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:43.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.041+0000 7f0c06dc1700 1 --2- 172.21.15.38:0/1077464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c0006c5e0 0x7f0c000b68c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0c000b6350 tx=0x7f0bfc009bd0 comp rx=0 tx=0).stop 2023-07-11T00:24:43.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.047+0000 7f0c06dc1700 1 -- 172.21.15.38:0/1077464 shutdown_connections 2023-07-11T00:24:43.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.047+0000 7f0c06dc1700 1 --2- 172.21.15.38:0/1077464 >> v2:172.21.15.70:3300/0 conn(0x7f0c00140b00 0x7f0c00150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:43.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.047+0000 7f0c06dc1700 1 --2- 172.21.15.38:0/1077464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c0006c5e0 0x7f0c000b68c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:43.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.047+0000 7f0c06dc1700 1 -- 172.21.15.38:0/1077464 >> 172.21.15.38:0/1077464 conn(0x7f0c000bc880 msgr2=0x7f0c000bcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:43.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.052+0000 7f0c06dc1700 1 -- 172.21.15.38:0/1077464 shutdown_connections 2023-07-11T00:24:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.052+0000 7f0c06dc1700 1 -- 172.21.15.38:0/1077464 wait complete. 2023-07-11T00:24:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.053+0000 7f0c06dc1700 1 Processor -- start 2023-07-11T00:24:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.054+0000 7f0c06dc1700 1 -- start start 2023-07-11T00:24:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.055+0000 7f0c06dc1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c0006c5e0 0x7f0c001437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.055+0000 7f0c06dc1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c00140680 0x7f0c0013efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.055+0000 7f0c06dc1700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c00140b00 0x7f0c0013f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.055+0000 7f0c06dc1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c00143d10 con 0x7f0c0006c5e0 2023-07-11T00:24:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.055+0000 7f0c06dc1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c00146a20 con 0x7f0c00140680 2023-07-11T00:24:43.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.055+0000 7f0c06dc1700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0013e870 con 0x7f0c00140b00 2023-07-11T00:24:43.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.055+0000 7f0bf7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c00140680 0x7f0c0013efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:43.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.055+0000 7f0bf7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c00140680 0x7f0c0013efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:42082/0 (socket says 172.21.15.38:42082) 2023-07-11T00:24:43.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.055+0000 7f0bf7fff700 1 -- 172.21.15.38:0/2049556331 learned_addr learned my addr 172.21.15.38:0/2049556331 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:24:43.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.055+0000 7f0c0535e700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c00140b00 0x7f0c0013f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:43.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.056+0000 7f0c0535e700 1 -- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c00140680 msgr2=0x7f0c0013efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.056+0000 7f0c0535e700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c00140680 0x7f0c0013efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.056+0000 7f0c0535e700 1 -- 172.21.15.38:0/2049556331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c0006c5e0 msgr2=0x7f0c001437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.056+0000 7f0c0535e700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c0006c5e0 0x7f0c001437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:43.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.056+0000 7f0c0535e700 1 -- 172.21.15.38:0/2049556331 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc009550 con 0x7f0c00140b00 2023-07-11T00:24:43.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.074+0000 7f0c0535e700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c00140b00 0x7f0c0013f520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800be20 tx=0x7f0bf8009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:43.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.081+0000 7f0bf57fa700 1 -- 172.21.15.38:0/2049556331 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800cc90 con 0x7f0c00140b00 2023-07-11T00:24:43.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.081+0000 7f0bf57fa700 1 -- 172.21.15.38:0/2049556331 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf800ce30 con 0x7f0c00140b00 2023-07-11T00:24:43.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.081+0000 7f0bf57fa700 1 -- 172.21.15.38:0/2049556331 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8014680 con 0x7f0c00140b00 2023-07-11T00:24:43.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.081+0000 7f0c06dc1700 1 -- 172.21.15.38:0/2049556331 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c00083470 con 0x7f0c00140b00 2023-07-11T00:24:43.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.081+0000 7f0c06dc1700 1 -- 172.21.15.38:0/2049556331 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c00146460 con 0x7f0c00140b00 2023-07-11T00:24:43.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.083+0000 7f0bf57fa700 1 -- 172.21.15.38:0/2049556331 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0bf8006d50 con 0x7f0c00140b00 2023-07-11T00:24:43.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.084+0000 7f0bf57fa700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bec06adb0 0x7f0bec06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:43.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.084+0000 7f0bf57fa700 1 -- 172.21.15.38:0/2049556331 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f0bf8088fa0 con 0x7f0c00140b00 2023-07-11T00:24:43.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.087+0000 7f0c06dc1700 1 -- 172.21.15.38:0/2049556331 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c00074360 con 0x7f0c00140b00 2023-07-11T00:24:43.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.090+0000 7f0c04b5d700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bec06adb0 0x7f0bec06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:43.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.099+0000 7f0bf57fa700 1 -- 172.21.15.38:0/2049556331 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0bf80540f0 con 0x7f0c00140b00 2023-07-11T00:24:43.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.121+0000 7f0c04b5d700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bec06adb0 0x7f0bec06d260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc000c00 tx=0x7f0bfc032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:43.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.552+0000 7f0c06dc1700 1 -- 172.21.15.38:0/2049556331 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c001475e0 con 0x7f0c00140b00 2023-07-11T00:24:43.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.555+0000 7f0bf57fa700 1 -- 172.21.15.38:0/2049556331 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0bf8019020 con 0x7f0c00140b00 2023-07-11T00:24:43.568 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-07-11T00:24:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.569+0000 7f0c06dc1700 1 -- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bec06adb0 msgr2=0x7f0bec06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.569+0000 7f0c06dc1700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bec06adb0 0x7f0bec06d260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc000c00 tx=0x7f0bfc032000 comp rx=0 tx=0).stop 2023-07-11T00:24:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.569+0000 7f0c06dc1700 1 -- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c00140b00 msgr2=0x7f0c0013f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.569+0000 7f0c06dc1700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c00140b00 0x7f0c0013f520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800be20 tx=0x7f0bf8009ef0 comp rx=0 tx=0).stop 2023-07-11T00:24:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.570+0000 7f0c06dc1700 1 -- 172.21.15.38:0/2049556331 shutdown_connections 2023-07-11T00:24:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.570+0000 7f0c06dc1700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f0bec06adb0 0x7f0bec06d260 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc000c00 tx=0x7f0bfc032000 comp rx=0 tx=0).stop 2023-07-11T00:24:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.570+0000 7f0c06dc1700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c00140b00 0x7f0c0013f520 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.570+0000 7f0c06dc1700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c0006c5e0 0x7f0c001437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.570+0000 7f0c06dc1700 1 --2- 172.21.15.38:0/2049556331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c00140680 0x7f0c0013efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.570+0000 7f0c06dc1700 1 -- 172.21.15.38:0/2049556331 >> 172.21.15.38:0/2049556331 conn(0x7f0c000bc880 msgr2=0x7f0c000ba660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.572+0000 7f0c06dc1700 1 -- 172.21.15.38:0/2049556331 shutdown_connections 2023-07-11T00:24:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:43.573+0000 7f0c06dc1700 1 -- 172.21.15.38:0/2049556331 wait complete. 2023-07-11T00:24:43.614 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-11T00:24:44.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.031+0000 7f642e68a700 1 Processor -- start 2023-07-11T00:24:44.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.031+0000 7f642e68a700 1 -- start start 2023-07-11T00:24:44.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.032+0000 7f642e68a700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64280b8f00 0x7f64280b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:44.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.032+0000 7f642e68a700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6428089730 0x7f6428089b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:44.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.032+0000 7f642e68a700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64280b8690 con 0x7f64280b4830 2023-07-11T00:24:44.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.032+0000 7f642e68a700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64280b52f0 con 0x7f6428089730 2023-07-11T00:24:44.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.032+0000 7f642e68a700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642808a0d0 con 0x7f64280b8f00 2023-07-11T00:24:44.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.033+0000 7f64277fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64280b8f00 0x7f64280b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:44.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.033+0000 7f64277fe700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64280b8f00 0x7f64280b9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:58354/0 (socket says 172.21.15.38:58354) 2023-07-11T00:24:44.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.033+0000 7f64277fe700 1 -- 172.21.15.38:0/1113758151 learned_addr learned my addr 172.21.15.38:0/1113758151 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:24:44.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.037+0000 7f642cc27700 1 --2- 172.21.15.38:0/1113758151 >> v2:172.21.15.70:3300/0 conn(0x7f6428089730 0x7f6428089b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:44.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.041+0000 7f64277fe700 1 -- 172.21.15.38:0/1113758151 >> v2:172.21.15.70:3300/0 conn(0x7f6428089730 msgr2=0x7f6428089b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-11T00:24:44.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.041+0000 7f64277fe700 1 --2- 172.21.15.38:0/1113758151 >> v2:172.21.15.70:3300/0 conn(0x7f6428089730 0x7f6428089b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:44.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.041+0000 7f64277fe700 1 -- 172.21.15.38:0/1113758151 >> v1:172.21.15.70:6789/0 conn(0x7f64280b4830 legacy=0x7f64280b6370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-11T00:24:44.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.041+0000 7f64277fe700 1 -- 172.21.15.38:0/1113758151 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64280b5fc0 con 0x7f64280b8f00 2023-07-11T00:24:44.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.057+0000 7f64277fe700 1 --2- 172.21.15.38:0/1113758151 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64280b8f00 0x7f64280b9350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6418006fd0 tx=0x7f6418007bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1154d5776bf9929 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:44.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.077+0000 7f6426ffd700 1 -- 172.21.15.38:0/1113758151 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800f070 con 0x7f64280b8f00 2023-07-11T00:24:44.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.077+0000 7f6426ffd700 1 -- 172.21.15.38:0/1113758151 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6418005c30 con 0x7f64280b8f00 2023-07-11T00:24:44.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.077+0000 7f6426ffd700 1 -- 172.21.15.38:0/1113758151 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800c660 con 0x7f64280b8f00 2023-07-11T00:24:44.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.078+0000 7f642e68a700 1 -- 172.21.15.38:0/1113758151 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64280b8f00 msgr2=0x7f64280b9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:44.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.078+0000 7f642e68a700 1 --2- 172.21.15.38:0/1113758151 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64280b8f00 0x7f64280b9350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6418006fd0 tx=0x7f6418007bc0 comp rx=0 tx=0).stop 2023-07-11T00:24:44.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.083+0000 7f642e68a700 1 -- 172.21.15.38:0/1113758151 shutdown_connections 2023-07-11T00:24:44.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.083+0000 7f642e68a700 1 --2- 172.21.15.38:0/1113758151 >> v2:172.21.15.70:3300/0 conn(0x7f6428089730 0x7f6428089b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:44.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.083+0000 7f642e68a700 1 --2- 172.21.15.38:0/1113758151 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64280b8f00 0x7f64280b9350 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6418006fd0 tx=0x7f6418007bc0 comp rx=0 tx=0).stop 2023-07-11T00:24:44.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.083+0000 7f642e68a700 1 -- 172.21.15.38:0/1113758151 >> 172.21.15.38:0/1113758151 conn(0x7f6428069f30 msgr2=0x7f642806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:44.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.094+0000 7f642e68a700 1 -- 172.21.15.38:0/1113758151 shutdown_connections 2023-07-11T00:24:44.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.100+0000 7f642e68a700 1 -- 172.21.15.38:0/1113758151 wait complete. 2023-07-11T00:24:44.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.102+0000 7f642e68a700 1 Processor -- start 2023-07-11T00:24:44.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.105+0000 7f642e68a700 1 -- start start 2023-07-11T00:24:44.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.106+0000 7f642e68a700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6428089730 0x7f6428084a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:44.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.106+0000 7f642e68a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64280b4830 0x7f642815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:44.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.106+0000 7f642e68a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f642815b190 0x7f64281f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:44.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.106+0000 7f642e68a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6428084f70 con 0x7f642815b190 2023-07-11T00:24:44.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.106+0000 7f642e68a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642815b610 con 0x7f64280b4830 2023-07-11T00:24:44.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.106+0000 7f642e68a700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6428088380 con 0x7f6428089730 2023-07-11T00:24:44.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.107+0000 7f642cc27700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f642815b190 0x7f64281f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:44.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.107+0000 7f642cc27700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f642815b190 0x7f64281f1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42468/0 (socket says 172.21.15.38:42468) 2023-07-11T00:24:44.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.107+0000 7f642cc27700 1 -- 172.21.15.38:0/476829263 learned_addr learned my addr 172.21.15.38:0/476829263 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:24:44.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.107+0000 7f64277fe700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64280b4830 0x7f642815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:44.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.107+0000 7f642cc27700 1 -- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6428089730 msgr2=0x7f6428084a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:44.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.107+0000 7f642cc27700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6428089730 0x7f6428084a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:44.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.107+0000 7f642cc27700 1 -- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64280b4830 msgr2=0x7f642815ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:44.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.107+0000 7f642cc27700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64280b4830 0x7f642815ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.107+0000 7f642cc27700 1 -- 172.21.15.38:0/476829263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6418007570 con 0x7f642815b190 2023-07-11T00:24:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.108+0000 7f642cc27700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f642815b190 0x7f64281f1c20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6420007e70 tx=0x7f642000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.110+0000 7f6424ff9700 1 -- 172.21.15.38:0/476829263 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642000ee50 con 0x7f642815b190 2023-07-11T00:24:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.110+0000 7f6424ff9700 1 -- 172.21.15.38:0/476829263 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6420013560 con 0x7f642815b190 2023-07-11T00:24:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.110+0000 7f6424ff9700 1 -- 172.21.15.38:0/476829263 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420013910 con 0x7f642815b190 2023-07-11T00:24:44.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.110+0000 7f642e68a700 1 -- 172.21.15.38:0/476829263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64281e0730 con 0x7f642815b190 2023-07-11T00:24:44.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.110+0000 7f642e68a700 1 -- 172.21.15.38:0/476829263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6428085540 con 0x7f642815b190 2023-07-11T00:24:44.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.114+0000 7f6424ff9700 1 -- 172.21.15.38:0/476829263 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6420013a70 con 0x7f642815b190 2023-07-11T00:24:44.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.114+0000 7f6424ff9700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f641406adb0 0x7f641406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:44.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.115+0000 7f6424ff9700 1 -- 172.21.15.38:0/476829263 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f642008d7b0 con 0x7f642815b190 2023-07-11T00:24:44.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.115+0000 7f642e68a700 1 -- 172.21.15.38:0/476829263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6428074360 con 0x7f642815b190 2023-07-11T00:24:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.122+0000 7f6427fff700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f641406adb0 0x7f641406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.123+0000 7f6424ff9700 1 -- 172.21.15.38:0/476829263 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6420058850 con 0x7f642815b190 2023-07-11T00:24:44.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.156+0000 7f6427fff700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f641406adb0 0x7f641406d260 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f641c0096d0 tx=0x7f641c006c30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:44.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.525+0000 7f642e68a700 1 -- 172.21.15.38:0/476829263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64280b8b90 con 0x7f642815b190 2023-07-11T00:24:44.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.530+0000 7f6424ff9700 1 -- 172.21.15.38:0/476829263 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f642005be70 con 0x7f642815b190 2023-07-11T00:24:44.553 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-07-11T00:24:44.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.584+0000 7f642e68a700 1 -- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f641406adb0 msgr2=0x7f641406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:44.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.584+0000 7f642e68a700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f641406adb0 0x7f641406d260 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f641c0096d0 tx=0x7f641c006c30 comp rx=0 tx=0).stop 2023-07-11T00:24:44.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.584+0000 7f642e68a700 1 -- 172.21.15.38:0/476829263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f642815b190 msgr2=0x7f64281f1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:44.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.584+0000 7f642e68a700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f642815b190 0x7f64281f1c20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6420007e70 tx=0x7f642000e3c0 comp rx=0 tx=0).stop 2023-07-11T00:24:44.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.591+0000 7f642e68a700 1 -- 172.21.15.38:0/476829263 shutdown_connections 2023-07-11T00:24:44.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.591+0000 7f642e68a700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f641406adb0 0x7f641406d260 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:44.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.591+0000 7f642e68a700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f642815b190 0x7f64281f1c20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:44.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.591+0000 7f642e68a700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6428089730 0x7f6428084a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:44.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.591+0000 7f642e68a700 1 --2- 172.21.15.38:0/476829263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64280b4830 0x7f642815ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:44.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.591+0000 7f642e68a700 1 -- 172.21.15.38:0/476829263 >> 172.21.15.38:0/476829263 conn(0x7f6428069f30 msgr2=0x7f6428154a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:44.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.596+0000 7f642e68a700 1 -- 172.21.15.38:0/476829263 shutdown_connections 2023-07-11T00:24:44.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:44.596+0000 7f642e68a700 1 -- 172.21.15.38:0/476829263 wait complete. 2023-07-11T00:24:44.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-11T00:24:45.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.039+0000 7f30dfb9c700 1 Processor -- start 2023-07-11T00:24:45.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.043+0000 7f30dfb9c700 1 -- start start 2023-07-11T00:24:45.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.044+0000 7f30dfb9c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f30d80b3ad0 0x7f30d814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.044+0000 7f30dfb9c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f30d80b4670 0x7f30d80b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.044+0000 7f30dfb9c700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f30d8148950 0x7f30d8148db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.044+0000 7f30dfb9c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d81492f0 con 0x7f30d80b3ad0 2023-07-11T00:24:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.044+0000 7f30dfb9c700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d81521a0 con 0x7f30d8148950 2023-07-11T00:24:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.044+0000 7f30dfb9c700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d8152480 con 0x7f30d80b4670 2023-07-11T00:24:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.044+0000 7f30de139700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f30d8148950 0x7f30d8148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.044+0000 7f30de139700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f30d8148950 0x7f30d8148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.38:42108/0 (socket says 172.21.15.38:42108) 2023-07-11T00:24:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.044+0000 7f30de139700 1 -- 172.21.15.38:0/1425823354 learned_addr learned my addr 172.21.15.38:0/1425823354 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:24:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.045+0000 7f30de139700 1 -- 172.21.15.38:0/1425823354 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f30d80b4670 msgr2=0x7f30d80b4ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:24:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.045+0000 7f30de139700 1 --2- 172.21.15.38:0/1425823354 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f30d80b4670 0x7f30d80b4ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.045+0000 7f30de139700 1 -- 172.21.15.38:0/1425823354 >> v2:172.21.15.38:3300/0 conn(0x7f30d80b3ad0 msgr2=0x7f30d814eb50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:24:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.045+0000 7f30de139700 1 --2- 172.21.15.38:0/1425823354 >> v2:172.21.15.38:3300/0 conn(0x7f30d80b3ad0 0x7f30d814eb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.045+0000 7f30de139700 1 -- 172.21.15.38:0/1425823354 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d8152760 con 0x7f30d8148950 2023-07-11T00:24:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.045+0000 7f30de139700 1 --2- 172.21.15.38:0/1425823354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d8148950 0x7f30d8148db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f30d80727a0 tx=0x7f30d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ddc9a49e4bad473 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:45.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.045+0000 7f30dc936700 1 -- 172.21.15.38:0/1425823354 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000e070 con 0x7f30d8148950 2023-07-11T00:24:45.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.046+0000 7f30dc936700 1 -- 172.21.15.38:0/1425823354 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d000b9c0 con 0x7f30d8148950 2023-07-11T00:24:45.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.046+0000 7f30dc936700 1 -- 172.21.15.38:0/1425823354 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000bd70 con 0x7f30d8148950 2023-07-11T00:24:45.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.059+0000 7f30dfb9c700 1 -- 172.21.15.38:0/1425823354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d8148950 msgr2=0x7f30d8148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:45.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.059+0000 7f30dfb9c700 1 --2- 172.21.15.38:0/1425823354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d8148950 0x7f30d8148db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f30d80727a0 tx=0x7f30d000b330 comp rx=0 tx=0).stop 2023-07-11T00:24:45.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.066+0000 7f30dfb9c700 1 -- 172.21.15.38:0/1425823354 shutdown_connections 2023-07-11T00:24:45.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.066+0000 7f30dfb9c700 1 --2- 172.21.15.38:0/1425823354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d8148950 0x7f30d8148db0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.066+0000 7f30dfb9c700 1 --2- 172.21.15.38:0/1425823354 >> v2:172.21.15.38:3300/0 conn(0x7f30d80b3ad0 0x7f30d814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.066+0000 7f30dfb9c700 1 --2- 172.21.15.38:0/1425823354 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f30d80b4670 0x7f30d80b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.066+0000 7f30dfb9c700 1 -- 172.21.15.38:0/1425823354 >> 172.21.15.38:0/1425823354 conn(0x7f30d8069f30 msgr2=0x7f30d806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:45.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.090+0000 7f30dfb9c700 1 -- 172.21.15.38:0/1425823354 shutdown_connections 2023-07-11T00:24:45.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.091+0000 7f30dfb9c700 1 -- 172.21.15.38:0/1425823354 wait complete. 2023-07-11T00:24:45.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.092+0000 7f30dfb9c700 1 Processor -- start 2023-07-11T00:24:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.092+0000 7f30dfb9c700 1 -- start start 2023-07-11T00:24:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.093+0000 7f30dfb9c700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f30d80b3ad0 0x7f30d814fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.093+0000 7f30dfb9c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30d80b4670 0x7f30d814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.093+0000 7f30dfb9c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d8148950 0x7f30d8150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.093+0000 7f30dfb9c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d81322a0 con 0x7f30d80b4670 2023-07-11T00:24:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.093+0000 7f30dfb9c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d8150210 con 0x7f30d8148950 2023-07-11T00:24:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.093+0000 7f30dfb9c700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d814d740 con 0x7f30d80b3ad0 2023-07-11T00:24:45.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.098+0000 7f30dd137700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30d80b4670 0x7f30d814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.098+0000 7f30dd137700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30d80b4670 0x7f30d814d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42482/0 (socket says 172.21.15.38:42482) 2023-07-11T00:24:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.098+0000 7f30dd137700 1 -- 172.21.15.38:0/984176920 learned_addr learned my addr 172.21.15.38:0/984176920 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:24:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.098+0000 7f30dd137700 1 -- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f30d80b3ad0 msgr2=0x7f30d814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.098+0000 7f30dd137700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f30d80b3ad0 0x7f30d814fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.098+0000 7f30dd137700 1 -- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d8148950 msgr2=0x7f30d8150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.098+0000 7f30dd137700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d8148950 0x7f30d8150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.098+0000 7f30dd137700 1 -- 172.21.15.38:0/984176920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d0009b30 con 0x7f30d80b4670 2023-07-11T00:24:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.099+0000 7f30dd137700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30d80b4670 0x7f30d814d200 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f30d400b550 tx=0x7f30d400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.099+0000 7f30ce7fc700 1 -- 172.21.15.38:0/984176920 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4011830 con 0x7f30d80b4670 2023-07-11T00:24:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.099+0000 7f30ce7fc700 1 -- 172.21.15.38:0/984176920 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d40119b0 con 0x7f30d80b4670 2023-07-11T00:24:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.099+0000 7f30ce7fc700 1 -- 172.21.15.38:0/984176920 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4011d60 con 0x7f30d80b4670 2023-07-11T00:24:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.100+0000 7f30dfb9c700 1 -- 172.21.15.38:0/984176920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d81429c0 con 0x7f30d80b4670 2023-07-11T00:24:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.100+0000 7f30dfb9c700 1 -- 172.21.15.38:0/984176920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d814d9c0 con 0x7f30d80b4670 2023-07-11T00:24:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.102+0000 7f30dfb9c700 1 -- 172.21.15.38:0/984176920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d813a980 con 0x7f30d80b4670 2023-07-11T00:24:45.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.117+0000 7f30ce7fc700 1 -- 172.21.15.38:0/984176920 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30d401a400 con 0x7f30d80b4670 2023-07-11T00:24:45.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.117+0000 7f30ce7fc700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f30bc06ace0 0x7f30bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.118+0000 7f30ce7fc700 1 -- 172.21.15.38:0/984176920 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f30d40899c0 con 0x7f30d80b4670 2023-07-11T00:24:45.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.118+0000 7f30dd938700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f30bc06ace0 0x7f30bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:45.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.119+0000 7f30dd938700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f30bc06ace0 0x7f30bc06d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f30c8009770 tx=0x7f30c8006cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:45.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.132+0000 7f30ce7fc700 1 -- 172.21.15.38:0/984176920 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f30d40549d0 con 0x7f30d80b4670 2023-07-11T00:24:45.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.495+0000 7f30dfb9c700 1 -- 172.21.15.38:0/984176920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30d814e350 con 0x7f30d80b4670 2023-07-11T00:24:45.506 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-07-11T00:24:45.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.496+0000 7f30ce7fc700 1 -- 172.21.15.38:0/984176920 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30d814e350 con 0x7f30d80b4670 2023-07-11T00:24:45.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 -- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f30bc06ace0 msgr2=0x7f30bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:45.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f30bc06ace0 0x7f30bc06d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f30c8009770 tx=0x7f30c8006cd0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 -- 172.21.15.38:0/984176920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30d80b4670 msgr2=0x7f30d814d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:45.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30d80b4670 0x7f30d814d200 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f30d400b550 tx=0x7f30d400b910 comp rx=0 tx=0).stop 2023-07-11T00:24:45.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 -- 172.21.15.38:0/984176920 shutdown_connections 2023-07-11T00:24:45.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7f30bc06ace0 0x7f30bc06d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d8148950 0x7f30d8150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f30d80b3ad0 0x7f30d814fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 --2- 172.21.15.38:0/984176920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30d80b4670 0x7f30d814d200 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 -- 172.21.15.38:0/984176920 >> 172.21.15.38:0/984176920 conn(0x7f30d8069f30 msgr2=0x7f30d8142e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:45.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 -- 172.21.15.38:0/984176920 shutdown_connections 2023-07-11T00:24:45.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.499+0000 7f30dfb9c700 1 -- 172.21.15.38:0/984176920 wait complete. 2023-07-11T00:24:45.536 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-11T00:24:45.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.777+0000 7fbb961cc700 1 Processor -- start 2023-07-11T00:24:45.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.778+0000 7fbb961cc700 1 -- start start 2023-07-11T00:24:45.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.779+0000 7fbb961cc700 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbb90147460 0x7fbb900b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.779+0000 7fbb961cc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb9014ab60 0x7fbb9014afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.779+0000 7fbb961cc700 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb901482e0 con 0x7fbb900b8160 2023-07-11T00:24:45.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.779+0000 7fbb961cc700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9006e4f0 con 0x7fbb9014ab60 2023-07-11T00:24:45.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.779+0000 7fbb961cc700 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9014b4e0 con 0x7fbb90147460 2023-07-11T00:24:45.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.780+0000 7fbb8ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb9014ab60 0x7fbb9014afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:45.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.780+0000 7fbb8ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb9014ab60 0x7fbb9014afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42492/0 (socket says 172.21.15.38:42492) 2023-07-11T00:24:45.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.780+0000 7fbb8ffff700 1 -- 172.21.15.38:0/2298679388 learned_addr learned my addr 172.21.15.38:0/2298679388 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:24:45.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.780+0000 7fbb8ffff700 1 -- 172.21.15.38:0/2298679388 >> v2:172.21.15.70:3300/0 conn(0x7fbb90147460 msgr2=0x7fbb900b5c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-11T00:24:45.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.780+0000 7fbb8ffff700 1 --2- 172.21.15.38:0/2298679388 >> v2:172.21.15.70:3300/0 conn(0x7fbb90147460 0x7fbb900b5c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.780+0000 7fbb8ffff700 1 -- 172.21.15.38:0/2298679388 >> v1:172.21.15.70:6789/0 conn(0x7fbb900b8160 legacy=0x7fbb90141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:45.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.780+0000 7fbb8ffff700 1 -- 172.21.15.38:0/2298679388 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb901479b0 con 0x7fbb9014ab60 2023-07-11T00:24:45.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.780+0000 7fbb8ffff700 1 --2- 172.21.15.38:0/2298679388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb9014ab60 0x7fbb9014afa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbb90145070 tx=0x7fbb8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3aa28fa022a8bbf server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:45.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.788+0000 7fbb8e7fc700 1 -- 172.21.15.38:0/2298679388 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8800e070 con 0x7fbb9014ab60 2023-07-11T00:24:45.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.788+0000 7fbb8e7fc700 1 -- 172.21.15.38:0/2298679388 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88003a20 con 0x7fbb9014ab60 2023-07-11T00:24:45.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.788+0000 7fbb8e7fc700 1 -- 172.21.15.38:0/2298679388 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88003dd0 con 0x7fbb9014ab60 2023-07-11T00:24:45.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.791+0000 7fbb961cc700 1 -- 172.21.15.38:0/2298679388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb9014ab60 msgr2=0x7fbb9014afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:45.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.791+0000 7fbb961cc700 1 --2- 172.21.15.38:0/2298679388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb9014ab60 0x7fbb9014afa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbb90145070 tx=0x7fbb8800b330 comp rx=0 tx=0).stop 2023-07-11T00:24:45.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.795+0000 7fbb961cc700 1 -- 172.21.15.38:0/2298679388 shutdown_connections 2023-07-11T00:24:45.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.795+0000 7fbb961cc700 1 --2- 172.21.15.38:0/2298679388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb9014ab60 0x7fbb9014afa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.795+0000 7fbb961cc700 1 --2- 172.21.15.38:0/2298679388 >> v2:172.21.15.70:3300/0 conn(0x7fbb90147460 0x7fbb900b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.795+0000 7fbb961cc700 1 -- 172.21.15.38:0/2298679388 >> 172.21.15.38:0/2298679388 conn(0x7fbb90069f30 msgr2=0x7fbb9006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:45.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.796+0000 7fbb961cc700 1 -- 172.21.15.38:0/2298679388 shutdown_connections 2023-07-11T00:24:45.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.796+0000 7fbb961cc700 1 -- 172.21.15.38:0/2298679388 wait complete. 2023-07-11T00:24:45.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.798+0000 7fbb961cc700 1 Processor -- start 2023-07-11T00:24:45.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.798+0000 7fbb961cc700 1 -- start start 2023-07-11T00:24:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.799+0000 7fbb961cc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb900b8160 0x7fbb9013a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.799+0000 7fbb961cc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb90147460 0x7fbb9006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.799+0000 7fbb961cc700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb9014ab60 0x7fbb90070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.799+0000 7fbb961cc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9013a5d0 con 0x7fbb900b8160 2023-07-11T00:24:45.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.799+0000 7fbb961cc700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9006f690 con 0x7fbb90147460 2023-07-11T00:24:45.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.799+0000 7fbb961cc700 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9013c8d0 con 0x7fbb9014ab60 2023-07-11T00:24:45.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.800+0000 7fbb8ffff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb9014ab60 0x7fbb90070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:45.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.800+0000 7fbb8effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb90147460 0x7fbb9006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:45.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.800+0000 7fbb8ffff700 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb9014ab60 0x7fbb90070060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.38:58386/0 (socket says 172.21.15.38:58386) 2023-07-11T00:24:45.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.800+0000 7fbb8ffff700 1 -- 172.21.15.38:0/2847575847 learned_addr learned my addr 172.21.15.38:0/2847575847 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-07-11T00:24:45.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.800+0000 7fbb8effd700 1 -- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb9014ab60 msgr2=0x7fbb90070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:45.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.800+0000 7fbb8effd700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb9014ab60 0x7fbb90070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.800+0000 7fbb8effd700 1 -- 172.21.15.38:0/2847575847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb900b8160 msgr2=0x7fbb9013a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:45.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.800+0000 7fbb8effd700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb900b8160 0x7fbb9013a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:45.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.800+0000 7fbb8effd700 1 -- 172.21.15.38:0/2847575847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb88009b30 con 0x7fbb90147460 2023-07-11T00:24:45.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.801+0000 7fbb8effd700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb90147460 0x7fbb9006fb20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006fd0 tx=0x7fbb8000b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:45.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.801+0000 7fbb7ffff700 1 -- 172.21.15.38:0/2847575847 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80011830 con 0x7fbb90147460 2023-07-11T00:24:45.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.801+0000 7fbb7ffff700 1 -- 172.21.15.38:0/2847575847 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb800119b0 con 0x7fbb90147460 2023-07-11T00:24:45.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.801+0000 7fbb7ffff700 1 -- 172.21.15.38:0/2847575847 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80011d60 con 0x7fbb90147460 2023-07-11T00:24:45.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.802+0000 7fbb961cc700 1 -- 172.21.15.38:0/2847575847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9013cbb0 con 0x7fbb90147460 2023-07-11T00:24:45.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.802+0000 7fbb961cc700 1 -- 172.21.15.38:0/2847575847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9013c5a0 con 0x7fbb90147460 2023-07-11T00:24:45.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.805+0000 7fbb7ffff700 1 -- 172.21.15.38:0/2847575847 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb8001a400 con 0x7fbb90147460 2023-07-11T00:24:45.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.805+0000 7fbb7ffff700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbb7406acb0 0x7fbb7406d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-11T00:24:45.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.805+0000 7fbb7ffff700 1 -- 172.21.15.38:0/2847575847 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fbb800891c0 con 0x7fbb90147460 2023-07-11T00:24:45.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.806+0000 7fbb961cc700 1 -- 172.21.15.38:0/2847575847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb90074360 con 0x7fbb90147460 2023-07-11T00:24:45.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.809+0000 7fbb8f7fe700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbb7406acb0 0x7fbb7406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.816+0000 7fbb8f7fe700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbb7406acb0 0x7fbb7406d160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbb840017a0 tx=0x7fbb84007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-11T00:24:45.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:45.829+0000 7fbb7ffff700 1 -- 172.21.15.38:0/2847575847 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbb800541e0 con 0x7fbb90147460 2023-07-11T00:24:46.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.224+0000 7fbb961cc700 1 -- 172.21.15.38:0/2847575847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb900664c0 con 0x7fbb90147460 2023-07-11T00:24:46.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.241+0000 7fbb7ffff700 1 -- 172.21.15.38:0/2847575847 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v34) v1 ==== 80+0+122 (secure 0 0 0) 0x7fbb80015030 con 0x7fbb90147460 2023-07-11T00:24:46.252 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6834/2519374117 2023-07-12T00:19:43.065054+0000 2023-07-11T00:24:46.252 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6832/2519374117 2023-07-12T00:19:43.065054+0000 2023-07-11T00:24:46.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.252+0000 7fbb961cc700 1 -- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbb7406acb0 msgr2=0x7fbb7406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:46.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.252+0000 7fbb961cc700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbb7406acb0 0x7fbb7406d160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbb840017a0 tx=0x7fbb84007a40 comp rx=0 tx=0).stop 2023-07-11T00:24:46.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.252+0000 7fbb961cc700 1 -- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb90147460 msgr2=0x7fbb9006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-11T00:24:46.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.252+0000 7fbb961cc700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb90147460 0x7fbb9006fb20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006fd0 tx=0x7fbb8000b730 comp rx=0 tx=0).stop 2023-07-11T00:24:46.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.254+0000 7fbb961cc700 1 -- 172.21.15.38:0/2847575847 shutdown_connections 2023-07-11T00:24:46.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.254+0000 7fbb961cc700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:6832/2073477499,v1:172.21.15.70:6833/2073477499] conn(0x7fbb7406acb0 0x7fbb7406d160 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:46.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.254+0000 7fbb961cc700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb9014ab60 0x7fbb90070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:46.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.254+0000 7fbb961cc700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb900b8160 0x7fbb9013a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:46.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.254+0000 7fbb961cc700 1 --2- 172.21.15.38:0/2847575847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb90147460 0x7fbb9006fb20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-11T00:24:46.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.254+0000 7fbb961cc700 1 -- 172.21.15.38:0/2847575847 >> 172.21.15.38:0/2847575847 conn(0x7fbb90069f30 msgr2=0x7fbb9013afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-11T00:24:46.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.257+0000 7fbb961cc700 1 -- 172.21.15.38:0/2847575847 shutdown_connections 2023-07-11T00:24:46.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-07-11T00:24:46.257+0000 7fbb961cc700 1 -- 172.21.15.38:0/2847575847 wait complete. 2023-07-11T00:24:46.271 INFO:teuthology.orchestra.run.smithi038.stderr:listed 2 entries 2023-07-11T00:24:46.295 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-11T00:24:46.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:24:46.296 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-11T00:24:46.393 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-07-11T00:24:46.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-11T00:24:46.393 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-11T00:24:47.959 INFO:tasks.ceph.osd.0:Sent signal 15 2023-07-11T00:24:47.961 INFO:tasks.ceph.osd.1:Sent signal 15 2023-07-11T00:24:47.961 INFO:tasks.ceph.osd.2:Sent signal 15 2023-07-11T00:24:47.962 INFO:tasks.ceph.osd.3:Sent signal 15 2023-07-11T00:24:47.962 INFO:tasks.ceph.osd.4:Sent signal 15 2023-07-11T00:24:47.963 INFO:tasks.ceph.osd.5:Sent signal 15 2023-07-11T00:24:47.964 INFO:tasks.ceph.osd.6:Sent signal 15 2023-07-11T00:24:47.964 INFO:tasks.ceph.osd.7:Sent signal 15 2023-07-11T00:24:47.965 INFO:tasks.ceph.mds.a:Sent signal 15 2023-07-11T00:24:47.965 INFO:tasks.ceph.mds.b:Sent signal 15 2023-07-11T00:24:47.966 INFO:tasks.ceph.mon.a:Sent signal 15 2023-07-11T00:24:47.967 INFO:tasks.ceph.mon.b:Sent signal 15 2023-07-11T00:24:47.967 INFO:tasks.ceph.mon.c:Sent signal 15 2023-07-11T00:24:47.969 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-07-11T00:24:47.969 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-07-11T00:24:47.971 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-07-11T00:24:47.961+0000 7f1ca1c0d700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 117563) UID: 0 2023-07-11T00:24:47.971 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-07-11T00:24:47.961+0000 7f1ca1c0d700 -1 osd.4 34 *** Got signal Terminated *** 2023-07-11T00:24:47.971 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-07-11T00:24:47.961+0000 7f1ca1c0d700 -1 osd.4 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:24:47.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-07-11T00:24:47.959+0000 7f403eb4e700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 117434) UID: 0 2023-07-11T00:24:47.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-07-11T00:24:47.959+0000 7f403eb4e700 -1 osd.1 34 *** Got signal Terminated *** 2023-07-11T00:24:47.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-07-11T00:24:47.959+0000 7f403eb4e700 -1 osd.1 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:24:47.973 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-07-11T00:24:47.963+0000 7f13dab9a700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 117435) UID: 0 2023-07-11T00:24:47.973 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-07-11T00:24:47.963+0000 7f13dab9a700 -1 osd.2 34 *** Got signal Terminated *** 2023-07-11T00:24:47.974 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-07-11T00:24:47.963+0000 7f13dab9a700 -1 osd.2 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:24:47.974 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-07-11T00:24:47.959+0000 7f854ac6e700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 117417) UID: 0 2023-07-11T00:24:47.974 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-07-11T00:24:47.959+0000 7f854ac6e700 -1 osd.0 34 *** Got signal Terminated *** 2023-07-11T00:24:47.974 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-07-11T00:24:47.959+0000 7f854ac6e700 -1 osd.0 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:24:47.975 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-07-11T00:24:47.968+0000 7efc6644b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 117436) UID: 0 2023-07-11T00:24:47.975 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-07-11T00:24:47.968+0000 7efc6644b700 -1 osd.3 34 *** Got signal Terminated *** 2023-07-11T00:24:47.975 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-07-11T00:24:47.968+0000 7efc6644b700 -1 osd.3 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:24:47.975 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-07-11T00:24:47.968+0000 7f0ef5404700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 128911) UID: 0 2023-07-11T00:24:47.976 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-07-11T00:24:47.968+0000 7f0ef5404700 -1 mds.a *** got signal Terminated *** 2023-07-11T00:24:47.976 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-07-11T00:24:47.968+0000 7f86998f2700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 117050) UID: 0 2023-07-11T00:24:47.977 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-07-11T00:24:47.968+0000 7f86998f2700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-11T00:24:47.979 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-07-11T00:24:47.972+0000 7fc8fbee6700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 117566) UID: 0 2023-07-11T00:24:47.979 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-07-11T00:24:47.972+0000 7fc8fbee6700 -1 osd.5 34 *** Got signal Terminated *** 2023-07-11T00:24:47.979 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-07-11T00:24:47.972+0000 7fc8fbee6700 -1 osd.5 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:24:47.980 INFO:tasks.ceph.mds.b.smithi070.stderr:2023-07-11T00:24:47.974+0000 7f32f2662700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 123046) UID: 0 2023-07-11T00:24:47.981 INFO:tasks.ceph.mds.b.smithi070.stderr:2023-07-11T00:24:47.974+0000 7f32f2662700 -1 mds.b *** got signal Terminated *** 2023-07-11T00:24:47.981 INFO:tasks.ceph.mon.c.smithi070.stderr:2023-07-11T00:24:47.975+0000 7fb52fc4b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 116844) UID: 0 2023-07-11T00:24:47.982 INFO:tasks.ceph.mon.c.smithi070.stderr:2023-07-11T00:24:47.975+0000 7fb52fc4b700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-07-11T00:24:47.982 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-07-11T00:24:47.976+0000 7f90a255f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 117568) UID: 0 2023-07-11T00:24:47.983 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-07-11T00:24:47.976+0000 7f90a255f700 -1 osd.6 34 *** Got signal Terminated *** 2023-07-11T00:24:47.983 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-07-11T00:24:47.976+0000 7f90a255f700 -1 osd.6 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:24:47.984 INFO:tasks.ceph.mon.b.smithi070.stderr:2023-07-11T00:24:47.977+0000 7f471babd700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 116842) UID: 0 2023-07-11T00:24:47.984 INFO:tasks.ceph.mon.b.smithi070.stderr:2023-07-11T00:24:47.977+0000 7f471babd700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-07-11T00:24:47.991 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-07-11T00:24:47.975+0000 7f817724e700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 117571) UID: 0 2023-07-11T00:24:47.992 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-07-11T00:24:47.975+0000 7f817724e700 -1 osd.7 34 *** Got signal Terminated *** 2023-07-11T00:24:47.992 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-07-11T00:24:47.975+0000 7f817724e700 -1 osd.7 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-11T00:24:48.174 INFO:tasks.ceph.mgr.y.smithi038.stderr:daemon-helper: command crashed with signal 15 2023-07-11T00:25:02.213 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:25:02.216 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:25:02.222 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:25:32.391 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:25:32.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:25:32.401 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:26:02.524 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:26:02.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:26:02.531 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:26:32.687 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:26:32.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:26:32.693 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:27:02.827 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:27:02.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:27:02.833 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:27:32.955 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:27:32.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:27:32.961 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:28:03.099 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:28:03.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:28:03.105 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:28:33.242 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:28:33.245 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:28:33.247 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:03.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:03.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:03.438 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:33.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:33.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:29:33.578 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:30:03.752 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:30:03.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:30:03.758 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:30:34.041 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:30:34.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:30:34.052 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:31:04.236 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:31:04.240 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:31:04.242 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:31:34.441 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:31:34.444 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:31:34.446 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:32:04.629 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:32:04.633 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:32:04.635 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:32:34.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:32:34.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:32:34.789 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:33:04.911 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:33:04.914 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:33:04.916 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:33:35.035 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:33:35.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:33:35.042 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:34:05.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:34:05.162 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:34:05.166 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:34:35.338 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:34:35.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:34:35.344 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:35:05.495 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:35:05.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:35:05.500 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:35:35.681 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:35:35.685 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:35:35.688 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:36:06.078 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:36:06.081 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:36:06.084 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:36:36.258 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:36:36.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:36:36.264 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:37:06.453 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:37:06.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:37:06.458 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:37:36.596 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:37:36.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:37:36.601 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:38:06.773 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:38:06.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:38:06.779 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:38:36.909 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:38:36.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:38:36.914 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:39:07.044 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:39:07.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:39:07.050 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:39:37.191 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:39:37.193 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:39:37.196 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:40:07.376 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:40:07.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:40:07.381 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:40:37.714 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:40:37.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:40:37.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:41:07.845 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:41:07.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:41:07.851 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:41:38.016 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:41:38.019 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:41:38.022 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:42:08.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:42:08.199 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:42:08.202 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:42:38.368 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:42:38.371 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:42:38.373 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:43:08.503 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:43:08.506 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:43:08.508 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:43:38.702 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:43:38.705 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:43:38.708 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:44:08.841 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:44:08.845 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:44:08.847 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:44:39.013 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:44:39.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:44:39.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:45:09.126 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:45:09.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:45:09.135 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:45:39.331 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:45:39.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:45:39.336 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:46:09.465 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:46:09.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:46:09.471 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:46:39.649 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:46:39.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:46:39.655 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:47:10.005 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:47:10.008 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:47:10.011 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:47:40.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:47:40.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:47:40.169 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:48:10.347 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:48:10.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:48:10.354 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:48:40.477 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:48:40.480 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:48:40.484 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:49:10.638 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:49:10.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:49:10.643 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:49:40.806 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:49:40.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:49:40.812 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:50:10.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:50:10.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:50:10.973 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:50:41.080 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:50:41.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:50:41.086 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:51:11.204 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:51:11.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:51:11.213 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:51:41.331 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:51:41.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:51:41.337 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:52:11.456 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:52:11.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:52:11.462 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:52:41.636 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:52:41.639 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:52:41.642 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:53:11.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:53:11.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:53:11.754 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:53:41.937 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:53:41.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:53:41.944 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:54:12.050 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:54:12.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:54:12.057 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:54:42.221 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:54:42.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:54:42.226 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:55:12.354 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:55:12.357 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:55:12.360 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:55:42.532 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:55:42.535 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:55:42.537 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:56:12.676 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:56:12.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:56:12.681 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:56:42.810 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:56:42.813 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:56:42.816 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:57:13.038 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:57:13.042 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:57:13.045 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:57:43.169 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:57:43.176 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:57:43.178 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:58:13.349 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:58:13.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:58:13.354 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:58:43.545 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:58:43.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:58:43.550 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:59:13.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:59:13.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:59:13.677 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:59:43.807 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:59:43.810 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T00:59:43.812 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:00:13.934 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:00:13.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:00:13.940 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:00:44.089 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:00:44.093 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:00:44.097 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:01:14.230 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:01:14.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:01:14.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:01:44.382 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:01:44.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:01:44.389 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:02:14.534 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:02:14.537 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:02:14.540 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:02:44.835 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:02:44.839 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:02:44.841 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:03:14.980 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:03:14.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:03:14.985 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:03:45.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:03:45.182 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:03:45.184 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:04:15.317 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:04:15.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:04:15.326 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:04:45.497 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:04:45.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:04:45.503 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:05:15.646 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:05:15.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:05:15.652 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:05:45.883 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:05:45.886 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:05:45.889 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:06:16.018 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:06:16.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:06:16.023 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:06:46.275 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:06:46.278 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:06:46.280 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:07:16.414 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:07:16.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:07:16.420 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:07:46.585 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:07:46.589 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:07:46.591 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:08:16.735 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:08:16.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:08:16.740 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:08:46.929 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:08:46.932 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:08:46.934 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:09:17.064 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:09:17.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:09:17.069 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:09:47.239 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:09:47.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:09:47.246 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:10:17.377 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:10:17.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:10:17.382 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:10:47.529 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:10:47.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:10:47.535 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:11:17.696 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:11:17.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:11:17.702 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:11:47.851 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:11:47.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:11:47.860 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:12:18.023 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:12:18.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:12:18.029 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:12:48.154 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:12:48.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:12:48.159 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:13:18.325 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:13:18.327 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:13:18.330 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:13:48.513 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:13:48.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:13:48.518 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:14:18.676 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:14:18.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:14:18.682 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:14:48.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:14:48.852 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:14:48.854 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:15:19.019 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:15:19.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:15:19.025 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:15:49.159 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:15:49.163 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:15:49.166 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:16:19.348 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:16:19.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:16:19.354 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:16:49.496 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:16:49.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:16:49.502 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:17:19.624 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:17:19.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:17:19.629 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:17:49.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:17:49.821 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:17:49.823 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:18:19.960 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:18:19.963 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:18:19.965 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:18:50.088 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:18:50.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:18:50.095 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:19:20.274 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:19:20.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:19:20.279 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:19:50.458 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:19:50.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:19:50.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:20:20.637 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:20:20.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:20:20.644 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:20:50.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:20:50.821 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:20:50.824 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:21:20.989 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:21:20.992 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:21:20.995 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:21:51.126 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:21:51.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:21:51.131 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:22:21.308 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:22:21.312 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:22:21.314 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:22:51.446 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:22:51.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:22:51.453 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:23:21.590 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:23:21.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:23:21.596 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:23:51.717 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:23:51.720 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:23:51.722 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:24:21.895 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:24:21.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:24:21.900 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:24:52.076 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:24:52.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:24:52.081 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:25:22.216 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:25:22.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:25:22.221 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:25:52.343 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:25:52.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:25:52.348 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:26:22.488 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:26:22.491 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:26:22.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:26:52.647 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:26:52.650 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:26:52.652 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:27:22.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:27:22.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:27:22.805 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:27:52.935 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:27:52.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:27:52.940 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:28:23.087 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:28:23.090 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:28:23.092 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:28:53.283 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:28:53.287 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:28:53.289 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:29:23.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:29:23.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:29:23.439 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:29:53.611 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:29:53.614 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:29:53.616 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:30:23.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:30:23.745 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:30:23.747 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:30:53.964 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:30:53.967 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:30:53.970 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:31:24.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:31:24.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:31:24.117 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:31:54.293 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:31:54.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:31:54.300 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:32:24.423 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:32:24.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:32:24.428 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:32:54.542 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:32:54.545 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:32:54.549 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:33:24.685 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:33:24.688 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:33:24.691 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:33:54.812 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:33:54.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:33:54.817 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:34:25.008 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:34:25.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:34:25.013 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:34:55.141 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:34:55.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:34:55.147 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:35:25.285 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:35:25.288 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:35:25.290 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:35:55.482 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:35:55.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:35:55.489 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:36:25.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:36:25.666 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:36:25.668 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:36:55.841 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:36:55.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:36:55.848 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:37:26.040 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:37:26.043 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:37:26.045 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:37:56.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:37:56.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:37:56.186 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:38:26.331 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:38:26.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:38:26.336 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:38:56.513 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:38:56.516 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:38:56.519 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:39:26.659 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:39:26.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:39:26.665 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:39:56.850 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:39:56.852 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:39:56.854 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:40:26.988 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:40:26.992 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:40:26.994 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:40:57.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:40:57.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:40:57.192 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:41:27.327 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:41:27.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:41:27.332 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:41:57.504 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:41:57.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:41:57.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:42:27.667 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:42:27.671 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:42:27.673 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:42:57.872 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:42:57.875 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:42:57.877 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:43:28.077 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:43:28.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:43:28.083 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:43:58.236 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:43:58.239 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:43:58.241 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:44:28.347 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:44:28.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:44:28.352 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:44:58.474 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:44:58.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:44:58.480 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:45:28.707 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:45:28.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:45:28.712 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:45:59.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:45:59.073 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:45:59.076 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:46:29.213 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:46:29.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:46:29.219 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:46:59.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:46:59.336 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:46:59.338 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:47:29.527 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:47:29.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:47:29.535 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:47:59.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:47:59.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:47:59.679 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:48:29.813 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:48:29.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:48:29.820 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:48:59.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:48:59.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:48:59.972 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:49:30.093 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:49:30.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:49:30.099 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:50:00.471 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:50:00.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:50:00.476 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:50:30.605 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:50:30.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:50:30.610 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:51:00.797 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:51:00.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:51:00.802 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:51:30.944 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:51:30.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:51:30.951 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:52:01.108 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:52:01.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:52:01.114 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:52:31.287 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:52:31.290 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:52:31.293 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:53:01.476 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:53:01.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:53:01.481 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:53:31.715 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:53:31.718 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:53:31.720 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:54:01.845 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:54:01.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:54:01.851 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:54:31.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:54:32.000 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:54:32.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:55:02.133 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:55:02.135 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:55:02.138 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:55:32.260 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:55:32.263 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:55:32.265 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:56:02.404 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:56:02.406 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:56:02.409 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:56:32.630 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:56:32.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:56:32.635 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:57:02.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:57:02.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:57:02.755 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:57:32.885 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:57:32.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:57:32.890 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:58:03.036 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:58:03.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:58:03.041 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:58:33.189 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:58:33.192 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:58:33.194 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:59:03.332 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:59:03.335 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:59:03.337 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:59:33.652 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:59:33.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T01:59:33.658 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:00:03.832 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:00:03.835 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:00:03.837 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:00:33.955 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:00:33.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:00:33.961 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:01:04.143 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:01:04.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:01:04.148 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:01:34.293 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:01:34.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:01:34.298 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:02:04.477 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:02:04.480 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:02:04.483 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:02:34.633 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:02:34.636 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:02:34.638 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:03:04.812 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:03:04.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:03:04.818 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:03:34.992 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:03:34.995 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:03:34.998 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:04:05.153 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:04:05.155 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:04:05.158 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:04:35.280 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:04:35.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:04:35.285 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:05:05.432 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:05:05.435 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:05:05.438 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:05:35.568 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:05:35.570 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:05:35.573 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:06:05.694 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:06:05.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:06:05.699 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:06:35.856 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:06:35.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:06:35.863 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:07:05.973 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:07:05.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:07:05.978 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:07:36.142 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:07:36.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:07:36.147 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:08:06.252 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:08:06.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:08:06.258 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:08:36.435 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:08:36.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:08:36.442 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:09:06.590 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:09:06.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:09:06.595 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:09:36.787 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:09:36.790 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:09:36.792 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:10:06.984 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:10:06.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:10:06.988 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:10:37.121 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:10:37.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:10:37.126 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:11:07.302 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:11:07.305 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:11:07.307 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:11:37.468 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:11:37.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:11:37.473 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:12:07.594 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:12:07.597 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:12:07.599 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:12:37.713 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:12:37.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:12:37.718 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:13:07.882 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:13:07.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:13:07.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:13:38.045 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:13:38.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:13:38.050 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:14:08.225 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:14:08.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:14:08.230 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:14:38.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:14:38.383 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:14:38.386 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:15:08.594 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:15:08.597 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:15:08.599 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:15:38.791 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:15:38.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:15:38.796 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:16:08.910 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:16:08.913 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:16:08.916 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:16:39.109 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:16:39.112 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:16:39.114 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:17:09.247 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:17:09.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:17:09.252 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:17:39.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:17:39.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:17:39.424 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:18:09.544 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:18:09.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:18:09.548 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:18:39.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:18:39.673 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:18:39.676 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:19:09.843 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:19:09.845 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:19:09.848 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:19:40.014 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:19:40.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:19:40.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:20:10.177 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:20:10.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:20:10.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:20:40.367 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:20:40.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:20:40.372 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:21:10.498 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:21:10.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:21:10.503 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:21:40.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:21:40.654 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:21:40.656 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:22:10.857 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:22:10.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:22:10.862 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:22:40.987 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:22:40.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:22:40.992 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:23:11.106 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:23:11.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:23:11.111 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:23:41.241 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:23:41.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:23:41.246 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:24:11.412 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:24:11.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:24:11.417 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:24:41.809 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:24:41.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:24:41.814 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:25:11.956 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:25:11.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:25:11.961 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:25:42.084 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:25:42.086 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:25:42.088 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:26:12.283 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:26:12.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:26:12.288 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:26:42.463 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:26:42.466 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:26:42.468 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:27:12.606 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:27:12.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:27:12.611 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:27:42.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:27:42.727 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:27:42.729 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:28:12.852 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:28:12.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:28:12.857 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:28:43.041 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:28:43.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:28:43.046 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:29:13.223 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:29:13.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:29:13.228 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:29:43.349 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:29:43.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:29:43.354 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:30:13.522 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:30:13.525 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:30:13.527 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:30:43.745 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:30:43.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:30:43.750 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:31:13.925 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:31:13.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:31:13.930 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:31:44.143 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:31:44.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:31:44.148 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:32:14.285 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:32:14.288 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:32:14.291 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:32:44.403 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:32:44.406 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:32:44.408 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:33:14.588 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:33:14.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:33:14.709 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:33:44.834 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:33:44.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:33:44.839 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:34:15.023 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:34:15.027 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:34:15.029 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:34:45.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:34:45.190 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:34:45.192 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:35:15.314 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:35:15.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:35:15.319 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:35:45.489 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:35:45.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:35:45.494 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:36:15.677 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:36:15.680 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:36:15.682 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:36:45.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:36:45.851 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:36:45.854 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:37:15.980 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:37:15.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:37:15.985 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:37:46.124 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:37:46.127 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:37:46.129 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:38:16.251 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:38:16.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:38:16.257 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:38:46.387 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:38:46.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:38:46.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:39:16.499 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:39:16.502 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:39:16.504 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:39:46.688 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:39:46.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:39:46.693 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:40:16.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:40:16.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:40:16.823 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:40:47.007 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:40:47.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:40:47.012 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:41:17.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:41:17.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:41:17.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:41:47.534 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:41:47.537 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:41:47.539 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:42:17.715 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:42:17.718 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:42:17.720 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:42:47.837 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:42:47.840 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:42:47.842 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:43:17.991 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:43:17.993 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:43:17.996 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:43:48.132 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:43:48.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:43:48.137 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:44:18.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:44:18.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:44:18.325 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:44:48.469 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:44:48.472 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:44:48.475 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:45:18.647 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:45:18.650 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:45:18.652 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:45:48.827 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:45:48.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:45:48.833 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:46:19.016 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:46:19.019 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:46:19.022 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:46:49.222 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:46:49.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:46:49.227 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:47:19.443 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:47:19.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:47:19.448 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:47:49.614 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:47:49.617 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:47:49.619 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:48:19.768 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:48:19.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:48:19.774 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:48:49.958 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:48:49.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:48:49.964 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:49:20.080 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:49:20.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:49:20.085 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:49:50.199 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:49:50.201 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:49:50.204 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:50:20.566 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:50:20.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:50:20.571 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:50:50.771 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:50:50.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:50:50.777 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:51:20.959 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:51:20.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:51:20.965 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:51:51.160 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:51:51.163 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:51:51.165 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:52:21.296 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:52:21.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:52:21.301 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:52:51.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:52:51.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:52:51.424 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:53:21.598 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:53:21.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:53:21.606 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:53:51.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:53:51.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:53:51.728 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:54:21.908 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:54:21.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:54:21.914 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:54:52.020 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:54:52.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:54:52.025 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:55:22.217 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:55:22.220 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:55:22.223 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:55:52.424 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:55:52.427 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:55:52.429 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:56:22.587 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:56:22.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:56:22.592 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:56:52.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:56:52.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:56:52.788 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:57:22.947 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:57:22.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:57:22.953 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:57:53.082 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:57:53.084 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:57:53.087 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:58:23.225 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:58:23.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:58:23.230 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:58:53.420 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:58:53.423 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:58:53.425 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:59:23.555 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:59:23.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:59:23.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:59:53.690 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:59:53.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T02:59:53.696 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:00:23.833 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:00:23.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:00:23.839 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:00:53.992 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:00:53.995 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:00:53.998 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:01:24.214 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:01:24.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:01:24.220 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:01:54.340 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:01:54.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:01:54.346 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:02:24.476 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:02:24.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:02:24.481 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:02:54.654 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:02:54.657 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:02:54.660 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:03:24.826 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:03:24.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:03:24.831 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:03:54.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:03:54.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:03:54.987 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:04:25.144 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:04:25.147 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:04:25.149 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:04:55.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:04:55.289 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:04:55.292 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:05:22.742 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-07-11T03:05:25.429 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:05:25.432 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:05:25.434 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:05:55.582 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:05:55.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:05:55.587 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:06:25.725 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:06:25.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:06:25.730 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:06:55.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:06:55.880 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:06:55.882 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:07:26.042 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:07:26.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:07:26.047 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:07:56.247 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:07:56.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:07:56.252 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:08:26.383 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:08:26.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:08:26.388 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:08:56.557 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:08:56.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:08:56.563 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:09:26.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:09:26.740 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:09:26.742 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:09:56.943 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:09:56.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:09:56.948 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:10:27.066 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:10:27.069 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:10:27.071 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:10:57.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:10:57.190 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:10:57.192 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:11:27.292 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:11:27.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:11:27.297 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:11:57.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:11:57.442 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:11:57.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:12:27.660 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:12:27.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:12:27.664 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:12:57.794 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:12:57.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:12:57.799 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:13:27.979 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:13:27.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:13:27.984 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:13:58.150 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:13:58.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:13:58.155 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:14:28.314 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:14:28.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:14:28.319 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:14:58.452 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:14:58.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:14:58.458 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:15:28.587 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:15:28.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:15:28.592 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:15:58.793 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:15:58.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:15:58.798 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:16:28.976 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:16:28.978 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:16:28.981 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:16:59.080 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:16:59.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:16:59.086 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:17:29.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:17:29.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:17:29.299 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:17:59.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:17:59.442 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:17:59.444 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:18:29.629 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:18:29.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:18:29.634 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:18:59.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:18:59.779 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:18:59.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:19:29.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:19:29.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:19:29.919 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:20:00.095 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:20:00.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:20:00.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:20:30.268 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:20:30.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:20:30.273 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:21:00.426 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:21:00.429 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:21:00.431 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:21:30.544 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:21:30.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:21:30.549 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:22:00.682 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:22:00.685 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:22:00.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:22:30.807 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:22:30.810 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:22:30.813 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:23:00.976 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:23:00.979 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:23:00.981 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:23:31.240 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:23:31.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:23:31.245 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:24:01.411 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:24:01.414 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:24:01.416 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:24:20.203 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-07-11T03:24:31.532 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:24:31.535 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:24:31.537 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:25:01.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:25:01.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:25:01.667 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:25:31.853 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:25:31.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:25:31.857 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:26:02.024 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:26:02.027 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:26:02.029 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:26:32.155 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:26:32.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:26:32.160 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:27:02.293 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:27:02.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:27:02.298 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:27:32.473 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:27:32.476 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:27:32.478 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:28:02.586 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:28:02.589 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:28:02.591 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:28:32.708 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:28:32.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:28:32.713 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:29:02.844 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:29:02.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:29:02.850 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:29:33.044 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:29:33.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:29:33.049 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:30:03.181 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:30:03.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:30:03.187 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:30:33.355 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:30:33.358 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:30:33.361 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:31:03.494 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:31:03.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:31:03.499 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:31:33.690 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:31:33.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:31:33.695 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:32:03.830 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:32:03.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:32:03.835 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:32:33.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:32:33.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:32:33.971 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:33:04.147 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:33:04.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:33:04.152 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:33:34.270 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:33:34.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:33:34.276 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:34:04.468 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:34:04.471 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:34:04.473 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:34:34.755 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:34:34.758 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:34:34.760 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:35:04.884 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:35:04.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:35:04.890 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:35:34.995 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:35:34.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:35:35.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:36:05.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:36:05.182 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:36:05.184 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:36:35.342 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:36:35.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:36:35.347 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:37:05.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:37:05.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:37:05.557 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:37:35.695 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:37:35.698 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:37:35.700 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:38:05.830 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:38:05.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:38:05.835 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:38:35.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:38:35.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:38:35.970 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:39:06.093 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:39:06.096 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:39:06.098 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:39:36.237 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:39:36.239 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:39:36.242 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:40:06.372 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:40:06.375 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:40:06.377 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:40:36.507 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:40:36.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:40:36.512 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:41:06.660 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:41:06.663 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:41:06.665 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:41:36.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:41:36.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:41:36.827 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:42:06.980 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:42:06.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:42:06.985 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:42:37.115 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:42:37.118 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:42:37.120 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:43:07.251 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:43:07.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:43:07.258 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:43:37.395 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:43:37.398 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:43:37.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:44:07.568 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:44:07.571 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:44:07.573 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:44:37.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:44:37.727 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:44:37.729 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:45:07.913 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:45:07.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:45:07.917 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:45:38.036 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:45:38.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:45:38.041 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:46:08.172 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:46:08.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:46:08.178 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:46:38.299 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:46:38.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:46:38.304 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:47:08.492 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:47:08.494 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:47:08.497 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:47:38.680 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:47:38.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:47:38.685 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:48:09.077 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:48:09.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:48:09.082 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:48:39.256 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:48:39.259 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:48:39.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:49:09.384 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:49:09.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:49:09.390 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:49:39.566 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:49:39.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:49:39.571 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:50:09.688 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:50:09.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:50:09.694 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:50:39.886 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:50:39.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:50:39.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:51:10.107 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:51:10.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:51:10.112 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:51:40.254 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:51:40.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:51:40.259 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:52:10.389 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:52:10.392 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:52:10.394 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:52:40.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:52:40.536 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:52:40.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:53:10.659 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:53:10.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:53:10.665 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:53:40.812 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:53:40.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:53:40.818 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:54:10.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:54:10.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:54:10.944 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:54:41.091 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:54:41.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:54:41.097 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:55:11.226 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:55:11.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:55:11.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:55:41.378 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:55:41.381 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:55:41.384 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:56:11.539 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:56:11.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:56:11.550 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:56:41.691 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:56:41.695 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:56:41.699 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:57:11.826 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:57:11.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:57:11.832 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:57:42.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:57:42.038 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:57:42.041 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:58:12.205 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:58:12.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:58:12.211 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:58:42.385 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:58:42.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:58:42.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:59:12.565 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:59:12.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:59:12.570 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:59:42.720 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:59:42.724 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T03:59:42.726 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:00:12.852 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:00:12.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:00:12.861 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:00:42.999 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:00:43.002 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:00:43.005 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:01:13.147 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:01:13.154 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:01:13.159 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:01:43.295 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:01:43.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:01:43.307 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:02:13.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:02:13.457 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:02:13.460 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:02:43.636 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:02:43.639 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:02:43.642 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:03:13.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:03:13.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:03:13.795 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:03:43.979 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:03:43.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:03:43.985 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:04:14.118 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:04:14.128 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:04:14.132 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:04:44.307 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:04:44.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:04:44.312 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:05:14.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:05:14.489 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:05:14.492 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:05:44.638 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:05:44.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:05:44.644 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:06:14.823 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:06:14.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:06:14.831 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:06:44.940 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:06:44.943 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:06:44.945 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:07:15.115 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:07:15.118 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:07:15.120 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:07:45.505 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:07:45.508 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:07:45.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:08:15.902 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:08:15.907 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:08:15.910 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:08:46.049 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:08:46.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:08:46.055 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:09:16.184 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:09:16.188 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:09:16.190 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:09:46.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:09:46.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:09:46.363 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:10:16.487 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:10:16.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:10:16.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:10:46.623 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:10:46.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:10:46.629 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:11:16.758 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:11:16.762 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:11:16.764 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:11:46.894 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:11:46.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:11:46.899 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:12:17.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:12:17.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:12:17.282 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:12:47.406 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:12:47.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:12:47.412 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:13:17.579 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:13:17.582 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:13:17.584 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:13:47.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:13:47.779 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:13:47.782 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:14:17.948 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:14:17.951 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:14:17.953 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:14:48.098 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:14:48.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:14:48.104 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:15:18.291 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:15:18.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:15:18.297 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:15:48.443 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:15:48.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:15:48.448 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:16:18.576 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:16:18.580 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:16:18.583 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:16:48.689 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:16:48.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:16:48.694 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:17:18.833 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:17:18.836 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:17:18.838 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:17:49.116 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:17:49.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:17:49.121 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:18:19.262 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:18:19.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:18:19.267 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:18:49.389 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:18:49.392 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:18:49.394 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:19:19.697 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:19:19.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:19:19.702 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:19:49.893 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:19:49.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:19:49.900 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:20:20.029 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:20:20.033 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:20:20.035 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:20:50.230 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:20:50.233 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:20:50.236 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:21:20.376 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:21:20.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:21:20.382 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:21:50.510 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:21:50.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:21:50.516 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:22:20.653 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:22:20.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:22:20.658 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:22:50.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:22:50.828 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:22:50.831 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:23:20.974 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:23:20.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:23:20.979 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:23:51.118 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:23:51.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:23:51.123 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:24:21.305 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:24:21.308 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:24:21.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:24:51.447 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:24:51.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:24:51.454 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:25:21.599 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:25:21.602 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:25:21.605 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:25:51.735 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:25:51.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:25:51.740 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:26:21.881 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:26:21.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:26:21.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:26:51.996 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:26:52.000 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:26:52.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:27:22.135 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:27:22.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:27:22.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:27:52.251 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:27:52.254 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:27:52.257 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:28:22.427 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:28:22.430 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:28:22.432 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:28:52.589 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:28:52.592 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:28:52.594 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:29:22.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:29:22.753 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:29:22.757 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:29:52.904 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:29:52.907 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:29:52.910 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:30:23.089 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:30:23.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:30:23.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:30:53.231 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:30:53.233 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:30:53.236 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:31:23.394 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:31:23.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:31:23.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:31:53.587 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:31:53.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:31:53.592 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:32:23.720 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:32:23.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:32:23.726 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:32:53.906 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:32:53.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:32:53.911 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:33:24.094 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:33:24.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:33:24.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:33:54.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:33:54.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:33:54.244 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:34:24.702 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:34:24.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:34:24.710 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:34:54.917 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:34:54.921 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:34:54.925 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:35:25.056 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:35:25.060 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:35:25.062 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:35:55.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:35:55.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:35:55.272 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:36:25.385 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:36:25.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:36:25.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:36:55.513 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:36:55.516 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:36:55.518 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:37:25.640 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:37:25.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:37:25.645 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:37:55.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:37:55.788 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:37:55.791 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:38:25.968 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:38:25.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:38:25.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:38:56.257 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:38:56.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:38:56.264 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:39:26.528 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:39:26.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:39:26.534 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:39:56.725 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:39:56.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:39:56.730 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:40:26.897 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:40:26.900 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:40:26.903 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:40:57.076 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:40:57.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:40:57.081 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:41:27.215 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:41:27.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:41:27.221 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:41:57.603 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:41:57.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:41:57.610 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:42:27.752 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:42:27.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:42:27.757 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:42:57.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:42:57.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:42:57.944 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:43:28.175 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:43:28.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:43:28.180 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:43:58.364 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:43:58.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:43:58.373 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:44:28.536 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:44:28.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:44:28.541 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:44:58.678 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:44:58.681 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:44:58.683 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:45:28.854 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:45:28.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:45:28.860 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:45:59.000 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:45:59.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:45:59.008 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:46:29.134 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:46:29.137 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:46:29.139 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:46:59.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:46:59.290 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:46:59.293 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:47:29.450 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:47:29.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:47:29.455 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:47:59.591 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:47:59.594 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:47:59.596 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:48:29.743 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:48:29.746 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:48:29.749 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:48:59.920 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:48:59.923 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:48:59.925 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:49:30.094 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:49:30.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:49:30.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:50:00.292 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:50:00.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:50:00.298 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:50:30.434 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:50:30.437 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:50:30.439 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:51:00.635 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:51:00.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:51:00.640 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:51:30.756 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:51:30.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:51:30.762 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:52:00.902 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:52:00.905 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:52:00.908 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:52:31.043 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:52:31.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:52:31.048 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:53:01.213 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:53:01.216 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:53:01.219 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:53:31.336 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:53:31.339 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:53:31.341 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:54:01.473 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:54:01.475 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:54:01.478 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:54:31.625 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:54:31.628 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:54:31.630 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:55:01.816 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:55:01.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:55:01.822 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:55:32.033 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:55:32.036 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:55:32.038 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:56:02.227 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:56:02.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:56:02.231 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:56:32.407 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:56:32.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:56:32.412 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:57:02.560 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:57:02.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:57:02.565 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:57:32.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:57:32.753 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:57:32.755 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:58:02.904 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:58:02.907 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:58:02.909 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:58:33.058 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:58:33.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:58:33.064 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:59:03.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:59:03.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:59:03.208 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:59:33.312 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:59:33.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T04:59:33.319 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:00:03.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:00:03.435 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:00:03.439 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:00:33.614 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:00:33.618 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:00:33.625 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:01:03.819 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:01:03.822 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:01:03.825 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:01:33.962 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:01:33.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:01:33.968 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:02:04.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:02:04.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:02:04.077 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:02:34.318 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:02:34.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:02:34.324 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:03:04.501 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:03:04.504 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:03:04.506 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:03:34.619 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:03:34.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:03:34.624 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:04:04.806 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:04:04.810 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:04:04.813 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:04:34.958 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:04:34.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:04:34.963 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:05:05.086 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:05:05.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:05:05.092 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:05:35.229 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:05:35.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:05:35.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:06:05.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:06:05.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:06:05.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:06:35.714 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:06:35.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:06:35.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:07:05.843 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:07:05.845 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:07:05.850 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:07:35.971 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:07:35.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:07:35.976 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:08:06.106 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:08:06.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:08:06.112 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:08:36.225 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:08:36.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:08:36.230 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:09:06.368 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:09:06.371 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:09:06.373 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:09:36.503 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:09:36.506 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:09:36.508 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:10:06.656 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:10:06.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:10:06.661 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:10:36.791 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:10:36.793 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:10:36.795 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:11:07.027 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:11:07.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:11:07.032 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:11:37.170 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:11:37.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:11:37.175 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:12:07.370 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:12:07.373 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:12:07.376 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:12:37.544 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:12:37.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:12:37.549 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:13:07.722 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:13:07.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:13:07.727 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:13:37.853 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:13:37.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:13:37.859 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:14:08.031 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:14:08.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:14:08.037 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:14:38.144 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:14:38.147 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:14:38.150 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:15:08.284 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:15:08.287 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:15:08.290 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:15:38.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:15:38.443 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:15:38.446 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:16:08.588 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:16:08.592 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:16:08.595 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:16:38.806 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:16:38.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:16:38.812 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:17:08.994 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:17:08.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:17:09.001 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:17:39.120 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:17:39.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:17:39.127 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:18:09.304 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:18:09.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:18:09.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:18:39.501 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:18:39.504 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:18:39.506 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:19:09.642 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:19:09.645 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:19:09.649 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:19:39.828 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:19:39.831 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:19:39.834 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:20:09.963 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:20:09.967 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:20:09.970 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:20:40.140 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:20:40.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:20:40.148 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:21:10.268 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:21:10.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:21:10.275 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:21:40.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:21:40.443 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:21:40.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:22:10.611 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:22:10.614 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:22:10.617 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:22:40.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:22:40.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:22:40.793 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:23:10.926 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:23:10.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:23:10.931 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:23:41.102 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:23:41.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:23:41.107 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:24:11.222 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:24:11.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:24:11.228 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:24:41.616 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:24:41.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:24:41.622 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:25:11.816 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:25:11.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:25:11.821 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:25:41.945 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:25:41.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:25:41.952 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:26:12.110 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:26:12.113 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:26:12.115 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:26:42.251 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:26:42.254 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:26:42.257 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:27:12.452 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:27:12.456 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:27:12.459 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:27:42.608 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:27:42.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:27:42.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:28:12.903 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:28:12.906 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:28:12.909 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:28:43.141 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:28:43.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:28:43.147 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:29:13.265 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:29:13.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:29:13.270 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:29:43.451 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:29:43.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:29:43.457 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:30:13.607 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:30:13.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:30:13.612 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:30:43.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:30:43.746 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:30:43.750 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:31:13.895 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:31:13.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:31:13.900 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:31:44.095 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:31:44.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:31:44.102 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:32:14.268 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:32:14.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:32:14.275 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:32:44.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:32:44.442 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:32:44.444 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:33:14.627 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:33:14.630 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:33:14.632 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:33:44.834 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:33:44.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:33:44.839 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:34:15.030 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:34:15.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:34:15.034 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:34:45.150 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:34:45.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:34:45.155 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:35:15.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:35:15.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:35:15.299 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:35:45.463 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:35:45.466 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:35:45.468 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:36:15.607 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:36:15.610 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:36:15.612 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:36:45.734 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:36:45.737 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:36:45.740 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:37:15.878 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:37:15.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:37:15.884 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:37:46.091 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:37:46.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:37:46.096 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:38:16.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:38:16.281 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:38:16.283 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:38:46.466 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:38:46.469 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:38:46.471 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:39:16.663 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:39:16.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:39:16.670 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:39:46.798 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:39:46.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:39:46.804 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:40:16.948 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:40:16.951 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:40:16.954 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:40:47.153 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:40:47.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:40:47.158 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:41:17.310 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:41:17.313 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:41:17.315 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:41:47.480 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:41:47.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:41:47.486 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:42:17.640 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:42:17.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:42:17.645 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:42:47.839 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:42:47.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:42:47.844 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:43:17.994 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:43:17.997 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:43:18.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:43:48.192 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:43:48.195 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:43:48.197 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:44:18.340 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:44:18.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:44:18.345 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:44:48.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:44:48.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:44:48.527 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:45:18.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:45:18.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:45:18.731 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:45:48.888 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:45:48.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:45:48.893 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:46:19.031 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:46:19.035 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:46:19.037 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:46:49.167 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:46:49.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:46:49.172 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:47:19.363 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:47:19.365 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:47:19.368 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:47:49.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:47:49.629 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:47:49.632 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:48:19.815 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:48:19.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:48:19.820 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:48:49.985 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:48:49.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:48:49.991 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:49:20.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:49:20.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:49:20.133 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:49:50.296 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:49:50.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:49:50.302 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:50:20.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:50:20.443 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:50:20.446 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:50:50.618 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:50:50.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:50:50.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:51:20.719 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:51:20.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:51:20.724 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:51:50.926 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:51:50.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:51:50.931 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:52:21.048 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:52:21.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:52:21.053 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:52:51.244 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:52:51.248 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:52:51.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:53:21.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:53:21.368 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:53:21.370 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:53:51.521 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:53:51.525 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:53:51.527 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:54:21.700 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:54:21.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:54:21.707 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:54:51.880 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:54:51.882 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:54:51.885 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:55:22.178 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:55:22.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:55:22.183 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:55:52.321 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:55:52.324 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:55:52.326 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:56:22.504 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:56:22.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:56:22.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:56:52.642 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:56:52.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:56:52.647 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:57:22.815 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:57:22.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:57:22.820 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:57:52.962 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:57:52.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:57:52.968 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:58:23.097 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:58:23.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:58:23.103 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:58:53.304 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:58:53.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:58:53.309 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:59:23.444 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:59:23.447 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:59:23.451 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:59:53.631 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:59:53.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T05:59:53.636 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:00:23.894 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:00:23.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:00:23.899 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:00:54.092 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:00:54.095 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:00:54.097 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:01:24.228 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:01:24.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:01:24.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:01:54.424 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:01:54.427 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:01:54.430 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:02:24.564 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:02:24.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:02:24.573 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:02:54.709 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:02:54.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:02:54.714 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:03:25.101 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:03:25.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:03:25.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:03:55.297 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:03:55.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:03:55.301 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:04:25.460 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:04:25.463 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:04:25.465 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:04:55.640 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:04:55.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:04:55.645 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:05:25.816 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:05:25.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:05:25.822 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:05:55.954 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:05:55.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:05:55.960 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:06:26.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:06:26.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:06:26.136 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:06:56.292 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:06:56.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:06:56.299 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:07:26.426 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:07:26.429 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:07:26.432 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:07:56.562 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:07:56.565 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:07:56.568 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:08:26.697 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:08:26.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:08:26.702 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:08:56.849 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:08:56.852 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:08:56.856 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:09:27.045 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:09:27.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:09:27.050 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:09:57.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:09:57.198 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:09:57.200 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:10:27.363 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:10:27.365 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:10:27.368 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:10:57.500 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:10:57.504 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:10:57.507 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:11:27.635 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:11:27.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:11:27.641 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:11:57.828 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:11:57.831 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:11:57.833 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:12:27.973 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:12:27.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:12:27.979 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:12:58.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:12:58.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:12:58.169 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:13:28.319 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:13:28.321 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:13:28.324 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:13:58.508 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:13:58.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:13:58.513 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:14:28.646 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:14:28.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:14:28.652 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:14:58.783 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:14:58.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:14:58.788 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:15:28.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:15:28.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:15:28.907 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:15:59.029 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:15:59.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:15:59.034 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:16:29.148 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:16:29.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:16:29.153 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:16:59.266 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:16:59.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:16:59.272 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:17:29.377 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:17:29.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:17:29.382 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:17:59.521 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:17:59.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:17:59.526 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:18:29.711 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:18:29.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:18:29.718 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:18:59.858 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:18:59.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:18:59.863 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:19:30.063 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:19:30.065 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:19:30.067 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:20:00.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:20:00.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:20:00.218 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:20:30.416 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:20:30.420 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:20:30.423 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:21:00.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:21:00.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:21:00.556 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:21:30.717 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:21:30.719 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:21:30.722 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:22:01.056 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:22:01.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:22:01.061 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:22:31.244 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:22:31.247 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:22:31.249 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:23:01.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:23:01.443 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:23:01.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:23:31.568 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:23:31.572 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:23:31.575 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:24:01.801 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:24:01.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:24:01.806 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:24:31.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:24:31.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:24:31.937 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:25:02.102 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:25:02.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:25:02.108 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:25:32.308 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:25:32.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:25:32.313 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:26:02.423 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:26:02.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:26:02.428 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:26:32.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:26:32.630 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:26:32.633 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:27:02.815 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:27:02.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:27:02.820 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:27:32.986 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:27:32.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:27:32.992 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:28:03.137 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:28:03.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:28:03.144 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:28:33.312 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:28:33.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:28:33.318 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:29:03.477 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:29:03.504 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:29:03.507 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:29:33.606 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:29:33.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:29:33.612 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:30:03.720 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:30:03.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:30:03.726 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:30:33.908 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:30:33.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:30:33.914 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:31:04.030 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:31:04.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:31:04.036 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:31:34.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:31:34.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:31:34.207 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:32:04.300 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:32:04.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:32:04.307 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:32:34.504 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:32:34.508 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:32:34.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:33:04.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:33:04.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:33:04.807 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:33:34.989 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:33:34.993 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:33:34.996 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:34:05.177 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:34:05.180 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:34:05.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:34:35.283 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:34:35.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:34:35.288 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:35:05.714 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:35:05.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:35:05.718 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:35:35.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:35:35.821 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:35:35.824 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:36:06.007 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:36:06.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:36:06.014 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:36:36.121 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:36:36.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:36:36.126 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:37:06.317 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:37:06.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:37:06.323 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:37:36.481 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:37:36.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:37:36.486 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:38:06.652 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:38:06.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:38:06.657 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:38:36.815 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:38:36.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:38:36.821 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:39:06.946 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:39:06.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:39:06.952 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:39:37.051 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:39:37.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:39:37.056 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:40:07.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:40:07.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:40:07.162 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:40:37.456 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:40:37.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:40:37.461 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:41:07.566 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:41:07.570 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:41:07.572 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:41:37.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:41:37.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:41:37.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:42:07.895 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:42:07.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:42:07.901 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:42:38.141 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:42:38.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:42:38.147 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:43:08.245 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:43:08.248 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:43:08.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:43:38.376 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:43:38.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:43:38.382 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:44:08.556 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:44:08.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:44:08.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:44:38.697 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:44:38.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:44:38.703 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:45:08.899 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:45:08.902 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:45:08.905 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:45:39.005 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:45:39.008 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:45:39.010 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:46:09.144 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:46:09.147 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:46:09.150 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:46:39.271 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:46:39.275 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:46:39.277 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:47:09.415 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:47:09.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:47:09.420 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:47:39.592 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:47:39.595 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:47:39.597 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:48:09.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:48:09.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:48:09.771 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:48:39.944 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:48:39.947 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:48:39.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:49:10.075 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:49:10.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:49:10.081 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:49:40.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:49:40.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:49:40.244 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:50:10.351 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:50:10.354 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:50:10.357 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:50:40.532 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:50:40.535 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:50:40.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:51:10.665 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:51:10.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:51:10.671 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:51:40.792 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:51:40.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:51:40.797 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:52:10.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:52:10.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:52:10.937 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:52:41.079 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:52:41.082 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:52:41.084 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:53:11.223 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:53:11.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:53:11.228 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:53:41.376 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:53:41.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:53:41.381 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:54:11.576 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:54:11.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:54:11.581 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:54:41.780 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:54:41.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:54:41.786 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:55:11.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:55:11.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:55:11.936 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:55:42.058 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:55:42.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:55:42.063 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:56:12.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:56:12.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:56:12.208 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:56:42.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:56:42.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:56:42.325 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:57:12.490 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:57:12.493 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:57:12.495 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:57:42.628 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:57:42.631 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:57:42.634 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:58:12.792 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:58:12.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:58:12.799 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:58:42.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:58:42.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:58:42.945 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:59:13.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:59:13.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:59:13.208 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:59:43.350 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:59:43.354 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T06:59:43.356 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:00:13.772 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:00:13.775 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:00:13.778 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:00:43.921 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:00:43.924 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:00:43.926 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:01:14.073 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:01:14.076 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:01:14.079 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:01:44.262 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:01:44.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:01:44.267 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:02:14.402 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:02:14.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:02:14.407 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:02:44.581 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:02:44.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:02:44.587 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:03:14.698 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:03:14.701 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:03:14.703 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:03:44.882 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:03:44.885 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:03:44.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:04:15.054 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:04:15.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:04:15.060 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:04:45.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:04:45.216 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:04:45.219 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:05:15.364 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:05:15.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:05:15.370 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:05:45.553 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:05:45.556 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:05:45.561 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:06:15.702 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:06:15.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:06:15.710 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:06:45.853 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:06:45.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:06:45.860 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:07:16.060 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:07:16.064 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:07:16.067 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:07:46.191 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:07:46.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:07:46.196 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:08:16.327 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:08:16.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:08:16.333 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:08:46.475 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:08:46.478 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:08:46.481 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:09:16.672 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:09:16.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:09:16.677 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:09:46.861 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:09:46.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:09:46.867 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:10:17.040 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:10:17.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:10:17.046 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:10:47.229 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:10:47.232 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:10:47.234 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:11:17.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:11:17.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:11:17.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:11:47.498 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:11:47.501 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:11:47.503 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:12:17.652 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:12:17.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:12:17.659 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:12:47.830 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:12:47.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:12:47.836 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:13:17.981 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:13:17.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:13:17.986 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:13:48.178 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:13:48.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:13:48.184 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:14:18.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:14:18.336 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:14:18.339 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:14:48.504 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:14:48.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:14:48.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:15:18.702 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:15:18.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:15:18.707 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:15:48.882 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:15:48.886 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:15:48.888 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:16:19.020 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:16:19.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:16:19.025 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:16:49.126 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:16:49.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:16:49.132 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:17:19.305 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:17:19.308 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:17:19.311 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:17:49.414 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:17:49.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:17:49.421 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:18:19.599 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:18:19.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:18:19.607 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:18:49.721 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:18:49.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:18:49.728 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:19:19.851 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:19:19.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:19:19.857 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:19:50.007 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:19:50.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:19:50.012 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:20:20.178 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:20:20.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:20:20.184 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:20:50.450 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:20:50.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:20:50.457 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:21:20.656 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:21:20.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:21:20.662 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:21:50.783 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:21:50.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:21:50.790 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:22:20.995 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:22:20.999 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:22:21.001 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:22:51.170 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:22:51.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:22:51.176 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:23:21.306 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:23:21.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:23:21.312 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:23:51.442 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:23:51.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:23:51.447 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:24:21.586 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:24:21.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:24:21.592 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:24:51.766 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:24:51.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:24:51.772 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:25:21.946 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:25:21.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:25:21.951 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:25:52.135 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:25:52.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:25:52.140 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:26:22.269 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:26:22.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:26:22.274 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:26:52.470 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:26:52.473 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:26:52.475 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:27:22.589 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:27:22.592 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:27:22.595 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:27:52.856 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:27:52.859 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:27:52.861 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:28:23.027 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:28:23.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:28:23.032 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:28:53.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:28:53.182 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:28:53.185 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:29:23.371 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:29:23.375 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:29:23.378 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:29:53.500 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:29:53.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:29:53.506 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:30:23.677 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:30:23.681 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:30:23.684 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:30:53.822 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:30:53.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:30:53.828 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:31:24.066 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:31:24.069 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:31:24.071 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:31:54.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:31:54.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:31:54.270 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:32:24.491 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:32:24.494 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:32:24.497 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:32:54.598 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:32:54.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:32:54.603 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:33:24.720 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:33:24.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:33:24.725 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:33:54.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:33:54.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:33:54.830 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:34:24.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:34:24.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:34:24.943 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:34:55.136 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:34:55.140 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:34:55.142 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:35:25.257 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:35:25.260 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:35:25.263 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:35:55.446 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:35:55.448 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:35:55.451 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:36:25.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:36:25.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:36:25.556 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:36:55.647 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:36:55.651 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:36:55.654 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:37:25.827 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:37:25.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:37:25.832 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:37:56.033 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:37:56.036 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:37:56.038 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:38:26.146 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:38:26.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:38:26.151 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:38:56.285 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:38:56.288 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:38:56.291 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:39:26.398 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:39:26.401 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:39:26.403 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:39:56.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:39:56.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:39:56.517 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:40:26.708 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:40:26.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:40:26.713 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:40:56.826 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:40:56.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:40:56.832 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:41:26.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:41:26.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:41:26.988 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:41:57.134 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:41:57.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:41:57.148 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:42:27.285 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:42:27.288 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:42:27.291 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:42:57.437 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:42:57.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:42:57.442 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:43:27.573 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:43:27.577 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:43:27.580 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:43:57.760 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:43:57.763 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:43:57.766 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:44:27.948 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:44:27.951 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:44:27.953 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:44:58.087 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:44:58.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:44:58.092 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:45:28.198 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:45:28.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:45:28.203 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:45:58.324 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:45:58.328 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:45:58.330 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:46:28.452 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:46:28.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:46:28.457 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:46:58.657 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:46:58.660 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:46:58.663 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:47:28.888 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:47:28.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:47:28.893 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:47:59.075 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:47:59.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:47:59.081 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:48:29.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:48:29.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:48:29.207 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:48:59.402 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:48:59.406 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:48:59.408 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:49:29.599 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:49:29.602 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:49:29.604 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:49:59.733 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:49:59.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:49:59.738 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:50:29.885 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:50:29.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:50:29.890 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:51:00.020 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:51:00.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:51:00.026 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:51:30.136 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:51:30.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:51:30.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:52:00.257 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:52:00.260 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:52:00.263 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:52:30.404 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:52:30.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:52:30.409 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:53:00.538 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:53:00.541 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:53:00.543 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:53:30.665 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:53:30.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:53:30.670 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:54:00.816 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:54:00.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:54:00.821 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:54:30.960 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:54:30.963 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:54:30.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:55:01.096 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:55:01.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:55:01.102 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:55:31.240 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:55:31.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:55:31.245 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:56:01.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:56:01.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:56:01.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:56:31.496 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:56:31.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:56:31.502 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:57:01.675 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:57:01.678 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:57:01.681 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:57:31.806 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:57:31.810 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:57:31.814 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:58:01.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:58:02.000 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:58:02.004 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:58:32.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:58:32.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:58:32.133 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:59:02.255 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:59:02.258 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:59:02.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:59:32.390 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:59:32.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T07:59:32.397 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:00:02.534 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:00:02.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:00:02.541 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:00:32.653 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:00:32.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:00:32.659 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:01:02.841 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:01:02.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:01:02.847 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:01:33.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:01:33.028 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:01:33.030 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:02:03.185 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:02:03.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:02:03.190 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:02:33.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:02:33.368 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:02:33.370 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:03:03.478 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:03:03.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:03:03.484 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:03:33.667 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:03:33.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:03:33.672 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:04:03.780 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:04:03.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:04:03.785 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:04:33.884 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:04:33.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:04:33.891 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:05:04.046 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:05:04.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:05:04.052 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:05:34.220 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:05:34.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:05:34.226 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:06:04.400 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:06:04.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:06:04.407 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:06:34.588 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:06:34.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:06:34.593 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:07:04.753 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:07:04.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:07:04.758 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:07:34.974 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:07:34.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:07:34.979 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:08:05.146 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:08:05.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:08:05.151 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:08:35.293 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:08:35.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:08:35.299 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:09:05.473 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:09:05.476 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:09:05.478 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:09:35.623 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:09:35.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:09:35.629 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:10:05.792 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:10:05.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:10:05.797 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:10:35.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:10:35.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:10:35.919 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:11:06.110 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:11:06.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:11:06.116 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:11:36.299 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:11:36.303 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:11:36.306 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:12:06.504 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:12:06.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:12:06.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:12:36.667 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:12:36.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:12:36.672 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:13:06.795 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:13:06.798 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:13:06.802 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:13:36.978 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:13:36.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:13:36.983 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:14:07.108 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:14:07.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:14:07.114 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:14:37.297 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:14:37.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:14:37.302 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:15:07.463 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:15:07.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:15:07.468 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:15:37.580 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:15:37.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:15:37.587 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:16:07.708 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:16:07.712 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:16:07.714 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:16:37.860 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:16:37.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:16:37.865 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:17:08.004 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:17:08.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:17:08.010 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:17:38.203 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:17:38.206 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:17:38.209 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:18:08.509 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:18:08.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:18:08.516 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:18:38.664 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:18:38.666 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:18:38.669 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:19:08.812 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:19:08.814 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:19:08.817 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:19:38.947 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:19:38.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:19:38.952 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:20:09.112 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:20:09.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:20:09.118 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:20:39.235 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:20:39.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:20:39.241 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:21:09.423 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:21:09.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:21:09.428 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:21:39.556 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:21:39.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:21:39.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:22:09.686 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:22:09.689 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:22:09.691 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:22:39.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:22:39.821 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:22:39.823 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:23:09.946 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:23:09.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:23:09.951 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:23:40.072 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:23:40.075 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:23:40.078 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:24:10.296 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:24:10.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:24:10.301 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:24:40.452 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:24:40.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:24:40.457 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:25:10.596 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:25:10.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:25:10.601 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:25:40.787 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:25:40.790 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:25:40.792 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:26:10.924 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:26:10.927 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:26:10.930 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:26:41.060 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:26:41.063 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:26:41.066 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:27:11.278 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:27:11.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:27:11.283 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:27:41.482 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:27:41.485 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:27:41.488 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:28:11.654 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:28:11.657 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:28:11.661 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:28:41.959 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:28:41.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:28:41.965 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:29:12.086 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:29:12.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:29:12.092 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:29:42.239 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:29:42.242 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:29:42.244 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:30:12.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:30:12.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:30:12.439 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:30:42.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:30:42.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:30:42.577 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:31:12.745 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:31:12.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:31:12.752 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:31:43.098 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:31:43.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:31:43.103 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:32:13.291 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:32:13.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:32:13.296 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:32:43.443 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:32:43.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:32:43.448 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:33:13.639 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:33:13.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:33:13.645 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:33:43.836 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:33:43.839 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:33:43.841 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:34:13.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:34:13.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:34:13.972 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:34:44.101 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:34:44.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:34:44.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:35:14.245 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:35:14.248 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:35:14.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:35:44.436 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:35:44.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:35:44.441 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:36:14.565 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:36:14.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:36:14.571 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:36:44.685 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:36:44.688 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:36:44.690 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:37:14.887 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:37:14.890 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:37:14.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:37:45.059 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:37:45.062 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:37:45.064 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:38:15.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:38:15.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:38:15.244 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:38:45.435 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:38:45.438 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:38:45.441 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:39:15.657 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:39:15.660 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:39:15.662 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:39:45.854 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:39:45.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:39:45.861 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:40:16.125 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:40:16.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:40:16.131 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:40:46.276 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:40:46.279 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:40:46.282 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:41:16.412 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:41:16.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:41:16.418 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:41:46.581 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:41:46.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:41:46.588 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:42:16.770 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:42:16.773 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:42:16.775 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:42:46.917 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:42:46.920 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:42:46.924 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:43:17.044 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:43:17.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:43:17.055 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:43:47.218 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:43:47.222 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:43:47.225 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:44:17.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:44:17.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:44:17.422 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:44:47.579 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:44:47.582 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:44:47.584 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:45:17.728 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:45:17.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:45:17.733 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:45:47.880 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:45:47.883 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:45:47.886 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:46:18.086 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:46:18.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:46:18.093 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:46:48.274 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:46:48.278 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:46:48.281 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:47:18.470 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:47:18.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:47:18.478 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:47:48.583 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:47:48.587 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:47:48.590 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:48:18.696 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:48:18.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:48:18.703 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:48:48.893 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:48:48.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:48:48.898 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:49:19.014 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:49:19.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:49:19.020 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:49:49.119 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:49:49.122 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:49:49.125 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:50:19.283 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:50:19.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:50:19.288 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:50:49.455 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:50:49.458 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:50:49.461 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:51:19.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:51:19.628 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:51:19.631 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:51:49.806 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:51:49.811 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:51:49.817 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:52:19.969 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:52:19.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:52:19.976 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:52:50.084 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:52:50.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:52:50.091 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:53:20.270 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:53:20.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:53:20.276 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:53:50.407 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:53:50.410 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:53:50.412 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:54:20.540 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:54:20.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:54:20.546 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:54:50.718 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:54:50.721 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:54:50.724 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:55:20.845 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:55:20.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:55:20.851 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:55:50.979 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:55:50.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:55:50.986 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:56:21.132 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:56:21.135 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:56:21.137 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:56:51.259 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:56:51.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:56:51.264 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:57:21.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:57:21.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:57:21.426 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:57:51.608 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:57:51.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:57:51.613 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:58:21.756 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:58:21.759 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:58:21.761 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:58:51.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:58:51.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:58:51.906 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:59:22.036 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:59:22.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:59:22.043 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:59:52.146 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:59:52.148 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T08:59:52.150 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:00:22.281 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:00:22.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:00:22.287 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:00:52.409 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:00:52.412 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:00:52.414 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:01:22.536 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:01:22.539 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:01:22.542 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:01:52.680 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:01:52.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:01:52.685 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:02:22.815 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:02:22.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:02:22.821 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:02:52.968 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:02:52.971 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:02:52.973 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:03:23.103 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:03:23.108 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:03:23.111 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:03:53.247 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:03:53.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:03:53.254 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:04:23.392 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:04:23.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:04:23.397 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:04:53.567 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:04:53.570 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:04:53.572 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:05:23.696 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:05:23.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:05:23.702 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:05:53.838 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:05:53.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:05:53.843 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:06:23.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:06:23.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:06:23.971 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:06:54.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:06:54.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:06:54.116 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:07:24.283 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:07:24.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:07:24.288 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:07:54.480 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:07:54.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:07:54.485 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:08:24.667 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:08:24.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:08:24.673 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:08:54.839 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:08:54.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:08:54.843 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:09:24.969 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:09:24.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:09:24.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:09:55.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:09:55.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:09:55.163 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:10:25.345 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:10:25.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:10:25.351 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:10:55.487 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:10:55.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:10:55.492 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:11:25.664 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:11:25.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:11:25.670 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:11:55.788 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:11:55.791 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:11:55.794 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:12:25.916 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:12:25.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:12:25.922 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:12:56.043 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:12:56.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:12:56.050 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:13:26.186 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:13:26.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:13:26.191 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:13:56.304 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:13:56.308 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:13:56.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:14:26.458 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:14:26.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:14:26.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:14:56.640 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:14:56.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:14:56.645 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:15:26.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:15:26.823 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:15:26.825 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:15:56.999 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:15:57.002 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:15:57.005 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:16:27.205 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:16:27.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:16:27.210 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:16:57.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:16:57.329 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:16:57.332 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:17:27.515 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:17:27.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:17:27.520 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:17:57.720 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:17:57.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:17:57.725 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:18:27.840 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:18:27.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:18:27.846 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:18:57.984 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:18:57.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:18:57.990 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:19:28.167 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:19:28.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:19:28.173 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:19:58.347 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:19:58.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:19:58.353 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:20:28.545 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:20:28.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:20:28.551 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:20:58.740 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:20:58.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:20:58.745 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:21:28.845 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:21:28.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:21:28.851 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:21:58.949 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:21:58.953 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:21:58.957 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:22:29.053 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:22:29.056 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:22:29.059 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:22:59.167 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:22:59.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:22:59.172 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:23:29.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:23:29.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:23:29.301 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:23:59.502 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:23:59.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:23:59.508 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:24:29.690 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:24:29.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:24:29.695 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:24:59.826 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:24:59.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:24:59.832 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:25:30.016 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:25:30.019 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:25:30.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:26:00.163 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:26:00.166 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:26:00.168 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:26:30.375 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:26:30.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:26:30.380 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:27:00.580 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:27:00.583 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:27:00.586 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:27:30.760 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:27:30.763 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:27:30.766 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:28:00.948 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:28:00.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:28:00.958 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:28:31.100 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:28:31.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:28:31.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:29:01.275 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:29:01.278 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:29:01.280 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:29:31.447 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:29:31.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:29:31.452 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:30:01.701 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:30:01.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:30:01.707 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:30:31.915 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:30:31.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:30:31.920 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:31:02.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:31:02.113 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:31:02.116 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:31:32.290 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:31:32.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:31:32.296 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:32:02.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:32:02.489 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:32:02.491 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:32:32.675 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:32:32.678 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:32:32.680 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:33:02.838 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:33:02.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:33:02.845 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:33:33.017 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:33:33.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:33:33.023 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:34:03.206 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:34:03.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:34:03.211 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:34:33.350 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:34:33.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:34:33.355 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:35:03.457 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:35:03.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:35:03.462 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:35:33.637 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:35:33.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:35:33.642 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:36:03.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:36:03.745 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:36:03.748 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:36:34.155 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:36:34.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:36:34.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:37:04.268 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:37:04.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:37:04.274 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:37:34.490 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:37:34.493 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:37:34.495 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:38:04.678 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:38:04.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:38:04.684 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:38:34.858 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:38:34.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:38:34.863 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:39:05.063 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:39:05.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:39:05.069 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:39:35.252 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:39:35.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:39:35.257 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:40:05.456 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:40:05.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:40:05.462 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:40:35.661 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:40:35.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:40:35.668 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:41:05.866 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:41:05.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:41:05.871 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:41:36.003 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:41:36.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:41:36.008 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:42:06.138 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:42:06.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:42:06.143 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:42:36.330 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:42:36.333 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:42:36.335 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:43:06.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:43:06.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:43:06.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:43:36.653 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:43:36.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:43:36.658 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:44:06.845 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:44:06.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:44:06.850 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:44:37.017 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:44:37.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:44:37.022 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:45:07.180 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:45:07.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:45:07.185 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:45:37.319 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:45:37.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:45:37.325 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:46:07.499 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:46:07.502 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:46:07.504 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:46:37.670 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:46:37.673 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:46:37.675 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:47:07.841 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:47:07.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:47:07.846 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:47:38.063 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:47:38.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:47:38.069 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:48:08.206 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:48:08.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:48:08.212 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:48:38.374 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:48:38.376 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:48:38.379 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:49:08.578 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:49:08.581 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:49:08.584 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:49:38.766 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:49:38.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:49:38.771 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:50:08.929 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:50:08.932 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:50:08.934 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:50:39.116 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:50:39.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:50:39.122 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:51:09.288 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:51:09.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:51:09.294 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:51:39.493 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:51:39.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:51:39.499 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:52:09.646 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:52:09.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:52:09.651 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:52:39.837 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:52:39.850 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:52:39.855 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:53:10.066 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:53:10.069 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:53:10.071 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:53:40.210 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:53:40.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:53:40.215 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:54:10.410 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:54:10.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:54:10.415 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:54:40.598 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:54:40.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:54:40.603 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:55:10.769 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:55:10.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:55:10.774 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:55:40.957 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:55:40.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:55:40.962 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:56:11.078 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:56:11.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:56:11.082 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:56:41.222 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:56:41.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:56:41.227 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:57:11.414 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:57:11.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:57:11.419 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:57:41.618 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:57:41.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:57:41.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:58:11.790 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:58:11.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:58:11.795 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:58:41.978 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:58:41.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:58:41.982 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:59:12.165 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:59:12.168 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:59:12.171 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:59:42.269 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:59:42.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T09:59:42.274 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:00:12.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:00:12.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:00:12.438 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:00:42.623 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:00:42.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:00:42.628 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:01:12.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:01:12.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:01:12.807 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:01:42.915 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:01:42.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:01:42.920 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:02:13.052 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:02:13.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:02:13.057 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:02:43.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:02:43.186 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:02:43.188 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:03:13.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:03:13.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:03:13.334 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:03:43.577 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:03:43.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:03:43.582 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:04:13.719 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:04:13.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:04:13.724 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:04:43.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:04:43.880 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:04:43.882 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:05:14.058 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:05:14.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:05:14.063 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:05:44.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:05:44.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:05:44.243 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:06:14.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:06:14.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:06:14.406 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:06:44.563 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:06:44.566 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:06:44.568 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:07:14.752 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:07:14.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:07:14.757 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:07:44.931 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:07:44.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:07:44.937 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:08:15.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:08:15.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:08:15.134 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:08:45.324 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:08:45.327 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:08:45.329 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:09:15.488 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:09:15.491 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:09:15.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:09:45.810 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:09:45.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:09:45.815 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:10:15.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:10:16.000 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:10:16.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:10:46.138 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:10:46.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:10:46.143 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:11:16.274 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:11:16.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:11:16.280 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:11:46.476 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:11:46.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:11:46.481 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:12:16.891 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:12:16.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:12:16.896 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:12:47.021 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:12:47.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:12:47.026 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:13:17.156 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:13:17.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:13:17.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:13:47.283 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:13:47.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:13:47.289 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:14:17.461 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:14:17.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:14:17.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:14:47.597 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:14:47.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:14:47.602 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:15:17.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:15:17.740 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:15:17.742 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:15:47.934 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:15:47.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:15:47.939 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:16:18.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:16:18.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:16:18.136 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:16:48.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:16:48.331 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:16:48.334 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:17:18.473 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:17:18.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:17:18.479 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:17:48.600 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:17:48.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:17:48.606 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:18:18.727 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:18:18.730 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:18:18.732 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:18:48.940 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:18:48.943 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:18:48.946 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:19:19.117 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:19:19.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:19:19.122 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:19:49.292 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:19:49.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:19:49.297 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:20:19.469 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:20:19.472 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:20:19.475 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:20:49.640 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:20:49.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:20:49.645 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:21:19.837 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:21:19.840 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:21:19.842 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:21:49.950 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:21:49.952 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:21:49.955 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:22:20.155 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:22:20.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:22:20.160 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:22:50.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:22:50.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:22:50.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:23:20.532 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:23:20.534 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:23:20.537 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:23:50.712 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:23:50.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:23:50.718 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:24:20.816 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:24:20.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:24:20.822 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:24:50.995 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:24:50.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:24:51.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:25:21.167 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:25:21.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:25:21.172 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:25:51.266 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:25:51.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:25:51.271 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:26:21.437 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:26:21.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:26:21.442 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:26:51.634 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:26:51.637 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:26:51.639 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:27:21.814 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:27:21.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:27:21.819 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:27:51.994 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:27:51.996 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:27:51.999 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:28:22.107 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:28:22.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:28:22.112 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:28:52.213 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:28:52.216 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:28:52.218 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:29:22.393 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:29:22.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:29:22.398 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:29:52.564 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:29:52.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:29:52.570 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:30:22.745 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:30:22.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:30:22.750 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:30:52.892 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:30:52.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:30:52.898 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:31:23.089 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:31:23.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:31:23.094 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:31:53.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:31:53.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:31:53.207 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:32:23.298 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:32:23.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:32:23.304 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:32:53.403 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:32:53.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:32:53.408 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:33:23.591 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:33:23.594 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:33:23.596 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:33:53.780 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:33:53.782 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:33:53.785 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:34:23.960 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:34:23.963 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:34:23.965 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:34:54.139 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:34:54.142 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:34:54.144 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:35:24.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:35:24.338 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:35:24.341 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:35:54.523 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:35:54.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:35:54.528 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:36:24.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:36:24.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:36:24.657 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:36:54.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:36:54.823 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:36:54.826 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:37:24.980 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:37:24.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:37:24.985 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:37:55.110 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:37:55.113 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:37:55.115 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:38:25.235 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:38:25.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:38:25.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:38:55.445 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:38:55.448 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:38:55.450 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:39:25.616 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:39:25.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:39:25.621 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:39:55.812 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:39:55.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:39:55.817 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:40:25.985 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:40:25.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:40:25.989 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:40:56.317 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:40:56.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:40:56.322 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:41:26.464 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:41:26.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:41:26.469 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:41:56.632 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:41:56.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:41:56.637 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:42:26.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:42:26.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:42:26.829 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:42:57.035 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:42:57.038 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:42:57.040 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:43:27.214 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:43:27.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:43:27.220 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:43:57.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:43:57.359 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:43:57.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:44:27.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:44:27.535 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:44:27.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:44:57.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:44:57.740 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:44:57.742 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:45:27.908 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:45:27.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:45:27.913 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:45:58.049 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:45:58.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:45:58.054 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:46:28.227 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:46:28.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:46:28.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:46:58.414 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:46:58.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:46:58.419 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:47:28.619 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:47:28.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:47:28.624 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:47:58.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:47:58.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:47:58.804 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:48:28.995 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:48:28.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:48:29.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:48:59.192 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:48:59.195 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:48:59.198 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:49:29.355 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:49:29.358 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:49:29.360 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:49:59.535 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:49:59.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:49:59.540 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:50:29.732 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:50:29.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:50:29.738 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:50:59.845 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:50:59.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:50:59.850 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:51:29.963 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:51:29.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:51:29.968 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:52:00.147 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:52:00.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:52:00.152 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:52:30.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:52:30.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:52:30.282 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:53:00.414 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:53:00.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:53:00.419 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:53:30.603 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:53:30.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:53:30.608 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:54:00.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:54:00.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:54:00.789 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:54:30.971 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:54:30.974 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:54:30.976 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:55:01.084 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:55:01.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:55:01.089 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:55:31.182 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:55:31.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:55:31.202 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:56:01.387 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:56:01.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:56:01.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:56:31.583 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:56:31.586 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:56:31.588 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:57:01.947 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:57:01.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:57:01.951 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:57:32.051 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:57:32.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:57:32.056 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:58:02.181 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:58:02.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:58:02.185 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:58:32.353 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:58:32.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:58:32.358 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:59:02.632 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:59:02.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:59:02.639 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:59:32.755 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:59:32.758 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T10:59:32.762 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:00:02.951 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:00:02.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:00:02.958 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:00:33.147 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:00:33.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:00:33.154 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:01:03.344 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:01:03.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:01:03.352 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:01:33.549 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:01:33.553 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:01:33.556 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:02:03.661 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:02:03.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:02:03.667 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:02:33.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:02:33.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:02:33.790 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:03:03.905 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:03:03.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:03:03.912 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:03:34.051 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:03:34.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:03:34.057 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:04:04.248 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:04:04.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:04:04.253 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:04:34.427 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:04:34.430 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:04:34.432 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:05:04.615 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:05:04.618 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:05:04.621 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:05:34.728 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:05:34.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:05:34.734 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:06:04.873 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:06:04.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:06:04.879 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:06:35.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:06:35.028 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:06:35.031 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:07:05.153 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:07:05.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:07:05.158 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:07:35.339 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:07:35.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:07:35.344 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:08:05.553 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:08:05.556 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:08:05.558 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:08:35.708 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:08:35.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:08:35.713 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:09:05.854 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:09:05.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:09:05.859 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:09:36.004 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:09:36.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:09:36.010 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:10:06.180 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:10:06.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:10:06.185 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:10:36.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:10:36.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:10:36.299 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:11:06.407 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:11:06.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:11:06.412 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:11:36.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:11:36.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:11:36.517 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:12:06.716 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:12:06.719 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:12:06.721 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:12:36.887 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:12:36.890 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:12:36.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:13:07.092 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:13:07.095 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:13:07.097 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:13:37.272 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:13:37.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:13:37.277 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:14:07.460 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:14:07.463 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:14:07.465 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:14:37.765 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:14:37.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:14:37.771 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:15:07.970 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:15:07.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:15:07.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:15:38.108 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:15:38.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:15:38.113 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:16:08.289 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:16:08.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:16:08.293 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:16:38.402 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:16:38.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:16:38.407 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:17:08.583 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:17:08.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:17:08.588 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:17:38.687 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:17:38.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:17:38.692 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:18:08.867 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:18:08.870 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:18:08.872 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:18:39.063 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:18:39.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:18:39.068 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:19:09.227 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:19:09.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:19:09.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:19:39.399 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:19:39.403 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:19:39.405 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:20:09.587 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:20:09.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:20:09.593 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:20:39.775 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:20:39.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:20:39.780 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:21:09.964 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:21:09.967 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:21:09.970 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:21:40.168 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:21:40.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:21:40.174 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:22:10.314 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:22:10.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:22:10.319 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:22:40.488 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:22:40.491 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:22:40.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:23:10.601 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:23:10.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:23:10.606 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:23:40.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:23:40.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:23:40.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:24:10.977 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:24:10.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:24:10.982 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:24:41.090 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:24:41.093 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:24:41.096 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:25:11.226 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:25:11.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:25:11.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:25:41.351 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:25:41.354 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:25:41.356 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:26:11.447 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:26:11.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:26:11.453 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:26:41.611 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:26:41.615 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:26:41.617 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:27:11.725 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:27:11.727 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:27:11.730 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:27:41.846 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:27:41.849 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:27:41.851 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:28:11.959 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:28:11.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:28:11.964 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:28:42.148 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:28:42.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:28:42.153 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:29:12.261 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:29:12.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:29:12.266 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:29:42.474 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:29:42.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:29:42.479 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:30:12.622 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:30:12.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:30:12.627 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:30:42.994 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:30:42.997 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:30:42.999 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:31:13.165 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:31:13.168 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:31:13.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:31:43.328 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:31:43.331 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:31:43.333 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:32:13.507 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:32:13.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:32:13.512 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:32:43.633 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:32:43.636 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:32:43.638 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:33:13.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:33:13.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:33:13.823 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:33:44.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:33:44.027 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:33:44.030 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:34:14.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:34:14.206 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:34:14.208 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:34:44.366 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:34:44.369 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:34:44.371 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:35:14.570 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:35:14.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:35:14.575 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:35:44.767 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:35:44.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:35:44.772 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:36:14.939 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:36:14.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:36:14.944 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:36:45.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:36:45.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:36:45.116 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:37:15.274 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:37:15.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:37:15.279 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:37:45.394 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:37:45.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:37:45.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:38:15.576 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:38:15.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:38:15.581 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:38:45.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:38:45.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:38:45.769 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:39:15.943 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:39:15.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:39:15.948 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:39:46.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:39:46.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:39:46.136 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:40:16.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:40:16.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:40:16.334 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:40:46.734 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:40:46.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:40:46.739 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:41:16.839 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:41:16.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:41:16.845 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-11T11:41:35.408 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-11T11:41:35.487 DEBUG:teuthology.task.console_log:Killing console logger for smithi038 2023-07-11T11:41:35.488 DEBUG:teuthology.task.console_log:Killing console logger for smithi070 2023-07-11T11:41:35.488 DEBUG:teuthology.task.console_log:Killing console logger for smithi131 2023-07-11T11:41:35.488 DEBUG:teuthology.exit:Finished running handlers